[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:40:04 dist-test-slave-t7g5 krb5kdc[12894](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:40:04 dist-test-slave-t7g5 krb5kdc[12894](info): set up 2 sockets
Aug 08 04:40:04 dist-test-slave-t7g5 krb5kdc[12894](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260808 04:40:05.361305 12881 mini_kdc.cc:121] Time spent starting KDC: real 1.307s user 0.007s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Aug 08 04:40:05 dist-test-slave-t7g5 krb5kdc[12894](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164005, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:40:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:40:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.148.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
I20260808 04:40:05.484875 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:39565
--webserver_interface=127.12.148.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:40609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:39565
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:05.596700 12916 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:05.596978 12916 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:05.597036 12916 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:05.601002 12916 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:40:05.601060 12916 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:05.601086 12916 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:05.601107 12916 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:40:05.601136 12916 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:40:05.606350 12916 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:40609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:39565
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:39565
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12916
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:05.607331 12916 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:05.608377 12916 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 04:40:05.616879 12916 server_base.cc:1034] running on GCE node
W20260808 04:40:05.616849 12924 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:05.616926 12923 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:05.616937 12931 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:05.617684 12916 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:05.618752 12916 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:05.619915 12916 hybrid_clock.cc:648] HybridClock initialized: now 1786164005619901 us; error 27 us; skew 500 ppm
Aug 08 04:40:05 dist-test-slave-t7g5 krb5kdc[12894](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164005, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:05.622711 12916 init.cc:377] Logged in from keytab as kudu/127.12.148.126@KRBTEST.COM (short username kudu)
I20260808 04:40:05.623584 12916 webserver.cc:460] Webserver started at http://127.12.148.126:35249/ using document root <none> and password file <none>
I20260808 04:40:05.624123 12916 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:05.624193 12916 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:05.624406 12916 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:05.626459 12916 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "2811eabd7b0a40f89ac01886bdea1aa7"
format_stamp: "Formatted at 2026-08-08 04:40:05 on dist-test-slave-t7g5"
server_key: "5f0cb4737ee97484ee971c88d9f5dc7b"
server_key_iv: "48563447b7bb93658006bfe001369442"
server_key_version: "encryptionkey@0"
I20260808 04:40:05.627003 12916 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "2811eabd7b0a40f89ac01886bdea1aa7"
format_stamp: "Formatted at 2026-08-08 04:40:05 on dist-test-slave-t7g5"
server_key: "5f0cb4737ee97484ee971c88d9f5dc7b"
server_key_iv: "48563447b7bb93658006bfe001369442"
server_key_version: "encryptionkey@0"
I20260808 04:40:05.630616 12916 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 04:40:05.632917 12942 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:05.634104 12916 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:40:05.634217 12916 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "2811eabd7b0a40f89ac01886bdea1aa7"
format_stamp: "Formatted at 2026-08-08 04:40:05 on dist-test-slave-t7g5"
server_key: "5f0cb4737ee97484ee971c88d9f5dc7b"
server_key_iv: "48563447b7bb93658006bfe001369442"
server_key_version: "encryptionkey@0"
I20260808 04:40:05.634311 12916 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:05.667788 12916 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:05.671227 12916 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:05.671420 12916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:05.678612 12916 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:39565
I20260808 04:40:05.678632 13035 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:39565 every 8 connection(s)
I20260808 04:40:05.679584 12916 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:40:05.681161 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 12916
I20260808 04:40:05.681304 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:40:05.682476 13037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:05.682608 12881 external_mini_cluster.cc:1428] Setting key 75269e5954c35eaec4bd36a2f3dff651
I20260808 04:40:05.688925 13037 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2811eabd7b0a40f89ac01886bdea1aa7: Bootstrap starting.
I20260808 04:40:05.691491 13037 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2811eabd7b0a40f89ac01886bdea1aa7: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:05.692338 13037 log.cc:824] T 00000000000000000000000000000000 P 2811eabd7b0a40f89ac01886bdea1aa7: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:05.694599 13037 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2811eabd7b0a40f89ac01886bdea1aa7: No bootstrap required, opened a new log
I20260808 04:40:05.698681 13037 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2811eabd7b0a40f89ac01886bdea1aa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2811eabd7b0a40f89ac01886bdea1aa7" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 39565 } }
I20260808 04:40:05.698990 13037 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2811eabd7b0a40f89ac01886bdea1aa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:05.699054 13037 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2811eabd7b0a40f89ac01886bdea1aa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2811eabd7b0a40f89ac01886bdea1aa7, State: Initialized, Role: FOLLOWER
I20260808 04:40:05.699522 13037 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2811eabd7b0a40f89ac01886bdea1aa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2811eabd7b0a40f89ac01886bdea1aa7" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 39565 } }
I20260808 04:40:05.699689 13037 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2811eabd7b0a40f89ac01886bdea1aa7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:40:05.699760 13037 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2811eabd7b0a40f89ac01886bdea1aa7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:40:05.699872 13037 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2811eabd7b0a40f89ac01886bdea1aa7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:05.701020 13037 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2811eabd7b0a40f89ac01886bdea1aa7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2811eabd7b0a40f89ac01886bdea1aa7" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 39565 } }
I20260808 04:40:05.701401 13037 leader_election.cc:302] T 00000000000000000000000000000000 P 2811eabd7b0a40f89ac01886bdea1aa7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2811eabd7b0a40f89ac01886bdea1aa7; no voters:
I20260808 04:40:05.701785 13037 leader_election.cc:288] T 00000000000000000000000000000000 P 2811eabd7b0a40f89ac01886bdea1aa7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:40:05.701896 13044 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2811eabd7b0a40f89ac01886bdea1aa7 [term 1 FOLLOWER]: Leader election won for term 1
Aug 08 04:40:05 dist-test-slave-t7g5 krb5kdc[12894](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164005, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:40:05.702142 13044 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2811eabd7b0a40f89ac01886bdea1aa7 [term 1 LEADER]: Becoming Leader. State: Replica: 2811eabd7b0a40f89ac01886bdea1aa7, State: Running, Role: LEADER
I20260808 04:40:05.702466 13044 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2811eabd7b0a40f89ac01886bdea1aa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2811eabd7b0a40f89ac01886bdea1aa7" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 39565 } }
I20260808 04:40:05.703121 13037 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2811eabd7b0a40f89ac01886bdea1aa7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:40:05.705463 13045 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2811eabd7b0a40f89ac01886bdea1aa7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2811eabd7b0a40f89ac01886bdea1aa7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2811eabd7b0a40f89ac01886bdea1aa7" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 39565 } } }
I20260808 04:40:05.705505 13048 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2811eabd7b0a40f89ac01886bdea1aa7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2811eabd7b0a40f89ac01886bdea1aa7. Latest consensus state: current_term: 1 leader_uuid: "2811eabd7b0a40f89ac01886bdea1aa7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2811eabd7b0a40f89ac01886bdea1aa7" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 39565 } } }
I20260808 04:40:05.705614 13048 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2811eabd7b0a40f89ac01886bdea1aa7 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:05.705614 13045 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2811eabd7b0a40f89ac01886bdea1aa7 [sys.catalog]: This master's current role is: LEADER
W20260808 04:40:05.708640 13070 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2811eabd7b0a40f89ac01886bdea1aa7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 04:40:05.708714 13070 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 04:40:05.708789 13073 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:40:05.709347 13039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:05.685847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38884 (local address 127.12.148.126:39565)
0808 04:40:05.686294 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:05.686313 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:05.687345 (+ 1032us) server_negotiation.cc:407] Connection header received
0808 04:40:05.691255 (+ 3910us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:05.691273 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:05.691591 (+ 318us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:05.691904 (+ 313us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:05.694693 (+ 2789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:05.695715 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:05.697416 (+ 1701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:05.697928 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:05.698057 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:05.703119 (+ 5062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:05.703126 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:05.703142 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:05.703194 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:05.705248 (+ 2054us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:05.705973 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:05.705979 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:05.705986 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:05.706135 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:05.706583 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:05.706587 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:05.706588 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:05.707197 (+ 609us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:05.707404 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:05.708094 (+ 690us) server_negotiation.cc:299] Negotiation successful
0808 04:40:05.708393 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":287,"thread_start_us":126,"threads_started":1}
I20260808 04:40:05.709625 13073 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:40:05.715340 13073 catalog_manager.cc:1347] Generated new cluster ID: d271332799054b348f111f8dc6f5087e
I20260808 04:40:05.715407 13073 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:40:05.729437 13073 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:40:05.730391 13073 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:40:05.739267 13073 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2811eabd7b0a40f89ac01886bdea1aa7: Generated new TSK 0
I20260808 04:40:05.739921 13073 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.148.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab.
Entry for principal kudu/127.12.148.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab.
I20260808 04:40:05.768538 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.65:0
--local_ip_for_outbound_sockets=127.12.148.65
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:39565
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:40609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:05.880196 13082 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:05.880463 13082 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:05.880518 13082 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:05.884517 13082 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:05.884582 13082 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:05.884666 13082 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.65
I20260808 04:40:05.889799 13082 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:40609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:39565
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13082
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.65
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:05.890802 13082 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:05.891780 13082 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:05.901152 13094 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:05.901154 13096 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:05.901232 13092 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:05.901684 13082 server_base.cc:1034] running on GCE node
I20260808 04:40:05.902071 13082 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:05.902698 13082 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:05.903849 13082 hybrid_clock.cc:648] HybridClock initialized: now 1786164005903839 us; error 39 us; skew 500 ppm
Aug 08 04:40:05 dist-test-slave-t7g5 krb5kdc[12894](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164005, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:05.906651 13082 init.cc:377] Logged in from keytab as kudu/127.12.148.65@KRBTEST.COM (short username kudu)
I20260808 04:40:05.907473 13082 webserver.cc:460] Webserver started at http://127.12.148.65:34031/ using document root <none> and password file <none>
I20260808 04:40:05.907979 13082 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:05.908037 13082 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:05.908205 13082 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:05.910216 13082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-0/data/instance:
uuid: "746957caa0374fafbeb0e7b7d73cb406"
format_stamp: "Formatted at 2026-08-08 04:40:05 on dist-test-slave-t7g5"
server_key: "23ea65cb548b59f7f985944115f1b54c"
server_key_iv: "b6ed3dbc1a14afd03102a725f7a9b4e1"
server_key_version: "encryptionkey@0"
I20260808 04:40:05.910804 13082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance:
uuid: "746957caa0374fafbeb0e7b7d73cb406"
format_stamp: "Formatted at 2026-08-08 04:40:05 on dist-test-slave-t7g5"
server_key: "23ea65cb548b59f7f985944115f1b54c"
server_key_iv: "b6ed3dbc1a14afd03102a725f7a9b4e1"
server_key_version: "encryptionkey@0"
I20260808 04:40:05.914364 13082 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 04:40:05.916620 13103 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:05.917836 13082 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:40:05.917943 13082 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-0/wal
uuid: "746957caa0374fafbeb0e7b7d73cb406"
format_stamp: "Formatted at 2026-08-08 04:40:05 on dist-test-slave-t7g5"
server_key: "23ea65cb548b59f7f985944115f1b54c"
server_key_iv: "b6ed3dbc1a14afd03102a725f7a9b4e1"
server_key_version: "encryptionkey@0"
I20260808 04:40:05.918038 13082 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:05.932085 13082 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:05.935026 13082 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:05.935197 13082 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:05.935746 13082 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:05.936525 13082 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:05.936574 13082 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:05.936626 13082 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:05.936656 13082 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:05.945408 13082 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.65:35633
I20260808 04:40:05.945464 13279 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.65:35633 every 8 connection(s)
I20260808 04:40:05.946278 13082 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
I20260808 04:40:05.954936 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 13082
I20260808 04:40:05.955044 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance
I20260808 04:40:05.955298 12881 external_mini_cluster.cc:1428] Setting key 09c04fe17ea173ddd3afbe6b3fdb9f66
Aug 08 04:40:05 dist-test-slave-t7g5 krb5kdc[12894](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164005, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:40:05.959731 13039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:05.948125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:60761 (local address 127.12.148.126:39565)
0808 04:40:05.948243 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:05.948246 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:05.949049 (+ 803us) server_negotiation.cc:407] Connection header received
0808 04:40:05.950463 (+ 1414us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:05.950467 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:05.950526 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:05.950598 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:05.951745 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:05.952268 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:05.953392 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:05.953632 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:05.953743 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:05.956222 (+ 2479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:05.956226 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:05.956228 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:05.956252 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:05.957761 (+ 1509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:05.958235 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:05.958239 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:05.958240 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:05.958331 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:05.958617 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:05.958620 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:05.958621 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:05.958835 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:05.958941 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:05.959507 (+ 566us) server_negotiation.cc:299] Negotiation successful
0808 04:40:05.959611 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 04:40:05.960722 13284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:05.948473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:39565 (local address 127.12.148.65:60761)
0808 04:40:05.948913 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:05.948955 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:05.950250 (+ 1295us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:05.950780 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:05.950787 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:05.951145 (+ 358us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:05.951597 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:05.951609 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:05.952386 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:05.952389 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:05.953262 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:05.953271 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:05.953790 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:05.953795 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:05.953970 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:05.954443 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:05.954459 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:05.956069 (+ 1610us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:05.957869 (+ 1800us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:05.957873 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:05.957885 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:05.958146 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:05.958411 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:05.958413 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:05.958415 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:05.958542 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:05.958959 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:05.958965 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:05.959275 (+ 310us) client_negotiation.cc:769] Sending connection context
0808 04:40:05.959483 (+ 208us) client_negotiation.cc:240] Negotiation successful
0808 04:40:05.959807 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":124,"threads_started":1}
I20260808 04:40:05.962024 13282 heartbeater.cc:347] Connected to a master server at 127.12.148.126:39565
I20260808 04:40:05.962249 13282 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:05.962743 13282 heartbeater.cc:511] Master 127.12.148.126:39565 requested a full tablet report, sending...
I20260808 04:40:05.964231 12976 ts_manager.cc:194] Registered new tserver with Master: 746957caa0374fafbeb0e7b7d73cb406 (127.12.148.65:35633)
I20260808 04:40:05.965345 12976 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.65@KRBTEST.COM'} at 127.12.148.65:60761
WARNING: no policy specified for kudu/127.12.148.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab.
Entry for principal kudu/127.12.148.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab.
I20260808 04:40:05.982549 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.66:0
--local_ip_for_outbound_sockets=127.12.148.66
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:39565
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:40609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:06.092804 13291 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:06.093073 13291 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:06.093122 13291 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:06.097093 13291 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:06.097152 13291 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:06.097221 13291 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.66
I20260808 04:40:06.102397 13291 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:40609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:39565
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13291
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.66
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:06.103435 13291 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:06.104465 13291 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:06.113996 13300 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:06.113996 13297 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:06.113999 13298 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:06.114038 13291 server_base.cc:1034] running on GCE node
I20260808 04:40:06.114591 13291 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:06.115170 13291 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:06.116321 13291 hybrid_clock.cc:648] HybridClock initialized: now 1786164006116305 us; error 28 us; skew 500 ppm
Aug 08 04:40:06 dist-test-slave-t7g5 krb5kdc[12894](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164006, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:06.119072 13291 init.cc:377] Logged in from keytab as kudu/127.12.148.66@KRBTEST.COM (short username kudu)
I20260808 04:40:06.119907 13291 webserver.cc:460] Webserver started at http://127.12.148.66:45767/ using document root <none> and password file <none>
I20260808 04:40:06.120428 13291 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:06.120496 13291 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:06.120678 13291 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:06.122687 13291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-1/data/instance:
uuid: "08f8653a87f4457bb5b2e0b5e3a7b6ec"
format_stamp: "Formatted at 2026-08-08 04:40:06 on dist-test-slave-t7g5"
server_key: "cd1e1250ccfe8758fa088f96b327ebde"
server_key_iv: "4f6b1e30342fc78822a52e1a4dae05f6"
server_key_version: "encryptionkey@0"
I20260808 04:40:06.123231 13291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance:
uuid: "08f8653a87f4457bb5b2e0b5e3a7b6ec"
format_stamp: "Formatted at 2026-08-08 04:40:06 on dist-test-slave-t7g5"
server_key: "cd1e1250ccfe8758fa088f96b327ebde"
server_key_iv: "4f6b1e30342fc78822a52e1a4dae05f6"
server_key_version: "encryptionkey@0"
I20260808 04:40:06.126806 13291 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260808 04:40:06.129143 13311 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:06.130396 13291 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:40:06.130505 13291 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-1/wal
uuid: "08f8653a87f4457bb5b2e0b5e3a7b6ec"
format_stamp: "Formatted at 2026-08-08 04:40:06 on dist-test-slave-t7g5"
server_key: "cd1e1250ccfe8758fa088f96b327ebde"
server_key_iv: "4f6b1e30342fc78822a52e1a4dae05f6"
server_key_version: "encryptionkey@0"
I20260808 04:40:06.130600 13291 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:06.144786 13291 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:06.147801 13291 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:06.147980 13291 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:06.148507 13291 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:06.149278 13291 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:06.149326 13291 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:06.149375 13291 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:06.149405 13291 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:06.157850 13291 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.66:32987
I20260808 04:40:06.157891 13501 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.66:32987 every 8 connection(s)
I20260808 04:40:06.158672 13291 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
Aug 08 04:40:06 dist-test-slave-t7g5 krb5kdc[12894](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164006, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:40:06.168601 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 13291
I20260808 04:40:06.168712 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance
I20260808 04:40:06.168955 12881 external_mini_cluster.cc:1428] Setting key e734387ae6d4ad72d022a5bc990dc1f4
I20260808 04:40:06.171088 13039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:06.160367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:39789 (local address 127.12.148.126:39565)
0808 04:40:06.160526 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:06.160530 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:06.161339 (+ 809us) server_negotiation.cc:407] Connection header received
0808 04:40:06.162617 (+ 1278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:06.162620 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:06.162668 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:06.162742 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:06.163803 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:06.164308 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:06.165346 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:06.165557 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:06.165623 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:06.167808 (+ 2185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:06.167811 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:06.167813 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:06.167839 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:06.169068 (+ 1229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:06.169555 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:06.169559 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:06.169561 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:06.169681 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:06.170044 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:06.170045 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:06.170047 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:06.170248 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:06.170330 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:06.170816 (+ 486us) server_negotiation.cc:299] Negotiation successful
0808 04:40:06.170942 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 04:40:06.171738 13505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:06.160770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:39565 (local address 127.12.148.66:39789)
0808 04:40:06.161195 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:06.161235 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:06.162395 (+ 1160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:06.162881 (+ 486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:06.162887 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:06.163231 (+ 344us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:06.163690 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:06.163704 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:06.164398 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:06.164400 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:06.165257 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:06.165267 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:06.165691 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:06.165696 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:06.165836 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:06.166285 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:06.166299 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:06.167658 (+ 1359us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:06.169176 (+ 1518us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:06.169181 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:06.169193 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:06.169478 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:06.169754 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:06.169757 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:06.169759 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:06.169965 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:06.170348 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:06.170354 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:06.170585 (+ 231us) client_negotiation.cc:769] Sending connection context
0808 04:40:06.170732 (+ 147us) client_negotiation.cc:240] Negotiation successful
0808 04:40:06.170965 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":123,"threads_started":1}
I20260808 04:40:06.172786 13502 heartbeater.cc:347] Connected to a master server at 127.12.148.126:39565
I20260808 04:40:06.173023 13502 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:06.173547 13502 heartbeater.cc:511] Master 127.12.148.126:39565 requested a full tablet report, sending...
I20260808 04:40:06.174582 12976 ts_manager.cc:194] Registered new tserver with Master: 08f8653a87f4457bb5b2e0b5e3a7b6ec (127.12.148.66:32987)
I20260808 04:40:06.175112 12976 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.66@KRBTEST.COM'} at 127.12.148.66:39789
WARNING: no policy specified for kudu/127.12.148.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab.
Entry for principal kudu/127.12.148.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab.
I20260808 04:40:06.194612 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.67:0
--local_ip_for_outbound_sockets=127.12.148.67
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:39565
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:40609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:06.304600 13512 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:06.304870 13512 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:06.304920 13512 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:06.308975 13512 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:06.309049 13512 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:06.309119 13512 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.67
I20260808 04:40:06.314623 13512 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:40609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:39565
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13512
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.67
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:06.315706 13512 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:06.316744 13512 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:06.326336 13522 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:06.326336 13526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:06.326345 13523 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:06.326529 13512 server_base.cc:1034] running on GCE node
I20260808 04:40:06.327025 13512 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:06.327667 13512 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:06.328830 13512 hybrid_clock.cc:648] HybridClock initialized: now 1786164006328811 us; error 33 us; skew 500 ppm
Aug 08 04:40:06 dist-test-slave-t7g5 krb5kdc[12894](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164006, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:06.331542 13512 init.cc:377] Logged in from keytab as kudu/127.12.148.67@KRBTEST.COM (short username kudu)
I20260808 04:40:06.332401 13512 webserver.cc:460] Webserver started at http://127.12.148.67:40327/ using document root <none> and password file <none>
I20260808 04:40:06.332937 13512 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:06.333004 13512 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:06.333190 13512 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:06.335251 13512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-2/data/instance:
uuid: "36b5022f714f4a3db0695a7e6e80c446"
format_stamp: "Formatted at 2026-08-08 04:40:06 on dist-test-slave-t7g5"
server_key: "bf0104f8d5862accb8cf9f77795b0391"
server_key_iv: "1df3173f0c3a0d24ae7335f79c2422a1"
server_key_version: "encryptionkey@0"
I20260808 04:40:06.335816 13512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance:
uuid: "36b5022f714f4a3db0695a7e6e80c446"
format_stamp: "Formatted at 2026-08-08 04:40:06 on dist-test-slave-t7g5"
server_key: "bf0104f8d5862accb8cf9f77795b0391"
server_key_iv: "1df3173f0c3a0d24ae7335f79c2422a1"
server_key_version: "encryptionkey@0"
I20260808 04:40:06.339557 13512 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 04:40:06.341810 13534 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:06.342935 13512 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:40:06.343039 13512 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-2/wal
uuid: "36b5022f714f4a3db0695a7e6e80c446"
format_stamp: "Formatted at 2026-08-08 04:40:06 on dist-test-slave-t7g5"
server_key: "bf0104f8d5862accb8cf9f77795b0391"
server_key_iv: "1df3173f0c3a0d24ae7335f79c2422a1"
server_key_version: "encryptionkey@0"
I20260808 04:40:06.343130 13512 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:06.360244 13512 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:06.363251 13512 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:06.363436 13512 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:06.363997 13512 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:06.364804 13512 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:06.364850 13512 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:06.364902 13512 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:06.364933 13512 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:06.373600 13512 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.67:34595
I20260808 04:40:06.373627 13720 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.67:34595 every 8 connection(s)
I20260808 04:40:06.374495 13512 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
I20260808 04:40:06.380756 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 13512
I20260808 04:40:06.380842 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance
I20260808 04:40:06.381054 12881 external_mini_cluster.cc:1428] Setting key 952b2ed2ffac00e692e5b55d537129bb
Aug 08 04:40:06 dist-test-slave-t7g5 krb5kdc[12894](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164006, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:40:06.387308 13039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:06.376352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:47317 (local address 127.12.148.126:39565)
0808 04:40:06.376506 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:06.376511 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:06.377376 (+ 865us) server_negotiation.cc:407] Connection header received
0808 04:40:06.378665 (+ 1289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:06.378668 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:06.378715 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:06.378787 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:06.379874 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:06.380401 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:06.381563 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:06.381848 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:06.381965 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:06.384288 (+ 2323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:06.384291 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:06.384293 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:06.384316 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:06.385427 (+ 1111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:06.385904 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:06.385907 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:06.385908 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:06.386010 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:06.386358 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:06.386360 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:06.386361 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:06.386543 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:06.386625 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:06.387096 (+ 471us) server_negotiation.cc:299] Negotiation successful
0808 04:40:06.387191 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 04:40:06.388048 13725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:06.376771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:39565 (local address 127.12.148.67:47317)
0808 04:40:06.377223 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:06.377265 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:06.378466 (+ 1201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:06.378921 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:06.378928 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:06.379277 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:06.379760 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:06.379773 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:06.380493 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:06.380495 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:06.381436 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:06.381447 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:06.382006 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:06.382012 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:06.382202 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:06.382780 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:06.382796 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:06.384145 (+ 1349us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:06.385526 (+ 1381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:06.385531 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:06.385542 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:06.385829 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:06.386116 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:06.386118 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:06.386120 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:06.386279 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:06.386649 (+ 370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:06.386654 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:06.386911 (+ 257us) client_negotiation.cc:769] Sending connection context
0808 04:40:06.387062 (+ 151us) client_negotiation.cc:240] Negotiation successful
0808 04:40:06.387294 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":122,"threads_started":1}
I20260808 04:40:06.389024 13721 heartbeater.cc:347] Connected to a master server at 127.12.148.126:39565
I20260808 04:40:06.389245 13721 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:06.389727 13721 heartbeater.cc:511] Master 127.12.148.126:39565 requested a full tablet report, sending...
I20260808 04:40:06.390676 12976 ts_manager.cc:194] Registered new tserver with Master: 36b5022f714f4a3db0695a7e6e80c446 (127.12.148.67:34595)
I20260808 04:40:06.391206 12976 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.67@KRBTEST.COM'} at 127.12.148.67:47317
I20260808 04:40:06.395089 12881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 04:40:06 dist-test-slave-t7g5 krb5kdc[12894](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164006, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 04:40:06 dist-test-slave-t7g5 krb5kdc[12894](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164006, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.148.65@KRBTEST.COM
I20260808 04:40:06.420485 13731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:06.412025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44366 (local address 127.12.148.65:35633)
0808 04:40:06.412348 (+ 323us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:06.412366 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:06.412388 (+ 22us) server_negotiation.cc:407] Connection header received
0808 04:40:06.412436 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:06.412441 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:06.412620 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:06.412737 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:06.413320 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:06.414186 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:06.414953 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:06.415296 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:06.415379 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:06.417517 (+ 2138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:06.417526 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:06.417538 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:06.417560 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:06.419064 (+ 1504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:06.419407 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:06.419411 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:06.419412 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:06.419485 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:06.419665 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:06.419667 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:06.419668 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:06.419877 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:06.420027 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:06.420164 (+ 137us) server_negotiation.cc:299] Negotiation successful
0808 04:40:06.420297 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":224,"thread_start_us":125,"threads_started":1}
W20260808 04:40:06.421432 13142 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44366
Aug 08 04:40:06 dist-test-slave-t7g5 krb5kdc[12894](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164006, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 04:40:06 dist-test-slave-t7g5 krb5kdc[12894](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164006, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.148.65@KRBTEST.COM
I20260808 04:40:06.445801 13731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:06.438525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44382 (local address 127.12.148.65:35633)
0808 04:40:06.438657 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:06.438661 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:06.438767 (+ 106us) server_negotiation.cc:407] Connection header received
0808 04:40:06.438866 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:06.438869 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:06.438907 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:06.438986 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:06.439614 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:06.440120 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:06.440869 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:06.441079 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:06.441142 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:06.443192 (+ 2050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:06.443195 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:06.443197 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:06.443219 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:06.444531 (+ 1312us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:06.444875 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:06.444877 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:06.444878 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:06.444947 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:06.445126 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:06.445128 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:06.445129 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:06.445271 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:06.445372 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:06.445530 (+ 158us) server_negotiation.cc:299] Negotiation successful
0808 04:40:06.445621 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 04:40:06.446707 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 13082
I20260808 04:40:06.457404 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 13291
I20260808 04:40:06.464057 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 13512
I20260808 04:40:06.474562 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 12916
2026-08-08T04:40:06Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2454 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:40:06 dist-test-slave-t7g5 krb5kdc[13743](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:40:06 dist-test-slave-t7g5 krb5kdc[13743](info): set up 2 sockets
Aug 08 04:40:06 dist-test-slave-t7g5 krb5kdc[13743](info): commencing operation
krb5kdc: starting...
W20260808 04:40:07.626307 12881 mini_kdc.cc:121] Time spent starting KDC: real 1.126s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Aug 08 04:40:07 dist-test-slave-t7g5 krb5kdc[13743](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164007, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:40:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:40:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.148.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
I20260808 04:40:07.743551 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:44917
--webserver_interface=127.12.148.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:40373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:44917
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:07.851912 13765 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:07.852167 13765 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:07.852208 13765 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:07.856163 13765 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:40:07.856222 13765 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:07.856241 13765 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:07.856271 13765 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:40:07.856298 13765 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:40:07.861479 13765 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:40373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:44917
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:44917
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13765
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:07.862468 13765 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:07.863559 13765 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:07.871606 13775 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:07.871613 13778 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:07.871775 13765 server_base.cc:1034] running on GCE node
W20260808 04:40:07.871618 13776 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:07.872390 13765 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:07.873454 13765 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:07.874614 13765 hybrid_clock.cc:648] HybridClock initialized: now 1786164007874593 us; error 31 us; skew 500 ppm
Aug 08 04:40:07 dist-test-slave-t7g5 krb5kdc[13743](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164007, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:07.877208 13765 init.cc:377] Logged in from keytab as kudu/127.12.148.126@KRBTEST.COM (short username kudu)
I20260808 04:40:07.878065 13765 webserver.cc:460] Webserver started at http://127.12.148.126:42623/ using document root <none> and password file <none>
I20260808 04:40:07.878589 13765 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:07.878645 13765 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:07.878811 13765 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:07.880734 13765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "50d90d43461a4b02b0a4972f65e0b044"
format_stamp: "Formatted at 2026-08-08 04:40:07 on dist-test-slave-t7g5"
server_key: "248636bac79e5e62c4ade1347b7f21c2"
server_key_iv: "3b2037b68799b7f6375480bdeaf4454c"
server_key_version: "encryptionkey@0"
I20260808 04:40:07.881250 13765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "50d90d43461a4b02b0a4972f65e0b044"
format_stamp: "Formatted at 2026-08-08 04:40:07 on dist-test-slave-t7g5"
server_key: "248636bac79e5e62c4ade1347b7f21c2"
server_key_iv: "3b2037b68799b7f6375480bdeaf4454c"
server_key_version: "encryptionkey@0"
I20260808 04:40:07.884764 13765 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260808 04:40:07.887056 13789 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:07.888202 13765 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 04:40:07.888305 13765 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "50d90d43461a4b02b0a4972f65e0b044"
format_stamp: "Formatted at 2026-08-08 04:40:07 on dist-test-slave-t7g5"
server_key: "248636bac79e5e62c4ade1347b7f21c2"
server_key_iv: "3b2037b68799b7f6375480bdeaf4454c"
server_key_version: "encryptionkey@0"
I20260808 04:40:07.888389 13765 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:07.900593 13765 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:07.903553 13765 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:07.903715 13765 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:07.909946 13765 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:44917
I20260808 04:40:07.909998 13874 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:44917 every 8 connection(s)
I20260808 04:40:07.910835 13765 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:40:07.913435 13875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:07.918713 13875 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50d90d43461a4b02b0a4972f65e0b044: Bootstrap starting.
I20260808 04:40:07.919124 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 13765
I20260808 04:40:07.919215 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:40:07.919442 12881 external_mini_cluster.cc:1428] Setting key 0eac1c90edb47448ee87cb1e51550be8
I20260808 04:40:07.921183 13875 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 50d90d43461a4b02b0a4972f65e0b044: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:07.922076 13875 log.cc:824] T 00000000000000000000000000000000 P 50d90d43461a4b02b0a4972f65e0b044: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:07.924196 13875 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50d90d43461a4b02b0a4972f65e0b044: No bootstrap required, opened a new log
I20260808 04:40:07.927922 13875 raft_consensus.cc:348] T 00000000000000000000000000000000 P 50d90d43461a4b02b0a4972f65e0b044 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50d90d43461a4b02b0a4972f65e0b044" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 44917 } }
I20260808 04:40:07.928180 13875 raft_consensus.cc:374] T 00000000000000000000000000000000 P 50d90d43461a4b02b0a4972f65e0b044 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:07.928241 13875 raft_consensus.cc:729] T 00000000000000000000000000000000 P 50d90d43461a4b02b0a4972f65e0b044 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50d90d43461a4b02b0a4972f65e0b044, State: Initialized, Role: FOLLOWER
Aug 08 04:40:07 dist-test-slave-t7g5 krb5kdc[13743](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164007, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:40:07.928715 13875 consensus_queue.cc:260] T 00000000000000000000000000000000 P 50d90d43461a4b02b0a4972f65e0b044 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50d90d43461a4b02b0a4972f65e0b044" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 44917 } }
I20260808 04:40:07.928881 13875 raft_consensus.cc:388] T 00000000000000000000000000000000 P 50d90d43461a4b02b0a4972f65e0b044 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:40:07.929010 13875 raft_consensus.cc:482] T 00000000000000000000000000000000 P 50d90d43461a4b02b0a4972f65e0b044 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:40:07.929127 13875 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 50d90d43461a4b02b0a4972f65e0b044 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:07.930070 13875 raft_consensus.cc:504] T 00000000000000000000000000000000 P 50d90d43461a4b02b0a4972f65e0b044 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50d90d43461a4b02b0a4972f65e0b044" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 44917 } }
I20260808 04:40:07.930423 13875 leader_election.cc:302] T 00000000000000000000000000000000 P 50d90d43461a4b02b0a4972f65e0b044 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 50d90d43461a4b02b0a4972f65e0b044; no voters:
I20260808 04:40:07.930907 13875 leader_election.cc:288] T 00000000000000000000000000000000 P 50d90d43461a4b02b0a4972f65e0b044 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:40:07.930992 13887 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 50d90d43461a4b02b0a4972f65e0b044 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:07.931180 13887 raft_consensus.cc:686] T 00000000000000000000000000000000 P 50d90d43461a4b02b0a4972f65e0b044 [term 1 LEADER]: Becoming Leader. State: Replica: 50d90d43461a4b02b0a4972f65e0b044, State: Running, Role: LEADER
I20260808 04:40:07.931536 13887 consensus_queue.cc:237] T 00000000000000000000000000000000 P 50d90d43461a4b02b0a4972f65e0b044 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50d90d43461a4b02b0a4972f65e0b044" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 44917 } }
I20260808 04:40:07.932129 13875 sys_catalog.cc:564] T 00000000000000000000000000000000 P 50d90d43461a4b02b0a4972f65e0b044 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:40:07.932691 13887 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50d90d43461a4b02b0a4972f65e0b044 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 50d90d43461a4b02b0a4972f65e0b044. Latest consensus state: current_term: 1 leader_uuid: "50d90d43461a4b02b0a4972f65e0b044" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50d90d43461a4b02b0a4972f65e0b044" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 44917 } } }
I20260808 04:40:07.932811 13887 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50d90d43461a4b02b0a4972f65e0b044 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:07.933449 13888 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50d90d43461a4b02b0a4972f65e0b044 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "50d90d43461a4b02b0a4972f65e0b044" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50d90d43461a4b02b0a4972f65e0b044" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 44917 } } }
I20260808 04:40:07.933621 13888 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50d90d43461a4b02b0a4972f65e0b044 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:07.934516 13894 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:40:07.935243 13879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:07.920631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43096 (local address 127.12.148.126:44917)
0808 04:40:07.921010 (+ 379us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:07.921030 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:07.921072 (+ 42us) server_negotiation.cc:407] Connection header received
0808 04:40:07.921950 (+ 878us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:07.921974 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:07.922374 (+ 400us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:07.922697 (+ 323us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:07.923397 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:07.924849 (+ 1452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:07.925787 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:07.926485 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:07.926655 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:07.929348 (+ 2693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:07.929355 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:07.929370 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:07.929405 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:07.931457 (+ 2052us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:07.931962 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:07.931968 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:07.931975 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:07.932108 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:07.932419 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:07.932423 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:07.932425 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:07.933062 (+ 637us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:07.934010 (+ 948us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:07.934153 (+ 143us) server_negotiation.cc:299] Negotiation successful
0808 04:40:07.934459 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":240,"thread_start_us":91,"threads_started":1}
I20260808 04:40:07.937383 13894 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:40:07.942974 13894 catalog_manager.cc:1347] Generated new cluster ID: 1bf5f5101bf74152b929a548d8288d91
I20260808 04:40:07.943032 13894 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:40:07.952718 13894 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:40:07.953559 13894 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:40:07.959276 13894 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 50d90d43461a4b02b0a4972f65e0b044: Generated new TSK 0
I20260808 04:40:07.959872 13894 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.148.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab.
Entry for principal kudu/127.12.148.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab.
I20260808 04:40:07.994172 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.65:0
--local_ip_for_outbound_sockets=127.12.148.65
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:44917
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:40373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:08.104480 13923 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:08.104727 13923 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:08.104768 13923 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:08.108706 13923 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:08.108759 13923 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:08.108814 13923 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.65
I20260808 04:40:08.113858 13923 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:40373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:44917
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13923
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.65
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:08.114810 13923 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:08.115793 13923 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 04:40:08.125089 13923 server_base.cc:1034] running on GCE node
W20260808 04:40:08.125155 13937 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:08.125147 13931 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:08.125080 13930 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:08.125638 13923 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:08.126258 13923 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:08.127413 13923 hybrid_clock.cc:648] HybridClock initialized: now 1786164008127394 us; error 29 us; skew 500 ppm
Aug 08 04:40:08 dist-test-slave-t7g5 krb5kdc[13743](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164008, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:08.130205 13923 init.cc:377] Logged in from keytab as kudu/127.12.148.65@KRBTEST.COM (short username kudu)
I20260808 04:40:08.131006 13923 webserver.cc:460] Webserver started at http://127.12.148.65:40793/ using document root <none> and password file <none>
I20260808 04:40:08.131510 13923 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:08.131570 13923 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:08.131736 13923 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:08.133888 13923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-0/data/instance:
uuid: "27b54889c8e2489e875523a0300cf1d2"
format_stamp: "Formatted at 2026-08-08 04:40:08 on dist-test-slave-t7g5"
server_key: "a0ac2d0cf92f9af225a43945b1efeffd"
server_key_iv: "e05af8f0bb2ccb73086d2b525ee580e9"
server_key_version: "encryptionkey@0"
I20260808 04:40:08.134436 13923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance:
uuid: "27b54889c8e2489e875523a0300cf1d2"
format_stamp: "Formatted at 2026-08-08 04:40:08 on dist-test-slave-t7g5"
server_key: "a0ac2d0cf92f9af225a43945b1efeffd"
server_key_iv: "e05af8f0bb2ccb73086d2b525ee580e9"
server_key_version: "encryptionkey@0"
I20260808 04:40:08.138008 13923 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:40:08.140319 13949 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:08.141505 13923 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:40:08.141598 13923 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-0/wal
uuid: "27b54889c8e2489e875523a0300cf1d2"
format_stamp: "Formatted at 2026-08-08 04:40:08 on dist-test-slave-t7g5"
server_key: "a0ac2d0cf92f9af225a43945b1efeffd"
server_key_iv: "e05af8f0bb2ccb73086d2b525ee580e9"
server_key_version: "encryptionkey@0"
I20260808 04:40:08.141733 13923 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:08.159003 13923 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:08.162084 13923 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:08.162236 13923 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:08.162766 13923 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:08.163542 13923 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:08.163590 13923 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:08.163628 13923 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:08.163650 13923 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:08.171846 13923 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.65:39771
I20260808 04:40:08.171877 14140 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.65:39771 every 8 connection(s)
I20260808 04:40:08.172700 13923 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
I20260808 04:40:08.180249 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 13923
I20260808 04:40:08.180382 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance
I20260808 04:40:08.180663 12881 external_mini_cluster.cc:1428] Setting key 8a860726d305b0d80f8e136f9bc5c5d7
Aug 08 04:40:08 dist-test-slave-t7g5 krb5kdc[13743](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164008, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:40:08.186066 13879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:08.174453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:35835 (local address 127.12.148.126:44917)
0808 04:40:08.174583 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:08.174587 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:08.175415 (+ 828us) server_negotiation.cc:407] Connection header received
0808 04:40:08.176774 (+ 1359us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:08.176777 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:08.176827 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:08.176889 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:08.178125 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.178647 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.179737 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.179958 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.180026 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:08.182608 (+ 2582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:08.182612 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:08.182615 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:08.182641 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:08.184118 (+ 1477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:08.184685 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:08.184687 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:08.184688 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:08.184764 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:08.185095 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:08.185097 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:08.185098 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:08.185258 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:08.185326 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:08.185832 (+ 506us) server_negotiation.cc:299] Negotiation successful
0808 04:40:08.185936 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 04:40:08.186839 14148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:08.174818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:44917 (local address 127.12.148.65:35835)
0808 04:40:08.175263 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:08.175307 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:08.176538 (+ 1231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:08.177086 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:08.177095 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:08.177464 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:08.177991 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:08.178005 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.178754 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.178757 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:08.179649 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:08.179659 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.180090 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.180094 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:08.180293 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:08.180888 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:08.180904 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:08.182438 (+ 1534us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:08.184238 (+ 1800us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:08.184244 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:08.184258 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:08.184601 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:08.184835 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:08.184838 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:08.184840 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:08.185013 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:08.185355 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:08.185360 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:08.185604 (+ 244us) client_negotiation.cc:769] Sending connection context
0808 04:40:08.185783 (+ 179us) client_negotiation.cc:240] Negotiation successful
0808 04:40:08.186035 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":112,"threads_started":1}
I20260808 04:40:08.188076 14141 heartbeater.cc:347] Connected to a master server at 127.12.148.126:44917
I20260808 04:40:08.188288 14141 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:08.188887 14141 heartbeater.cc:511] Master 127.12.148.126:44917 requested a full tablet report, sending...
I20260808 04:40:08.190662 13809 ts_manager.cc:194] Registered new tserver with Master: 27b54889c8e2489e875523a0300cf1d2 (127.12.148.65:39771)
I20260808 04:40:08.192253 13809 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.65@KRBTEST.COM'} at 127.12.148.65:35835
WARNING: no policy specified for kudu/127.12.148.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab.
Entry for principal kudu/127.12.148.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab.
I20260808 04:40:08.211956 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.66:0
--local_ip_for_outbound_sockets=127.12.148.66
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:44917
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:40373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:08.319911 14154 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:08.320173 14154 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:08.320230 14154 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:08.324388 14154 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:08.324452 14154 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:08.324528 14154 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.66
I20260808 04:40:08.329638 14154 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:40373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:44917
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14154
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.66
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:08.330691 14154 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:08.331740 14154 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:08.341133 14161 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:08.341130 14159 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:08.341194 14163 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:08.341545 14154 server_base.cc:1034] running on GCE node
I20260808 04:40:08.341974 14154 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:08.342612 14154 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:08.343772 14154 hybrid_clock.cc:648] HybridClock initialized: now 1786164008343761 us; error 39 us; skew 500 ppm
Aug 08 04:40:08 dist-test-slave-t7g5 krb5kdc[13743](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164008, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:08.346575 14154 init.cc:377] Logged in from keytab as kudu/127.12.148.66@KRBTEST.COM (short username kudu)
I20260808 04:40:08.347560 14154 webserver.cc:460] Webserver started at http://127.12.148.66:36457/ using document root <none> and password file <none>
I20260808 04:40:08.348132 14154 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:08.348198 14154 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:08.348415 14154 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:08.350613 14154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-1/data/instance:
uuid: "3665ace4ff494c6187624412aff2449c"
format_stamp: "Formatted at 2026-08-08 04:40:08 on dist-test-slave-t7g5"
server_key: "7611af5debcef3c943aa53835aca466d"
server_key_iv: "003d9095e9ceb30ad54a3e16f5140424"
server_key_version: "encryptionkey@0"
I20260808 04:40:08.351166 14154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance:
uuid: "3665ace4ff494c6187624412aff2449c"
format_stamp: "Formatted at 2026-08-08 04:40:08 on dist-test-slave-t7g5"
server_key: "7611af5debcef3c943aa53835aca466d"
server_key_iv: "003d9095e9ceb30ad54a3e16f5140424"
server_key_version: "encryptionkey@0"
I20260808 04:40:08.354887 14154 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 04:40:08.357237 14176 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:08.358438 14154 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:40:08.358554 14154 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-1/wal
uuid: "3665ace4ff494c6187624412aff2449c"
format_stamp: "Formatted at 2026-08-08 04:40:08 on dist-test-slave-t7g5"
server_key: "7611af5debcef3c943aa53835aca466d"
server_key_iv: "003d9095e9ceb30ad54a3e16f5140424"
server_key_version: "encryptionkey@0"
I20260808 04:40:08.358645 14154 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:08.388343 14154 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:08.391235 14154 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:08.391420 14154 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:08.392019 14154 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:08.392897 14154 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:08.392947 14154 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:08.393002 14154 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:08.393028 14154 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:08.401490 14154 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.66:40923
I20260808 04:40:08.401551 14339 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.66:40923 every 8 connection(s)
I20260808 04:40:08.402379 14154 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
I20260808 04:40:08.407951 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 14154
I20260808 04:40:08.408054 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance
I20260808 04:40:08.408305 12881 external_mini_cluster.cc:1428] Setting key 5c3b8577c1e4d9e3698079a970e06c47
Aug 08 04:40:08 dist-test-slave-t7g5 krb5kdc[13743](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164008, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:40:08.416158 13879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:08.404139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:37647 (local address 127.12.148.126:44917)
0808 04:40:08.404291 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:08.404295 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:08.405179 (+ 884us) server_negotiation.cc:407] Connection header received
0808 04:40:08.406476 (+ 1297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:08.406480 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:08.406544 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:08.406623 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:08.408112 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.408686 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.410092 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.410317 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.410407 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:08.412850 (+ 2443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:08.412853 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:08.412855 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:08.412880 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:08.414182 (+ 1302us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:08.414677 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:08.414681 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:08.414682 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:08.414771 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:08.415084 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:08.415087 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:08.415089 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:08.415272 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:08.415359 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:08.415867 (+ 508us) server_negotiation.cc:299] Negotiation successful
0808 04:40:08.415994 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 04:40:08.416939 14342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:08.404490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:44917 (local address 127.12.148.66:37647)
0808 04:40:08.405017 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:08.405060 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:08.406267 (+ 1207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:08.406804 (+ 537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:08.406810 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:08.407162 (+ 352us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:08.407641 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:08.407656 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.408831 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.408834 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:08.409966 (+ 1132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:08.409977 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.410457 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.410462 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:08.410628 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:08.411218 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:08.411236 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:08.412682 (+ 1446us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:08.414292 (+ 1610us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:08.414298 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:08.414314 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:08.414582 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:08.414854 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:08.414857 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:08.414859 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:08.414996 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:08.415371 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:08.415378 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:08.415630 (+ 252us) client_negotiation.cc:769] Sending connection context
0808 04:40:08.415804 (+ 174us) client_negotiation.cc:240] Negotiation successful
0808 04:40:08.416120 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":124,"threads_started":1}
WARNING: no policy specified for kudu/127.12.148.67@KRBTEST.COM; defaulting to no policy
I20260808 04:40:08.418077 14340 heartbeater.cc:347] Connected to a master server at 127.12.148.126:44917
I20260808 04:40:08.418303 14340 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:08.418780 14340 heartbeater.cc:511] Master 127.12.148.126:44917 requested a full tablet report, sending...
I20260808 04:40:08.419797 13809 ts_manager.cc:194] Registered new tserver with Master: 3665ace4ff494c6187624412aff2449c (127.12.148.66:40923)
I20260808 04:40:08.420363 13809 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.66@KRBTEST.COM'} at 127.12.148.66:37647
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab.
Entry for principal kudu/127.12.148.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab.
I20260808 04:40:08.435546 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.67:0
--local_ip_for_outbound_sockets=127.12.148.67
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:44917
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:40373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:08.549242 14345 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:08.549501 14345 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:08.549544 14345 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:08.553433 14345 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:08.553496 14345 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:08.553551 14345 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.67
I20260808 04:40:08.558713 14345 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:40373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:44917
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14345
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.67
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:08.559662 14345 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:08.560614 14345 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:08.569913 14352 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:08.569919 14354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:08.569954 14350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:08.570152 14345 server_base.cc:1034] running on GCE node
I20260808 04:40:08.570633 14345 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:08.571310 14345 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:08.572479 14345 hybrid_clock.cc:648] HybridClock initialized: now 1786164008572457 us; error 32 us; skew 500 ppm
Aug 08 04:40:08 dist-test-slave-t7g5 krb5kdc[13743](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164008, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:08.575158 14345 init.cc:377] Logged in from keytab as kudu/127.12.148.67@KRBTEST.COM (short username kudu)
I20260808 04:40:08.576000 14345 webserver.cc:460] Webserver started at http://127.12.148.67:35131/ using document root <none> and password file <none>
I20260808 04:40:08.576534 14345 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:08.576610 14345 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:08.576848 14345 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:08.578900 14345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-2/data/instance:
uuid: "22c8cc14907c43b8b0ebbdc945ce30ee"
format_stamp: "Formatted at 2026-08-08 04:40:08 on dist-test-slave-t7g5"
server_key: "1bd3183cba00840395c0a25f6a0dc91a"
server_key_iv: "202d788b38417be21bc7abd8fdc53d08"
server_key_version: "encryptionkey@0"
I20260808 04:40:08.579460 14345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance:
uuid: "22c8cc14907c43b8b0ebbdc945ce30ee"
format_stamp: "Formatted at 2026-08-08 04:40:08 on dist-test-slave-t7g5"
server_key: "1bd3183cba00840395c0a25f6a0dc91a"
server_key_iv: "202d788b38417be21bc7abd8fdc53d08"
server_key_version: "encryptionkey@0"
I20260808 04:40:08.583163 14345 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 04:40:08.585470 14368 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:08.586730 14345 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:40:08.586889 14345 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-2/wal
uuid: "22c8cc14907c43b8b0ebbdc945ce30ee"
format_stamp: "Formatted at 2026-08-08 04:40:08 on dist-test-slave-t7g5"
server_key: "1bd3183cba00840395c0a25f6a0dc91a"
server_key_iv: "202d788b38417be21bc7abd8fdc53d08"
server_key_version: "encryptionkey@0"
I20260808 04:40:08.586988 14345 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:08.598836 14345 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:08.601509 14345 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:08.601727 14345 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:08.602319 14345 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:08.603130 14345 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:08.603179 14345 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:08.603233 14345 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:08.603264 14345 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:08.611435 14345 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.67:38739
I20260808 04:40:08.611467 14539 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.67:38739 every 8 connection(s)
I20260808 04:40:08.612308 14345 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
Aug 08 04:40:08 dist-test-slave-t7g5 krb5kdc[13743](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164008, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:40:08.621980 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 14345
I20260808 04:40:08.622129 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance
I20260808 04:40:08.622452 12881 external_mini_cluster.cc:1428] Setting key 31f93216902aae29bfea88754027e330
I20260808 04:40:08.625419 13879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:08.614038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:58009 (local address 127.12.148.126:44917)
0808 04:40:08.614166 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:08.614170 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:08.614960 (+ 790us) server_negotiation.cc:407] Connection header received
0808 04:40:08.616235 (+ 1275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:08.616239 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:08.616296 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:08.616380 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:08.617517 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.618104 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.619229 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.619498 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.619594 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:08.621916 (+ 2322us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:08.621920 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:08.621922 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:08.621949 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:08.623462 (+ 1513us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:08.623938 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:08.623941 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:08.623943 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:08.624033 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:08.624342 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:08.624345 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:08.624347 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:08.624531 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:08.624618 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:08.625132 (+ 514us) server_negotiation.cc:299] Negotiation successful
0808 04:40:08.625253 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 04:40:08.626188 14543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:08.614371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:44917 (local address 127.12.148.67:58009)
0808 04:40:08.614810 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:08.614859 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:08.616026 (+ 1167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:08.616556 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:08.616563 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:08.616906 (+ 343us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:08.617370 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:08.617383 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.618224 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.618227 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:08.619102 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:08.619112 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.619640 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.619644 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:08.619802 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:08.620283 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:08.620298 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:08.621713 (+ 1415us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:08.623566 (+ 1853us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:08.623572 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:08.623587 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:08.623841 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:08.624114 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:08.624117 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:08.624119 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:08.624249 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:08.624639 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:08.624646 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:08.624881 (+ 235us) client_negotiation.cc:769] Sending connection context
0808 04:40:08.625044 (+ 163us) client_negotiation.cc:240] Negotiation successful
0808 04:40:08.625352 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":111,"threads_started":1}
I20260808 04:40:08.627158 14540 heartbeater.cc:347] Connected to a master server at 127.12.148.126:44917
I20260808 04:40:08.627372 14540 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:08.627815 14540 heartbeater.cc:511] Master 127.12.148.126:44917 requested a full tablet report, sending...
I20260808 04:40:08.628770 13809 ts_manager.cc:194] Registered new tserver with Master: 22c8cc14907c43b8b0ebbdc945ce30ee (127.12.148.67:38739)
I20260808 04:40:08.629300 13809 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.67@KRBTEST.COM'} at 127.12.148.67:58009
I20260808 04:40:08.635931 12881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 04:40:08.646477 13879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:08.639208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43108 (local address 127.12.148.126:44917)
0808 04:40:08.639306 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:08.639309 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:08.639540 (+ 231us) server_negotiation.cc:407] Connection header received
0808 04:40:08.639641 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:08.639643 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:08.639677 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:08.639739 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:08.640417 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.640907 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.641805 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.642025 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.642099 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:08.643419 (+ 1320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:08.643422 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:08.643423 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:08.643438 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:08.644813 (+ 1375us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:08.645225 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:08.645229 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:08.645230 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:08.645311 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:08.645572 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:08.645576 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:08.645577 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:08.645827 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:08.645963 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:08.646206 (+ 243us) server_negotiation.cc:299] Negotiation successful
0808 04:40:08.646322 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 04:40:08.651292 13809 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43108:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:40:08.654486 13809 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:40:08.668380 14554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:08.662898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.67:38739 (local address 127.0.0.1:41692)
0808 04:40:08.663846 (+ 948us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:08.663862 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:08.663989 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:08.664585 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:08.664591 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:08.664647 (+ 56us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:08.664813 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:08.664821 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.665923 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.665926 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:08.667050 (+ 1124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:08.667060 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.667847 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.667850 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:08.667966 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:08.668007 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 04:40:08.668108 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 04:40:08.668230 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":885,"thread_start_us":110,"threads_started":1}
I20260808 04:40:08.668406 14564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:08.663530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41692 (local address 127.12.148.67:38739)
0808 04:40:08.663921 (+ 391us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:08.663934 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:08.663957 (+ 23us) server_negotiation.cc:407] Connection header received
0808 04:40:08.664144 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:08.664150 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:08.664377 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:08.664537 (+ 160us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:08.664948 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.665797 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.667164 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.667727 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.667827 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:08.667984 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:08.668148 (+ 164us) server_negotiation.cc:299] Negotiation successful
0808 04:40:08.668247 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291,"thread_start_us":204,"threads_started":1}
I20260808 04:40:08.669246 14562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:08.662744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:39771 (local address 127.0.0.1:58428)
0808 04:40:08.664053 (+ 1309us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:08.664066 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:08.664166 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:08.664905 (+ 739us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:08.664908 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:08.664927 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:08.665013 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:08.665018 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.666417 (+ 1399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.666421 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:08.667747 (+ 1326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:08.667759 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.668837 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.668841 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:08.668930 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:08.668956 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 04:40:08.669038 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 04:40:08.669113 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1250,"mutex_wait_us":816,"spinlock_wait_cycles":2432,"thread_start_us":103,"threads_started":1}
I20260808 04:40:08.669313 14561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:08.662980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58428 (local address 127.12.148.65:39771)
0808 04:40:08.663356 (+ 376us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:08.663373 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:08.664265 (+ 892us) server_negotiation.cc:407] Connection header received
0808 04:40:08.664333 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:08.664337 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:08.664487 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:08.664643 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:08.665114 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.666263 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.667889 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.668710 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.668837 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:08.668970 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:08.669066 (+ 96us) server_negotiation.cc:299] Negotiation successful
0808 04:40:08.669159 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267,"thread_start_us":129,"threads_started":1}
I20260808 04:40:08.670171 14556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:08.662739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:40923 (local address 127.0.0.1:60050)
0808 04:40:08.663627 (+ 888us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:08.663680 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:08.664170 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:08.664788 (+ 618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:08.664791 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:08.664840 (+ 49us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:08.664936 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:08.664943 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.666417 (+ 1474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.666421 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:08.667747 (+ 1326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:08.667759 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.669774 (+ 2015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.669778 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:08.669864 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:08.669898 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 04:40:08.669970 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 04:40:08.670041 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":716,"mutex_wait_us":97,"spinlock_wait_cycles":7168,"thread_start_us":66,"threads_started":1}
I20260808 04:40:08.670542 14560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:08.662894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60050 (local address 127.12.148.66:40923)
0808 04:40:08.664352 (+ 1458us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:08.664363 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:08.664385 (+ 22us) server_negotiation.cc:407] Connection header received
0808 04:40:08.664457 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:08.664462 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:08.664626 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:08.664783 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:08.665044 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.666263 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.667889 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.668710 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.668821 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:08.669190 (+ 369us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:08.670340 (+ 1150us) server_negotiation.cc:299] Negotiation successful
0808 04:40:08.670432 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1358,"thread_start_us":140,"threads_started":1}
I20260808 04:40:08.671953 14432 tablet_service.cc:1467] Processing CreateTablet for tablet e188b856f395458e8a7ef51ec169bc30 (DEFAULT_TABLE table=test-table [id=88028ab8c3fc4e1182a73bf951cd0758]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:08.671953 14027 tablet_service.cc:1467] Processing CreateTablet for tablet e188b856f395458e8a7ef51ec169bc30 (DEFAULT_TABLE table=test-table [id=88028ab8c3fc4e1182a73bf951cd0758]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:08.673105 14027 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e188b856f395458e8a7ef51ec169bc30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:08.673110 14432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e188b856f395458e8a7ef51ec169bc30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:08.674515 14241 tablet_service.cc:1467] Processing CreateTablet for tablet e188b856f395458e8a7ef51ec169bc30 (DEFAULT_TABLE table=test-table [id=88028ab8c3fc4e1182a73bf951cd0758]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:08.675371 14241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e188b856f395458e8a7ef51ec169bc30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:08.680522 14565 tablet_bootstrap.cc:492] T e188b856f395458e8a7ef51ec169bc30 P 27b54889c8e2489e875523a0300cf1d2: Bootstrap starting.
I20260808 04:40:08.680967 14568 tablet_bootstrap.cc:492] T e188b856f395458e8a7ef51ec169bc30 P 22c8cc14907c43b8b0ebbdc945ce30ee: Bootstrap starting.
I20260808 04:40:08.681797 14571 tablet_bootstrap.cc:492] T e188b856f395458e8a7ef51ec169bc30 P 3665ace4ff494c6187624412aff2449c: Bootstrap starting.
I20260808 04:40:08.683481 14571 tablet_bootstrap.cc:654] T e188b856f395458e8a7ef51ec169bc30 P 3665ace4ff494c6187624412aff2449c: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:08.683606 14568 tablet_bootstrap.cc:654] T e188b856f395458e8a7ef51ec169bc30 P 22c8cc14907c43b8b0ebbdc945ce30ee: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:08.683606 14565 tablet_bootstrap.cc:654] T e188b856f395458e8a7ef51ec169bc30 P 27b54889c8e2489e875523a0300cf1d2: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:08.684669 14571 log.cc:824] T e188b856f395458e8a7ef51ec169bc30 P 3665ace4ff494c6187624412aff2449c: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:08.684809 14568 log.cc:824] T e188b856f395458e8a7ef51ec169bc30 P 22c8cc14907c43b8b0ebbdc945ce30ee: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:08.684809 14565 log.cc:824] T e188b856f395458e8a7ef51ec169bc30 P 27b54889c8e2489e875523a0300cf1d2: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:08.686545 14568 tablet_bootstrap.cc:492] T e188b856f395458e8a7ef51ec169bc30 P 22c8cc14907c43b8b0ebbdc945ce30ee: No bootstrap required, opened a new log
I20260808 04:40:08.686689 14571 tablet_bootstrap.cc:492] T e188b856f395458e8a7ef51ec169bc30 P 3665ace4ff494c6187624412aff2449c: No bootstrap required, opened a new log
I20260808 04:40:08.686688 14565 tablet_bootstrap.cc:492] T e188b856f395458e8a7ef51ec169bc30 P 27b54889c8e2489e875523a0300cf1d2: No bootstrap required, opened a new log
I20260808 04:40:08.686748 14568 ts_tablet_manager.cc:1397] T e188b856f395458e8a7ef51ec169bc30 P 22c8cc14907c43b8b0ebbdc945ce30ee: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 04:40:08.686873 14571 ts_tablet_manager.cc:1397] T e188b856f395458e8a7ef51ec169bc30 P 3665ace4ff494c6187624412aff2449c: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 04:40:08.686873 14565 ts_tablet_manager.cc:1397] T e188b856f395458e8a7ef51ec169bc30 P 27b54889c8e2489e875523a0300cf1d2: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260808 04:40:08.689550 14568 raft_consensus.cc:348] T e188b856f395458e8a7ef51ec169bc30 P 22c8cc14907c43b8b0ebbdc945ce30ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27b54889c8e2489e875523a0300cf1d2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39771 } } peers { permanent_uuid: "3665ace4ff494c6187624412aff2449c" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40923 } } peers { permanent_uuid: "22c8cc14907c43b8b0ebbdc945ce30ee" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 38739 } }
I20260808 04:40:08.689836 14568 raft_consensus.cc:374] T e188b856f395458e8a7ef51ec169bc30 P 22c8cc14907c43b8b0ebbdc945ce30ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:08.689893 14568 raft_consensus.cc:729] T e188b856f395458e8a7ef51ec169bc30 P 22c8cc14907c43b8b0ebbdc945ce30ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22c8cc14907c43b8b0ebbdc945ce30ee, State: Initialized, Role: FOLLOWER
I20260808 04:40:08.690338 14568 consensus_queue.cc:260] T e188b856f395458e8a7ef51ec169bc30 P 22c8cc14907c43b8b0ebbdc945ce30ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27b54889c8e2489e875523a0300cf1d2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39771 } } peers { permanent_uuid: "3665ace4ff494c6187624412aff2449c" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40923 } } peers { permanent_uuid: "22c8cc14907c43b8b0ebbdc945ce30ee" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 38739 } }
I20260808 04:40:08.690593 14571 raft_consensus.cc:348] T e188b856f395458e8a7ef51ec169bc30 P 3665ace4ff494c6187624412aff2449c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27b54889c8e2489e875523a0300cf1d2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39771 } } peers { permanent_uuid: "3665ace4ff494c6187624412aff2449c" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40923 } } peers { permanent_uuid: "22c8cc14907c43b8b0ebbdc945ce30ee" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 38739 } }
I20260808 04:40:08.690593 14565 raft_consensus.cc:348] T e188b856f395458e8a7ef51ec169bc30 P 27b54889c8e2489e875523a0300cf1d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27b54889c8e2489e875523a0300cf1d2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39771 } } peers { permanent_uuid: "3665ace4ff494c6187624412aff2449c" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40923 } } peers { permanent_uuid: "22c8cc14907c43b8b0ebbdc945ce30ee" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 38739 } }
I20260808 04:40:08.690836 14565 raft_consensus.cc:374] T e188b856f395458e8a7ef51ec169bc30 P 27b54889c8e2489e875523a0300cf1d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:08.690837 14571 raft_consensus.cc:374] T e188b856f395458e8a7ef51ec169bc30 P 3665ace4ff494c6187624412aff2449c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:08.690896 14571 raft_consensus.cc:729] T e188b856f395458e8a7ef51ec169bc30 P 3665ace4ff494c6187624412aff2449c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3665ace4ff494c6187624412aff2449c, State: Initialized, Role: FOLLOWER
I20260808 04:40:08.690904 14565 raft_consensus.cc:729] T e188b856f395458e8a7ef51ec169bc30 P 27b54889c8e2489e875523a0300cf1d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27b54889c8e2489e875523a0300cf1d2, State: Initialized, Role: FOLLOWER
I20260808 04:40:08.691398 14568 ts_tablet_manager.cc:1428] T e188b856f395458e8a7ef51ec169bc30 P 22c8cc14907c43b8b0ebbdc945ce30ee: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260808 04:40:08.691355 14565 consensus_queue.cc:260] T e188b856f395458e8a7ef51ec169bc30 P 27b54889c8e2489e875523a0300cf1d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27b54889c8e2489e875523a0300cf1d2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39771 } } peers { permanent_uuid: "3665ace4ff494c6187624412aff2449c" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40923 } } peers { permanent_uuid: "22c8cc14907c43b8b0ebbdc945ce30ee" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 38739 } }
I20260808 04:40:08.691355 14571 consensus_queue.cc:260] T e188b856f395458e8a7ef51ec169bc30 P 3665ace4ff494c6187624412aff2449c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27b54889c8e2489e875523a0300cf1d2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39771 } } peers { permanent_uuid: "3665ace4ff494c6187624412aff2449c" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40923 } } peers { permanent_uuid: "22c8cc14907c43b8b0ebbdc945ce30ee" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 38739 } }
I20260808 04:40:08.691784 14540 heartbeater.cc:503] Master 127.12.148.126:44917 was elected leader, sending a full tablet report...
I20260808 04:40:08.692286 14571 ts_tablet_manager.cc:1428] T e188b856f395458e8a7ef51ec169bc30 P 3665ace4ff494c6187624412aff2449c: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260808 04:40:08.692286 14565 ts_tablet_manager.cc:1428] T e188b856f395458e8a7ef51ec169bc30 P 27b54889c8e2489e875523a0300cf1d2: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260808 04:40:08.692651 14141 heartbeater.cc:503] Master 127.12.148.126:44917 was elected leader, sending a full tablet report...
I20260808 04:40:08.692839 14340 heartbeater.cc:503] Master 127.12.148.126:44917 was elected leader, sending a full tablet report...
I20260808 04:40:08.853040 14580 raft_consensus.cc:482] T e188b856f395458e8a7ef51ec169bc30 P 22c8cc14907c43b8b0ebbdc945ce30ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:40:08.853245 14580 raft_consensus.cc:504] T e188b856f395458e8a7ef51ec169bc30 P 22c8cc14907c43b8b0ebbdc945ce30ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27b54889c8e2489e875523a0300cf1d2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39771 } } peers { permanent_uuid: "3665ace4ff494c6187624412aff2449c" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40923 } } peers { permanent_uuid: "22c8cc14907c43b8b0ebbdc945ce30ee" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 38739 } }
I20260808 04:40:08.854357 14580 leader_election.cc:288] T e188b856f395458e8a7ef51ec169bc30 P 22c8cc14907c43b8b0ebbdc945ce30ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27b54889c8e2489e875523a0300cf1d2 (127.12.148.65:39771), 3665ace4ff494c6187624412aff2449c (127.12.148.66:40923)
I20260808 04:40:08.858130 14543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:08.854595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:39771 (local address 127.12.148.67:35425)
0808 04:40:08.854706 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:08.854722 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:08.854810 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:08.855086 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:08.855089 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:08.855105 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:08.855231 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:08.855238 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.856073 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.856076 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:08.856965 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:08.856975 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.857710 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.857714 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:08.857828 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:08.857855 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 04:40:08.857930 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 04:40:08.858003 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33,"mutex_wait_us":1}
I20260808 04:40:08.858157 14561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:08.854712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:35425 (local address 127.12.148.65:39771)
0808 04:40:08.854830 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:08.854835 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:08.854852 (+ 17us) server_negotiation.cc:407] Connection header received
0808 04:40:08.854909 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:08.854911 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:08.854980 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:08.855075 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:08.855337 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.855969 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.857096 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.857592 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.857720 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:08.857762 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:08.857968 (+ 206us) server_negotiation.cc:299] Negotiation successful
0808 04:40:08.858033 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 04:40:08.858405 14585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:08.854595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:40923 (local address 127.12.148.67:39145)
0808 04:40:08.855055 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:08.855068 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:08.855163 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:08.855396 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:08.855399 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:08.855416 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:08.855565 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:08.855572 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.856320 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.856323 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:08.857282 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:08.857293 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.857986 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.857989 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:08.858088 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:08.858112 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 04:40:08.858191 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 04:40:08.858254 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":378,"mutex_wait_us":135,"thread_start_us":105,"threads_started":1}
I20260808 04:40:08.858405 14560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:08.854711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:39145 (local address 127.12.148.66:40923)
0808 04:40:08.854830 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:08.854835 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:08.855154 (+ 319us) server_negotiation.cc:407] Connection header received
0808 04:40:08.855249 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:08.855252 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:08.855305 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:08.855374 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:08.855667 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.856216 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.857407 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.857879 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.857978 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:08.858019 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:08.858219 (+ 200us) server_negotiation.cc:299] Negotiation successful
0808 04:40:08.858290 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 04:40:08.858840 14061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e188b856f395458e8a7ef51ec169bc30" candidate_uuid: "22c8cc14907c43b8b0ebbdc945ce30ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27b54889c8e2489e875523a0300cf1d2" is_pre_election: true
I20260808 04:40:08.859045 14270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e188b856f395458e8a7ef51ec169bc30" candidate_uuid: "22c8cc14907c43b8b0ebbdc945ce30ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3665ace4ff494c6187624412aff2449c" is_pre_election: true
I20260808 04:40:08.859181 14061 raft_consensus.cc:2454] T e188b856f395458e8a7ef51ec169bc30 P 27b54889c8e2489e875523a0300cf1d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22c8cc14907c43b8b0ebbdc945ce30ee in term 0.
I20260808 04:40:08.859311 14270 raft_consensus.cc:2454] T e188b856f395458e8a7ef51ec169bc30 P 3665ace4ff494c6187624412aff2449c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22c8cc14907c43b8b0ebbdc945ce30ee in term 0.
I20260808 04:40:08.859660 14376 leader_election.cc:302] T e188b856f395458e8a7ef51ec169bc30 P 22c8cc14907c43b8b0ebbdc945ce30ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22c8cc14907c43b8b0ebbdc945ce30ee, 27b54889c8e2489e875523a0300cf1d2; no voters:
I20260808 04:40:08.859923 14580 raft_consensus.cc:2781] T e188b856f395458e8a7ef51ec169bc30 P 22c8cc14907c43b8b0ebbdc945ce30ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:40:08.860008 14580 raft_consensus.cc:482] T e188b856f395458e8a7ef51ec169bc30 P 22c8cc14907c43b8b0ebbdc945ce30ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:40:08.860038 14580 raft_consensus.cc:3037] T e188b856f395458e8a7ef51ec169bc30 P 22c8cc14907c43b8b0ebbdc945ce30ee [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:08.861052 14580 raft_consensus.cc:504] T e188b856f395458e8a7ef51ec169bc30 P 22c8cc14907c43b8b0ebbdc945ce30ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27b54889c8e2489e875523a0300cf1d2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39771 } } peers { permanent_uuid: "3665ace4ff494c6187624412aff2449c" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40923 } } peers { permanent_uuid: "22c8cc14907c43b8b0ebbdc945ce30ee" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 38739 } }
I20260808 04:40:08.861373 14580 leader_election.cc:288] T e188b856f395458e8a7ef51ec169bc30 P 22c8cc14907c43b8b0ebbdc945ce30ee [CANDIDATE]: Term 1 election: Requested vote from peers 27b54889c8e2489e875523a0300cf1d2 (127.12.148.65:39771), 3665ace4ff494c6187624412aff2449c (127.12.148.66:40923)
I20260808 04:40:08.861742 14061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e188b856f395458e8a7ef51ec169bc30" candidate_uuid: "22c8cc14907c43b8b0ebbdc945ce30ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27b54889c8e2489e875523a0300cf1d2"
I20260808 04:40:08.861754 14270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e188b856f395458e8a7ef51ec169bc30" candidate_uuid: "22c8cc14907c43b8b0ebbdc945ce30ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3665ace4ff494c6187624412aff2449c"
I20260808 04:40:08.861852 14061 raft_consensus.cc:3037] T e188b856f395458e8a7ef51ec169bc30 P 27b54889c8e2489e875523a0300cf1d2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:08.861872 14270 raft_consensus.cc:3037] T e188b856f395458e8a7ef51ec169bc30 P 3665ace4ff494c6187624412aff2449c [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:08.862955 14270 raft_consensus.cc:2454] T e188b856f395458e8a7ef51ec169bc30 P 3665ace4ff494c6187624412aff2449c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22c8cc14907c43b8b0ebbdc945ce30ee in term 1.
I20260808 04:40:08.862983 14061 raft_consensus.cc:2454] T e188b856f395458e8a7ef51ec169bc30 P 27b54889c8e2489e875523a0300cf1d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22c8cc14907c43b8b0ebbdc945ce30ee in term 1.
I20260808 04:40:08.863276 14374 leader_election.cc:302] T e188b856f395458e8a7ef51ec169bc30 P 22c8cc14907c43b8b0ebbdc945ce30ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 22c8cc14907c43b8b0ebbdc945ce30ee, 27b54889c8e2489e875523a0300cf1d2, 3665ace4ff494c6187624412aff2449c; no voters:
W20260808 04:40:08.863365 14542 tablet.cc:2369] T e188b856f395458e8a7ef51ec169bc30 P 22c8cc14907c43b8b0ebbdc945ce30ee: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:40:08.863500 14580 raft_consensus.cc:2781] T e188b856f395458e8a7ef51ec169bc30 P 22c8cc14907c43b8b0ebbdc945ce30ee [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:08.863722 14580 raft_consensus.cc:686] T e188b856f395458e8a7ef51ec169bc30 P 22c8cc14907c43b8b0ebbdc945ce30ee [term 1 LEADER]: Becoming Leader. State: Replica: 22c8cc14907c43b8b0ebbdc945ce30ee, State: Running, Role: LEADER
I20260808 04:40:08.864023 14580 consensus_queue.cc:237] T e188b856f395458e8a7ef51ec169bc30 P 22c8cc14907c43b8b0ebbdc945ce30ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27b54889c8e2489e875523a0300cf1d2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39771 } } peers { permanent_uuid: "3665ace4ff494c6187624412aff2449c" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40923 } } peers { permanent_uuid: "22c8cc14907c43b8b0ebbdc945ce30ee" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 38739 } }
I20260808 04:40:08.867010 13812 catalog_manager.cc:5495] T e188b856f395458e8a7ef51ec169bc30 P 22c8cc14907c43b8b0ebbdc945ce30ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 22c8cc14907c43b8b0ebbdc945ce30ee (127.12.148.67). New cstate: current_term: 1 leader_uuid: "22c8cc14907c43b8b0ebbdc945ce30ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27b54889c8e2489e875523a0300cf1d2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3665ace4ff494c6187624412aff2449c" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22c8cc14907c43b8b0ebbdc945ce30ee" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 38739 } health_report { overall_health: HEALTHY } } }
Aug 08 04:40:08 dist-test-slave-t7g5 krb5kdc[13743](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164007, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.148.65@KRBTEST.COM
W20260808 04:40:08.903503 14341 tablet.cc:2369] T e188b856f395458e8a7ef51ec169bc30 P 3665ace4ff494c6187624412aff2449c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:40:08.906201 14561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:08.897997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58432 (local address 127.12.148.65:39771)
0808 04:40:08.898161 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:08.898165 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:08.898240 (+ 75us) server_negotiation.cc:407] Connection header received
0808 04:40:08.898347 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:08.898350 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:08.898395 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:08.898462 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:08.899135 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.899669 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.900424 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.900654 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.900728 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:08.903034 (+ 2306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:08.903047 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:08.903063 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:08.903085 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:08.904696 (+ 1611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:08.905091 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:08.905097 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:08.905099 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:08.905188 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:08.905379 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:08.905380 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:08.905382 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:08.905611 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:08.905787 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:08.905939 (+ 152us) server_negotiation.cc:299] Negotiation successful
0808 04:40:08.906036 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
Aug 08 04:40:08 dist-test-slave-t7g5 krb5kdc[13743](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164008, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
W20260808 04:40:08.923982 14143 tablet.cc:2369] T e188b856f395458e8a7ef51ec169bc30 P 27b54889c8e2489e875523a0300cf1d2: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 04:40:08 dist-test-slave-t7g5 krb5kdc[13743](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164008, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.148.65@KRBTEST.COM
I20260808 04:40:08.933398 14561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:08.925851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58444 (local address 127.12.148.65:39771)
0808 04:40:08.925978 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:08.925982 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:08.926119 (+ 137us) server_negotiation.cc:407] Connection header received
0808 04:40:08.926251 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:08.926254 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:08.926300 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:08.926367 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:08.927031 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.927547 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.928332 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.928562 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.928651 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:08.930833 (+ 2182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:08.930836 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:08.930838 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:08.930876 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:08.931958 (+ 1082us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:08.932327 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:08.932329 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:08.932331 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:08.932408 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:08.932591 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:08.932593 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:08.932594 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:08.932733 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:08.932821 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:08.933130 (+ 309us) server_negotiation.cc:299] Negotiation successful
0808 04:40:08.933256 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
Aug 08 04:40:08 dist-test-slave-t7g5 krb5kdc[13743](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 04:40:08 dist-test-slave-t7g5 krb5kdc[13743](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.148.65@KRBTEST.COM
I20260808 04:40:08.958868 14561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:08.951293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58446 (local address 127.12.148.65:39771)
0808 04:40:08.951430 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:08.951435 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:08.951559 (+ 124us) server_negotiation.cc:407] Connection header received
0808 04:40:08.951692 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:08.951695 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:08.951738 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:08.951807 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:08.952464 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.952957 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.953816 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:08.954034 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:08.954123 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:08.956295 (+ 2172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:08.956298 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:08.956300 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:08.956323 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:08.957389 (+ 1066us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:08.957786 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:08.957790 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:08.957792 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:08.957869 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:08.958108 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:08.958111 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:08.958113 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:08.958270 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:08.958392 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:08.958601 (+ 209us) server_negotiation.cc:299] Negotiation successful
0808 04:40:08.958715 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
W20260808 04:40:08.960115 13997 tablet_service.cc:2908] Rejecting scan request for tablet e188b856f395458e8a7ef51ec169bc30: Uninitialized: clean time has not yet been initialized
I20260808 04:40:08.962311 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 13923
I20260808 04:40:08.975481 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 14154
I20260808 04:40:08.987210 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 14345
I20260808 04:40:08.997880 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 13765
2026-08-08T04:40:09Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2525 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:40:09 dist-test-slave-t7g5 krb5kdc[14612](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:40:09 dist-test-slave-t7g5 krb5kdc[14612](info): set up 2 sockets
Aug 08 04:40:09 dist-test-slave-t7g5 krb5kdc[14612](info): commencing operation
krb5kdc: starting...
W20260808 04:40:10.142760 12881 mini_kdc.cc:121] Time spent starting KDC: real 1.117s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Aug 08 04:40:10 dist-test-slave-t7g5 krb5kdc[14612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164010, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:40:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:40:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.148.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
I20260808 04:40:10.266474 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:35947
--webserver_interface=127.12.148.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:35981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:35947
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:10.379462 14638 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:10.379721 14638 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:10.379760 14638 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:10.383745 14638 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:40:10.383807 14638 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 04:40:10.383823 14638 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:10.383843 14638 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:10.383872 14638 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:40:10.383893 14638 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:40:10.389060 14638 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:35981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:35947
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:35947
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14638
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:10.390084 14638 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:10.391076 14638 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:10.399255 14648 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:10.399363 14638 server_base.cc:1034] running on GCE node
W20260808 04:40:10.399263 14652 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:10.399295 14649 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:10.400185 14638 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:10.401211 14638 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:10.402375 14638 hybrid_clock.cc:648] HybridClock initialized: now 1786164010402360 us; error 26 us; skew 500 ppm
Aug 08 04:40:10 dist-test-slave-t7g5 krb5kdc[14612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164010, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:10.408566 14638 init.cc:377] Logged in from keytab as kudu/127.12.148.126@KRBTEST.COM (short username kudu)
I20260808 04:40:10.409510 14638 webserver.cc:460] Webserver started at http://127.12.148.126:46401/ using document root <none> and password file <none>
I20260808 04:40:10.410085 14638 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:10.410148 14638 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:10.410321 14638 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:10.412509 14638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "1fa24221de434845ba2ca3767460519d"
format_stamp: "Formatted at 2026-08-08 04:40:10 on dist-test-slave-t7g5"
server_key: "ea9e15ccd3f808819c7433ef098e4d07"
server_key_iv: "baffeb4d9d2c4fb79d13fc4e1ab17d89"
server_key_version: "encryptionkey@0"
I20260808 04:40:10.413127 14638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "1fa24221de434845ba2ca3767460519d"
format_stamp: "Formatted at 2026-08-08 04:40:10 on dist-test-slave-t7g5"
server_key: "ea9e15ccd3f808819c7433ef098e4d07"
server_key_iv: "baffeb4d9d2c4fb79d13fc4e1ab17d89"
server_key_version: "encryptionkey@0"
I20260808 04:40:10.416716 14638 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260808 04:40:10.419119 14662 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:10.420333 14638 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260808 04:40:10.420451 14638 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "1fa24221de434845ba2ca3767460519d"
format_stamp: "Formatted at 2026-08-08 04:40:10 on dist-test-slave-t7g5"
server_key: "ea9e15ccd3f808819c7433ef098e4d07"
server_key_iv: "baffeb4d9d2c4fb79d13fc4e1ab17d89"
server_key_version: "encryptionkey@0"
I20260808 04:40:10.420537 14638 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:10.439174 14638 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:10.442291 14638 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:10.442446 14638 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:10.450227 14638 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:35947
I20260808 04:40:10.450239 14761 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:35947 every 8 connection(s)
I20260808 04:40:10.451146 14638 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:40:10.452531 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 14638
I20260808 04:40:10.452626 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:40:10.452878 12881 external_mini_cluster.cc:1428] Setting key c0b43fe6f9d222abb65e19c523a4672d
I20260808 04:40:10.454159 14762 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:10.461050 14762 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1fa24221de434845ba2ca3767460519d: Bootstrap starting.
Aug 08 04:40:10 dist-test-slave-t7g5 krb5kdc[14612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164010, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:40:10.463667 14762 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1fa24221de434845ba2ca3767460519d: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:10.465006 14762 log.cc:824] T 00000000000000000000000000000000 P 1fa24221de434845ba2ca3767460519d: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:10.467286 14762 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1fa24221de434845ba2ca3767460519d: No bootstrap required, opened a new log
I20260808 04:40:10.468011 14766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:10.454240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48112 (local address 127.12.148.126:35947)
0808 04:40:10.454666 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:10.454691 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:10.454732 (+ 41us) server_negotiation.cc:407] Connection header received
0808 04:40:10.455700 (+ 968us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:10.455723 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:10.456169 (+ 446us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:10.456535 (+ 366us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:10.457180 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.458683 (+ 1503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.459523 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.460233 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.460390 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:10.462710 (+ 2320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:10.462717 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:10.462732 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:10.462765 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:10.464728 (+ 1963us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:10.465189 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:10.465196 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:10.465201 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:10.465356 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:10.465710 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:10.465714 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:10.465716 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:10.466226 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:10.466444 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:10.466721 (+ 277us) server_negotiation.cc:299] Negotiation successful
0808 04:40:10.467015 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":124,"threads_started":1}
I20260808 04:40:10.470791 14762 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1fa24221de434845ba2ca3767460519d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fa24221de434845ba2ca3767460519d" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 35947 } }
I20260808 04:40:10.471010 14762 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1fa24221de434845ba2ca3767460519d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:10.471060 14762 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1fa24221de434845ba2ca3767460519d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fa24221de434845ba2ca3767460519d, State: Initialized, Role: FOLLOWER
I20260808 04:40:10.471410 14762 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1fa24221de434845ba2ca3767460519d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fa24221de434845ba2ca3767460519d" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 35947 } }
I20260808 04:40:10.471519 14762 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1fa24221de434845ba2ca3767460519d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:40:10.471562 14762 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1fa24221de434845ba2ca3767460519d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:40:10.471630 14762 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1fa24221de434845ba2ca3767460519d [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:10.472431 14762 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1fa24221de434845ba2ca3767460519d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fa24221de434845ba2ca3767460519d" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 35947 } }
I20260808 04:40:10.472733 14762 leader_election.cc:302] T 00000000000000000000000000000000 P 1fa24221de434845ba2ca3767460519d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1fa24221de434845ba2ca3767460519d; no voters:
I20260808 04:40:10.472990 14762 leader_election.cc:288] T 00000000000000000000000000000000 P 1fa24221de434845ba2ca3767460519d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:40:10.473129 14768 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1fa24221de434845ba2ca3767460519d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:10.473362 14768 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1fa24221de434845ba2ca3767460519d [term 1 LEADER]: Becoming Leader. State: Replica: 1fa24221de434845ba2ca3767460519d, State: Running, Role: LEADER
I20260808 04:40:10.473712 14768 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1fa24221de434845ba2ca3767460519d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fa24221de434845ba2ca3767460519d" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 35947 } }
I20260808 04:40:10.474193 14762 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1fa24221de434845ba2ca3767460519d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:40:10.475319 14772 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1fa24221de434845ba2ca3767460519d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1fa24221de434845ba2ca3767460519d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fa24221de434845ba2ca3767460519d" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 35947 } } }
I20260808 04:40:10.475458 14772 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1fa24221de434845ba2ca3767460519d [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:10.475764 14774 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1fa24221de434845ba2ca3767460519d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1fa24221de434845ba2ca3767460519d. Latest consensus state: current_term: 1 leader_uuid: "1fa24221de434845ba2ca3767460519d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fa24221de434845ba2ca3767460519d" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 35947 } } }
I20260808 04:40:10.475868 14774 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1fa24221de434845ba2ca3767460519d [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:10.475838 14784 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:40:10.478818 14784 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:40:10.484609 14784 catalog_manager.cc:1347] Generated new cluster ID: 2d67b0cb8cb74a76a1eb9751aa976141
I20260808 04:40:10.484671 14784 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:40:10.500005 14784 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:40:10.500923 14784 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:40:10.505442 14784 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1fa24221de434845ba2ca3767460519d: Generated new TSK 0
I20260808 04:40:10.506094 14784 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.148.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab.
Entry for principal kudu/127.12.148.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab.
I20260808 04:40:10.536949 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.65:0
--local_ip_for_outbound_sockets=127.12.148.65
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:35947
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:35981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:10.646759 14799 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:10.647008 14799 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:10.647049 14799 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:10.650965 14799 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:10.651021 14799 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:10.651057 14799 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 04:40:10.651106 14799 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.65
I20260808 04:40:10.656229 14799 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:35981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.148.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.148.126:35947
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14799
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.65
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:10.657197 14799 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:10.658208 14799 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:10.667412 14814 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:10.667510 14816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:10.667551 14809 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:10.667733 14799 server_base.cc:1034] running on GCE node
I20260808 04:40:10.668301 14799 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:10.668910 14799 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:10.670065 14799 hybrid_clock.cc:648] HybridClock initialized: now 1786164010670048 us; error 33 us; skew 500 ppm
Aug 08 04:40:10 dist-test-slave-t7g5 krb5kdc[14612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164010, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:10.672662 14799 init.cc:377] Logged in from keytab as kudu/127.12.148.65@KRBTEST.COM (short username kudu)
I20260808 04:40:10.673498 14799 webserver.cc:460] Webserver started at http://127.12.148.65:33879/ using document root <none> and password file <none>
I20260808 04:40:10.674052 14799 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:10.674121 14799 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:10.674343 14799 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:10.676445 14799 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-0/data/instance:
uuid: "890c3ecb47ee4cf38d746f327aa9fc54"
format_stamp: "Formatted at 2026-08-08 04:40:10 on dist-test-slave-t7g5"
server_key: "b9e13e65fae065d875a087901dffdc7d"
server_key_iv: "b3fac988fcfed6a2742d6ecea41d81bb"
server_key_version: "encryptionkey@0"
I20260808 04:40:10.676978 14799 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance:
uuid: "890c3ecb47ee4cf38d746f327aa9fc54"
format_stamp: "Formatted at 2026-08-08 04:40:10 on dist-test-slave-t7g5"
server_key: "b9e13e65fae065d875a087901dffdc7d"
server_key_iv: "b3fac988fcfed6a2742d6ecea41d81bb"
server_key_version: "encryptionkey@0"
I20260808 04:40:10.680568 14799 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 04:40:10.682901 14826 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:10.684056 14799 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 04:40:10.684162 14799 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-0/wal
uuid: "890c3ecb47ee4cf38d746f327aa9fc54"
format_stamp: "Formatted at 2026-08-08 04:40:10 on dist-test-slave-t7g5"
server_key: "b9e13e65fae065d875a087901dffdc7d"
server_key_iv: "b3fac988fcfed6a2742d6ecea41d81bb"
server_key_version: "encryptionkey@0"
I20260808 04:40:10.684262 14799 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:10.696375 14799 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:10.698968 14799 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:10.699139 14799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:10.700593 14799 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:10.700641 14799 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:10.700693 14799 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:10.700722 14799 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 04:40:10 dist-test-slave-t7g5 krb5kdc[14612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164010, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:40:10.710608 14799 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.65:39607
I20260808 04:40:10.711167 14992 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.65:39607 every 8 connection(s)
I20260808 04:40:10.711589 14799 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
I20260808 04:40:10.713222 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 14799
I20260808 04:40:10.713320 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance
I20260808 04:40:10.713587 12881 external_mini_cluster.cc:1428] Setting key 93cb144fd0ca4ff25f8aadba37d5f657
I20260808 04:40:10.714387 14766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:10.701392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:60735 (local address 127.12.148.126:35947)
0808 04:40:10.701515 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:10.701518 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:10.702560 (+ 1042us) server_negotiation.cc:407] Connection header received
0808 04:40:10.703563 (+ 1003us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:10.703567 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:10.703627 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:10.703684 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:10.705367 (+ 1683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.706214 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.707487 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.707939 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.708081 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:10.710769 (+ 2688us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:10.710773 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:10.710775 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:10.710806 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:10.712384 (+ 1578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:10.712849 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:10.712852 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:10.712854 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:10.712944 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:10.713272 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:10.713276 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:10.713278 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:10.713484 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:10.713571 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:10.714097 (+ 526us) server_negotiation.cc:299] Negotiation successful
0808 04:40:10.714226 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 04:40:10.715173 14840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:10.701958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:35947 (local address 127.12.148.65:60735)
0808 04:40:10.702414 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:10.702459 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:10.703324 (+ 865us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:10.704111 (+ 787us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:10.704117 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:10.704500 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:10.705175 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:10.705195 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.706355 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.706359 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:10.707373 (+ 1014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:10.707383 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.708098 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.708101 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:10.708246 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:10.708818 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:10.708841 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:10.710601 (+ 1760us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:10.712489 (+ 1888us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:10.712495 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:10.712509 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:10.712752 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:10.713042 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:10.713045 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:10.713047 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:10.713180 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:10.713586 (+ 406us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:10.713593 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:10.713873 (+ 280us) client_negotiation.cc:769] Sending connection context
0808 04:40:10.714037 (+ 164us) client_negotiation.cc:240] Negotiation successful
0808 04:40:10.714337 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":128,"threads_started":1}
I20260808 04:40:10.717782 14993 heartbeater.cc:347] Connected to a master server at 127.12.148.126:35947
I20260808 04:40:10.717935 14993 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:10.718472 14993 heartbeater.cc:511] Master 127.12.148.126:35947 requested a full tablet report, sending...
I20260808 04:40:10.720072 14686 ts_manager.cc:194] Registered new tserver with Master: 890c3ecb47ee4cf38d746f327aa9fc54 (127.12.148.65:39607)
I20260808 04:40:10.721156 14686 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.65@KRBTEST.COM'} at 127.12.148.65:60735
WARNING: no policy specified for kudu/127.12.148.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.66@KRBTEST.COM" created.
I20260808 04:40:10.728518 15001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:10.721899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:35947 (local address 127.12.148.65:51765)
0808 04:40:10.722174 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:10.722187 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:10.722290 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:10.722498 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:10.722501 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:10.722685 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:10.722805 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:10.722812 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.723625 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.723628 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:10.724219 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:10.724228 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.724697 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.724700 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:10.724790 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:10.725262 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:10.725276 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:10.725585 (+ 309us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:10.727173 (+ 1588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:10.727176 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:10.727177 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:10.727362 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:10.727633 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:10.727635 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:10.727636 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:10.727705 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:10.728065 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:10.728066 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:10.728136 (+ 70us) client_negotiation.cc:769] Sending connection context
0808 04:40:10.728208 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 04:40:10.728316 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"mutex_wait_us":7,"thread_start_us":96,"threads_started":1}
I20260808 04:40:10.728546 14766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:10.721965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:51765 (local address 127.12.148.126:35947)
0808 04:40:10.722083 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:10.722086 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:10.722256 (+ 170us) server_negotiation.cc:407] Connection header received
0808 04:40:10.722363 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:10.722366 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:10.722408 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:10.722472 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:10.722914 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.723503 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.724323 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.724595 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.724681 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:10.725746 (+ 1065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:10.725750 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:10.725752 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:10.725777 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:10.727068 (+ 1291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:10.727452 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:10.727456 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:10.727458 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:10.727550 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:10.727774 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:10.727777 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:10.727778 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:10.727986 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:10.728082 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:10.728281 (+ 199us) server_negotiation.cc:299] Negotiation successful
0808 04:40:10.728399 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab.
Entry for principal kudu/127.12.148.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab.
I20260808 04:40:10.740715 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.66:0
--local_ip_for_outbound_sockets=127.12.148.66
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:35947
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:35981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:10.851492 15004 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:10.851738 15004 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:10.851781 15004 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:10.855780 15004 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:10.855834 15004 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:10.855870 15004 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 04:40:10.855908 15004 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.66
I20260808 04:40:10.860899 15004 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:35981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.148.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.148.126:35947
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15004
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.66
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:10.861845 15004 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:10.862782 15004 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:10.871757 15009 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:10.871728 15013 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:10.871768 15010 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:10.871982 15004 server_base.cc:1034] running on GCE node
I20260808 04:40:10.872406 15004 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:10.872977 15004 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:10.874132 15004 hybrid_clock.cc:648] HybridClock initialized: now 1786164010874111 us; error 33 us; skew 500 ppm
Aug 08 04:40:10 dist-test-slave-t7g5 krb5kdc[14612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164010, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:10.876786 15004 init.cc:377] Logged in from keytab as kudu/127.12.148.66@KRBTEST.COM (short username kudu)
I20260808 04:40:10.877629 15004 webserver.cc:460] Webserver started at http://127.12.148.66:40441/ using document root <none> and password file <none>
I20260808 04:40:10.878170 15004 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:10.878229 15004 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:10.878427 15004 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:10.880340 15004 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-1/data/instance:
uuid: "796c02a5a31740a3b246b45119ade2ce"
format_stamp: "Formatted at 2026-08-08 04:40:10 on dist-test-slave-t7g5"
server_key: "69caff0291f1b86a1b6a78b77036f1a1"
server_key_iv: "2d4c1805c987c1f65f060f75744f808e"
server_key_version: "encryptionkey@0"
I20260808 04:40:10.880864 15004 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance:
uuid: "796c02a5a31740a3b246b45119ade2ce"
format_stamp: "Formatted at 2026-08-08 04:40:10 on dist-test-slave-t7g5"
server_key: "69caff0291f1b86a1b6a78b77036f1a1"
server_key_iv: "2d4c1805c987c1f65f060f75744f808e"
server_key_version: "encryptionkey@0"
I20260808 04:40:10.884287 15004 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260808 04:40:10.886524 15026 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:10.887645 15004 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:40:10.887737 15004 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-1/wal
uuid: "796c02a5a31740a3b246b45119ade2ce"
format_stamp: "Formatted at 2026-08-08 04:40:10 on dist-test-slave-t7g5"
server_key: "69caff0291f1b86a1b6a78b77036f1a1"
server_key_iv: "2d4c1805c987c1f65f060f75744f808e"
server_key_version: "encryptionkey@0"
I20260808 04:40:10.887832 15004 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:10.903151 15004 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:10.906147 15004 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:10.906322 15004 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:10.907677 15004 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:10.907727 15004 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:10.907778 15004 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:10.907805 15004 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 04:40:10 dist-test-slave-t7g5 krb5kdc[14612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164010, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:40:10.918015 15004 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.66:39255
I20260808 04:40:10.918159 15192 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.66:39255 every 8 connection(s)
I20260808 04:40:10.918939 15004 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
I20260808 04:40:10.920547 14766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:10.908325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:60091 (local address 127.12.148.126:35947)
0808 04:40:10.908459 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:10.908463 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:10.909997 (+ 1534us) server_negotiation.cc:407] Connection header received
0808 04:40:10.911041 (+ 1044us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:10.911045 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:10.911104 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:10.911182 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:10.912321 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.912913 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.914109 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.914331 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.914422 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:10.917089 (+ 2667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:10.917093 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:10.917095 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:10.917120 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:10.918530 (+ 1410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:10.919154 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:10.919158 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:10.919159 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:10.919262 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:10.919656 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:10.919660 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:10.919662 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:10.919856 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:10.919931 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:10.920330 (+ 399us) server_negotiation.cc:299] Negotiation successful
0808 04:40:10.920428 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 04:40:10.921276 15039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:10.909348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:35947 (local address 127.12.148.66:60091)
0808 04:40:10.909856 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:10.909897 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:10.910820 (+ 923us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:10.911354 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:10.911361 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:10.911726 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:10.912175 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:10.912188 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.913047 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.913050 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:10.913993 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:10.914005 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.914490 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.914494 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:10.914652 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:10.915146 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:10.915161 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:10.916919 (+ 1758us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:10.918699 (+ 1780us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:10.918704 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:10.918718 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:10.919035 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:10.919368 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:10.919371 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:10.919372 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:10.919541 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:10.919933 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:10.919938 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:10.920146 (+ 208us) client_negotiation.cc:769] Sending connection context
0808 04:40:10.920295 (+ 149us) client_negotiation.cc:240] Negotiation successful
0808 04:40:10.920529 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":124,"threads_started":1}
I20260808 04:40:10.922439 15193 heartbeater.cc:347] Connected to a master server at 127.12.148.126:35947
I20260808 04:40:10.922564 15193 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:10.922978 15193 heartbeater.cc:511] Master 127.12.148.126:35947 requested a full tablet report, sending...
I20260808 04:40:10.923977 14689 ts_manager.cc:194] Registered new tserver with Master: 796c02a5a31740a3b246b45119ade2ce (127.12.148.66:39255)
I20260808 04:40:10.924649 14689 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.66@KRBTEST.COM'} at 127.12.148.66:60091
I20260808 04:40:10.927049 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 15004
I20260808 04:40:10.927156 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance
I20260808 04:40:10.927451 12881 external_mini_cluster.cc:1428] Setting key 43e0d528bbdb92403140529d5a1cdb8b
I20260808 04:40:10.930975 15205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:10.924421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:35947 (local address 127.12.148.66:34505)
0808 04:40:10.924671 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:10.924684 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:10.924795 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:10.925017 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:10.925020 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:10.925203 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:10.925333 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:10.925339 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.926240 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.926244 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:10.926809 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:10.926818 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.927259 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.927263 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:10.927362 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:10.927769 (+ 407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:10.927782 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:10.928093 (+ 311us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:10.929614 (+ 1521us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:10.929617 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:10.929619 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:10.929861 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:10.930081 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:10.930084 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:10.930085 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:10.930173 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:10.930508 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:10.930511 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:10.930605 (+ 94us) client_negotiation.cc:769] Sending connection context
0808 04:40:10.930708 (+ 103us) client_negotiation.cc:240] Negotiation successful
0808 04:40:10.930835 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"mutex_wait_us":1,"thread_start_us":101,"threads_started":1}
I20260808 04:40:10.931023 14766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:10.924474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:34505 (local address 127.12.148.126:35947)
0808 04:40:10.924589 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:10.924593 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:10.924757 (+ 164us) server_negotiation.cc:407] Connection header received
0808 04:40:10.924888 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:10.924891 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:10.924932 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:10.925000 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:10.925442 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.926092 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.926914 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:10.927135 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:10.927227 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:10.928209 (+ 982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:10.928212 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:10.928214 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:10.928235 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:10.929511 (+ 1276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:10.929941 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:10.929943 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:10.929944 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:10.930010 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:10.930241 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:10.930243 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:10.930244 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:10.930431 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:10.930501 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:10.930772 (+ 271us) server_negotiation.cc:299] Negotiation successful
0808 04:40:10.930884 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
WARNING: no policy specified for kudu/127.12.148.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab.
Entry for principal kudu/127.12.148.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab.
I20260808 04:40:10.952147 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.67:0
--local_ip_for_outbound_sockets=127.12.148.67
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:35947
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:35981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:11.061862 15209 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:11.062129 15209 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:11.062189 15209 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:11.066231 15209 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:11.066288 15209 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:11.066341 15209 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 04:40:11.066391 15209 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.67
I20260808 04:40:11.071659 15209 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:35981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.148.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.148.126:35947
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15209
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.67
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:11.072616 15209 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:11.073582 15209 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:11.082756 15214 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:11.082823 15215 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:11.082957 15209 server_base.cc:1034] running on GCE node
W20260808 04:40:11.083108 15219 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:11.083458 15209 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:11.084031 15209 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:11.085198 15209 hybrid_clock.cc:648] HybridClock initialized: now 1786164011085169 us; error 37 us; skew 500 ppm
Aug 08 04:40:11 dist-test-slave-t7g5 krb5kdc[14612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164011, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:11.087896 15209 init.cc:377] Logged in from keytab as kudu/127.12.148.67@KRBTEST.COM (short username kudu)
I20260808 04:40:11.088800 15209 webserver.cc:460] Webserver started at http://127.12.148.67:45971/ using document root <none> and password file <none>
I20260808 04:40:11.089285 15209 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:11.089342 15209 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:11.089501 15209 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:11.091519 15209 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-2/data/instance:
uuid: "99396916be07442ba1cdba42b842df64"
format_stamp: "Formatted at 2026-08-08 04:40:11 on dist-test-slave-t7g5"
server_key: "ec10321c0a8c4264bcce441588c3e2a1"
server_key_iv: "22289eea4d4840d995bf5867f95a0854"
server_key_version: "encryptionkey@0"
I20260808 04:40:11.092017 15209 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance:
uuid: "99396916be07442ba1cdba42b842df64"
format_stamp: "Formatted at 2026-08-08 04:40:11 on dist-test-slave-t7g5"
server_key: "ec10321c0a8c4264bcce441588c3e2a1"
server_key_iv: "22289eea4d4840d995bf5867f95a0854"
server_key_version: "encryptionkey@0"
I20260808 04:40:11.095840 15209 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 04:40:11.098183 15228 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:11.099354 15209 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:40:11.099459 15209 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-2/wal
uuid: "99396916be07442ba1cdba42b842df64"
format_stamp: "Formatted at 2026-08-08 04:40:11 on dist-test-slave-t7g5"
server_key: "ec10321c0a8c4264bcce441588c3e2a1"
server_key_iv: "22289eea4d4840d995bf5867f95a0854"
server_key_version: "encryptionkey@0"
I20260808 04:40:11.099539 15209 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:11.111131 15209 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:11.113757 15209 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:11.113900 15209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:11.115190 15209 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:11.115238 15209 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:11.115278 15209 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:11.115306 15209 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 04:40:11 dist-test-slave-t7g5 krb5kdc[14612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164011, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:40:11.125046 15209 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.67:44549
I20260808 04:40:11.125159 15395 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.67:44549 every 8 connection(s)
I20260808 04:40:11.126034 15209 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
I20260808 04:40:11.127907 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 15209
I20260808 04:40:11.128022 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance
I20260808 04:40:11.128340 12881 external_mini_cluster.cc:1428] Setting key c63a183620a6684e96e46e3fa2e9c88b
I20260808 04:40:11.129863 15243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:11.116290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:35947 (local address 127.12.148.67:40491)
0808 04:40:11.116731 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:11.116787 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:11.117833 (+ 1046us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:11.118530 (+ 697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:11.118539 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:11.118886 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:11.119582 (+ 696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:11.119603 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.120632 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.120636 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:11.122058 (+ 1422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:11.122071 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.122620 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.122626 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:11.122822 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:11.123482 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:11.123503 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:11.125293 (+ 1790us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:11.127039 (+ 1746us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:11.127044 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:11.127056 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:11.127298 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:11.127543 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:11.127545 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:11.127546 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:11.127663 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:11.128181 (+ 518us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:11.128187 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:11.128471 (+ 284us) client_negotiation.cc:769] Sending connection context
0808 04:40:11.128666 (+ 195us) client_negotiation.cc:240] Negotiation successful
0808 04:40:11.128927 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":106,"threads_started":1}
I20260808 04:40:11.130026 14766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:11.115953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:40491 (local address 127.12.148.126:35947)
0808 04:40:11.116107 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:11.116112 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:11.116899 (+ 787us) server_negotiation.cc:407] Connection header received
0808 04:40:11.118163 (+ 1264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:11.118167 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:11.118238 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:11.118329 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:11.119728 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.120503 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.122193 (+ 1690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.122455 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.122559 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:11.125447 (+ 2888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:11.125450 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:11.125452 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:11.125478 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:11.126940 (+ 1462us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:11.127395 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:11.127398 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:11.127399 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:11.127480 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:11.127787 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:11.127791 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:11.127793 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:11.128023 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:11.128121 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:11.129787 (+ 1666us) server_negotiation.cc:299] Negotiation successful
0808 04:40:11.129887 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 04:40:11.131127 15396 heartbeater.cc:347] Connected to a master server at 127.12.148.126:35947
I20260808 04:40:11.131263 15396 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:11.131781 15396 heartbeater.cc:511] Master 127.12.148.126:35947 requested a full tablet report, sending...
I20260808 04:40:11.132805 14686 ts_manager.cc:194] Registered new tserver with Master: 99396916be07442ba1cdba42b842df64 (127.12.148.67:44549)
I20260808 04:40:11.133481 14686 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.67@KRBTEST.COM'} at 127.12.148.67:40491
I20260808 04:40:11.139573 15402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:11.133358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:35947 (local address 127.12.148.67:45203)
0808 04:40:11.133701 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:11.133715 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:11.133814 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:11.134041 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:11.134044 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:11.134260 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:11.134370 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:11.134378 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.135122 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.135126 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:11.135770 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:11.135779 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.136160 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.136162 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:11.136225 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:11.136637 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:11.136648 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:11.136961 (+ 313us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:11.138318 (+ 1357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:11.138321 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:11.138322 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:11.138516 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:11.138787 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:11.138789 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:11.138790 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:11.138863 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:11.139213 (+ 350us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:11.139215 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:11.139284 (+ 69us) client_negotiation.cc:769] Sending connection context
0808 04:40:11.139353 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 04:40:11.139453 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":106,"threads_started":1}
I20260808 04:40:11.139583 14766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:11.133428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:45203 (local address 127.12.148.126:35947)
0808 04:40:11.133533 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:11.133536 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:11.133774 (+ 238us) server_negotiation.cc:407] Connection header received
0808 04:40:11.133897 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:11.133900 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:11.133943 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:11.134023 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:11.134506 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.134989 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.135874 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.136075 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.136155 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:11.137077 (+ 922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:11.137080 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:11.137081 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:11.137101 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:11.138229 (+ 1128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:11.138617 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:11.138620 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:11.138621 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:11.138696 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:11.138962 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:11.138965 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:11.138966 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:11.139134 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:11.139215 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:11.139401 (+ 186us) server_negotiation.cc:299] Negotiation successful
0808 04:40:11.139486 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 04:40:11.142058 12881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 04:40:11 dist-test-slave-t7g5 krb5kdc[14612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164011, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 04:40:11 dist-test-slave-t7g5 krb5kdc[14612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164011, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:40:11.166826 14766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:11.159446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48116 (local address 127.12.148.126:35947)
0808 04:40:11.159571 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:11.159574 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:11.159587 (+ 13us) server_negotiation.cc:407] Connection header received
0808 04:40:11.159623 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:11.159625 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:11.159662 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:11.159729 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:11.160343 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.160844 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.161598 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.161826 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.161895 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:11.164160 (+ 2265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:11.164163 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:11.164165 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:11.164190 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:11.165336 (+ 1146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:11.165776 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:11.165778 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:11.165779 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:11.165856 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:11.166117 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:11.166118 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:11.166119 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:11.166273 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:11.166372 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:11.166612 (+ 240us) server_negotiation.cc:299] Negotiation successful
0808 04:40:11.166702 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 04:40:11.169397 14686 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48116:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:40:11.172319 14686 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:40:11.185930 15423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:11.180217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:39607 (local address 127.0.0.1:33890)
0808 04:40:11.180533 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:11.180583 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:11.180705 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:11.181605 (+ 900us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:11.181611 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:11.181636 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:11.181793 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:11.181802 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.183238 (+ 1436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.183241 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:11.184591 (+ 1350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:11.184600 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.185397 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.185401 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:11.185504 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:11.185540 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 04:40:11.185644 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 04:40:11.185786 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"mutex_wait_us":44,"thread_start_us":49,"threads_started":1}
I20260808 04:40:11.185941 15425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:11.180411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33890 (local address 127.12.148.65:39607)
0808 04:40:11.181083 (+ 672us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:11.181096 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:11.181120 (+ 24us) server_negotiation.cc:407] Connection header received
0808 04:40:11.181198 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:11.181203 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:11.181417 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:11.181967 (+ 550us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:11.182106 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.183133 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.184718 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.185284 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.185383 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:11.185543 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:11.185710 (+ 167us) server_negotiation.cc:299] Negotiation successful
0808 04:40:11.185814 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":565,"thread_start_us":115,"threads_started":1}
I20260808 04:40:11.186178 15426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:11.180540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:39255 (local address 127.0.0.1:57492)
0808 04:40:11.180944 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:11.180956 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:11.181037 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:11.181825 (+ 788us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:11.181828 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:11.181848 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:11.181950 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:11.181957 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.183171 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.183174 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:11.184680 (+ 1506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:11.184692 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.185800 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.185804 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:11.185894 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:11.185917 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 04:40:11.185969 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 04:40:11.186039 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":345,"mutex_wait_us":104,"thread_start_us":101,"threads_started":1}
I20260808 04:40:11.186553 15427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:11.180924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.67:44549 (local address 127.0.0.1:52194)
0808 04:40:11.181914 (+ 990us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:11.181927 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:11.181997 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:11.182582 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:11.182585 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:11.182604 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:11.182680 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:11.182686 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.183750 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.183754 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:11.184728 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:11.184735 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.186133 (+ 1398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.186136 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:11.186215 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:11.186302 (+ 87us) client_negotiation.cc:769] Sending connection context
0808 04:40:11.186373 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 04:40:11.186440 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":932,"thread_start_us":89,"threads_started":1}
I20260808 04:40:11.186914 15430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:11.180986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57492 (local address 127.12.148.66:39255)
0808 04:40:11.181318 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:11.181329 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:11.181351 (+ 22us) server_negotiation.cc:407] Connection header received
0808 04:40:11.181422 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:11.181427 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:11.181616 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:11.182099 (+ 483us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:11.182203 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.183076 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.184828 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.185640 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.186457 (+ 817us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:11.186621 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:11.186678 (+ 57us) server_negotiation.cc:299] Negotiation successful
0808 04:40:11.186780 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":245,"thread_start_us":126,"threads_started":1}
I20260808 04:40:11.187064 15432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:11.181419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52194 (local address 127.12.148.67:44549)
0808 04:40:11.182054 (+ 635us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:11.182073 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:11.182095 (+ 22us) server_negotiation.cc:407] Connection header received
0808 04:40:11.182164 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:11.182169 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:11.182332 (+ 163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:11.182488 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:11.182790 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.183642 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.184847 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.185640 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.185771 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:11.185933 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:11.186830 (+ 897us) server_negotiation.cc:299] Negotiation successful
0808 04:40:11.186925 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":526,"thread_start_us":115,"threads_started":1}
I20260808 04:40:11.189036 14877 tablet_service.cc:1467] Processing CreateTablet for tablet e336d888bf1242d5a6cb736bc177b6f3 (DEFAULT_TABLE table=test-table [id=ae9cba3e60ee4d00ad483b1708ce267d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:11.189452 15302 tablet_service.cc:1467] Processing CreateTablet for tablet e336d888bf1242d5a6cb736bc177b6f3 (DEFAULT_TABLE table=test-table [id=ae9cba3e60ee4d00ad483b1708ce267d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:11.189515 15097 tablet_service.cc:1467] Processing CreateTablet for tablet e336d888bf1242d5a6cb736bc177b6f3 (DEFAULT_TABLE table=test-table [id=ae9cba3e60ee4d00ad483b1708ce267d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:11.190192 14877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e336d888bf1242d5a6cb736bc177b6f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:11.190407 15302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e336d888bf1242d5a6cb736bc177b6f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:11.190485 15097 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e336d888bf1242d5a6cb736bc177b6f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:11.196835 15433 tablet_bootstrap.cc:492] T e336d888bf1242d5a6cb736bc177b6f3 P 99396916be07442ba1cdba42b842df64: Bootstrap starting.
I20260808 04:40:11.198419 15434 tablet_bootstrap.cc:492] T e336d888bf1242d5a6cb736bc177b6f3 P 890c3ecb47ee4cf38d746f327aa9fc54: Bootstrap starting.
I20260808 04:40:11.198742 15435 tablet_bootstrap.cc:492] T e336d888bf1242d5a6cb736bc177b6f3 P 796c02a5a31740a3b246b45119ade2ce: Bootstrap starting.
I20260808 04:40:11.199597 15433 tablet_bootstrap.cc:654] T e336d888bf1242d5a6cb736bc177b6f3 P 99396916be07442ba1cdba42b842df64: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:11.200090 15434 tablet_bootstrap.cc:654] T e336d888bf1242d5a6cb736bc177b6f3 P 890c3ecb47ee4cf38d746f327aa9fc54: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:11.200479 15433 log.cc:824] T e336d888bf1242d5a6cb736bc177b6f3 P 99396916be07442ba1cdba42b842df64: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:11.200742 15435 tablet_bootstrap.cc:654] T e336d888bf1242d5a6cb736bc177b6f3 P 796c02a5a31740a3b246b45119ade2ce: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:11.200758 15434 log.cc:824] T e336d888bf1242d5a6cb736bc177b6f3 P 890c3ecb47ee4cf38d746f327aa9fc54: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:11.201496 15435 log.cc:824] T e336d888bf1242d5a6cb736bc177b6f3 P 796c02a5a31740a3b246b45119ade2ce: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:11.202601 15434 tablet_bootstrap.cc:492] T e336d888bf1242d5a6cb736bc177b6f3 P 890c3ecb47ee4cf38d746f327aa9fc54: No bootstrap required, opened a new log
I20260808 04:40:11.202601 15433 tablet_bootstrap.cc:492] T e336d888bf1242d5a6cb736bc177b6f3 P 99396916be07442ba1cdba42b842df64: No bootstrap required, opened a new log
I20260808 04:40:11.202798 15433 ts_tablet_manager.cc:1397] T e336d888bf1242d5a6cb736bc177b6f3 P 99396916be07442ba1cdba42b842df64: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 04:40:11.202838 15434 ts_tablet_manager.cc:1397] T e336d888bf1242d5a6cb736bc177b6f3 P 890c3ecb47ee4cf38d746f327aa9fc54: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 04:40:11.203474 15435 tablet_bootstrap.cc:492] T e336d888bf1242d5a6cb736bc177b6f3 P 796c02a5a31740a3b246b45119ade2ce: No bootstrap required, opened a new log
I20260808 04:40:11.203660 15435 ts_tablet_manager.cc:1397] T e336d888bf1242d5a6cb736bc177b6f3 P 796c02a5a31740a3b246b45119ade2ce: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 04:40:11.206507 15435 raft_consensus.cc:348] T e336d888bf1242d5a6cb736bc177b6f3 P 796c02a5a31740a3b246b45119ade2ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39607 } } peers { permanent_uuid: "99396916be07442ba1cdba42b842df64" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44549 } } peers { permanent_uuid: "796c02a5a31740a3b246b45119ade2ce" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 39255 } }
I20260808 04:40:11.206730 15435 raft_consensus.cc:374] T e336d888bf1242d5a6cb736bc177b6f3 P 796c02a5a31740a3b246b45119ade2ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:11.206791 15435 raft_consensus.cc:729] T e336d888bf1242d5a6cb736bc177b6f3 P 796c02a5a31740a3b246b45119ade2ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 796c02a5a31740a3b246b45119ade2ce, State: Initialized, Role: FOLLOWER
I20260808 04:40:11.206651 15433 raft_consensus.cc:348] T e336d888bf1242d5a6cb736bc177b6f3 P 99396916be07442ba1cdba42b842df64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39607 } } peers { permanent_uuid: "99396916be07442ba1cdba42b842df64" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44549 } } peers { permanent_uuid: "796c02a5a31740a3b246b45119ade2ce" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 39255 } }
I20260808 04:40:11.206651 15434 raft_consensus.cc:348] T e336d888bf1242d5a6cb736bc177b6f3 P 890c3ecb47ee4cf38d746f327aa9fc54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39607 } } peers { permanent_uuid: "99396916be07442ba1cdba42b842df64" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44549 } } peers { permanent_uuid: "796c02a5a31740a3b246b45119ade2ce" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 39255 } }
I20260808 04:40:11.206903 15434 raft_consensus.cc:374] T e336d888bf1242d5a6cb736bc177b6f3 P 890c3ecb47ee4cf38d746f327aa9fc54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:11.206908 15433 raft_consensus.cc:374] T e336d888bf1242d5a6cb736bc177b6f3 P 99396916be07442ba1cdba42b842df64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:11.206964 15433 raft_consensus.cc:729] T e336d888bf1242d5a6cb736bc177b6f3 P 99396916be07442ba1cdba42b842df64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99396916be07442ba1cdba42b842df64, State: Initialized, Role: FOLLOWER
I20260808 04:40:11.206972 15434 raft_consensus.cc:729] T e336d888bf1242d5a6cb736bc177b6f3 P 890c3ecb47ee4cf38d746f327aa9fc54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 890c3ecb47ee4cf38d746f327aa9fc54, State: Initialized, Role: FOLLOWER
I20260808 04:40:11.207273 15435 consensus_queue.cc:260] T e336d888bf1242d5a6cb736bc177b6f3 P 796c02a5a31740a3b246b45119ade2ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39607 } } peers { permanent_uuid: "99396916be07442ba1cdba42b842df64" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44549 } } peers { permanent_uuid: "796c02a5a31740a3b246b45119ade2ce" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 39255 } }
I20260808 04:40:11.207386 15434 consensus_queue.cc:260] T e336d888bf1242d5a6cb736bc177b6f3 P 890c3ecb47ee4cf38d746f327aa9fc54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39607 } } peers { permanent_uuid: "99396916be07442ba1cdba42b842df64" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44549 } } peers { permanent_uuid: "796c02a5a31740a3b246b45119ade2ce" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 39255 } }
I20260808 04:40:11.207386 15433 consensus_queue.cc:260] T e336d888bf1242d5a6cb736bc177b6f3 P 99396916be07442ba1cdba42b842df64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39607 } } peers { permanent_uuid: "99396916be07442ba1cdba42b842df64" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44549 } } peers { permanent_uuid: "796c02a5a31740a3b246b45119ade2ce" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 39255 } }
I20260808 04:40:11.207926 15193 heartbeater.cc:503] Master 127.12.148.126:35947 was elected leader, sending a full tablet report...
I20260808 04:40:11.208302 15435 ts_tablet_manager.cc:1428] T e336d888bf1242d5a6cb736bc177b6f3 P 796c02a5a31740a3b246b45119ade2ce: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260808 04:40:11.208323 15434 ts_tablet_manager.cc:1428] T e336d888bf1242d5a6cb736bc177b6f3 P 890c3ecb47ee4cf38d746f327aa9fc54: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260808 04:40:11.208321 15433 ts_tablet_manager.cc:1428] T e336d888bf1242d5a6cb736bc177b6f3 P 99396916be07442ba1cdba42b842df64: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260808 04:40:11.208639 15396 heartbeater.cc:503] Master 127.12.148.126:35947 was elected leader, sending a full tablet report...
I20260808 04:40:11.208639 14993 heartbeater.cc:503] Master 127.12.148.126:35947 was elected leader, sending a full tablet report...
W20260808 04:40:11.212756 14994 tablet.cc:2369] T e336d888bf1242d5a6cb736bc177b6f3 P 890c3ecb47ee4cf38d746f327aa9fc54: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:40:11.292725 15445 raft_consensus.cc:482] T e336d888bf1242d5a6cb736bc177b6f3 P 99396916be07442ba1cdba42b842df64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:40:11.292956 15445 raft_consensus.cc:504] T e336d888bf1242d5a6cb736bc177b6f3 P 99396916be07442ba1cdba42b842df64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39607 } } peers { permanent_uuid: "99396916be07442ba1cdba42b842df64" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44549 } } peers { permanent_uuid: "796c02a5a31740a3b246b45119ade2ce" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 39255 } }
I20260808 04:40:11.294130 15445 leader_election.cc:288] T e336d888bf1242d5a6cb736bc177b6f3 P 99396916be07442ba1cdba42b842df64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 890c3ecb47ee4cf38d746f327aa9fc54 (127.12.148.65:39607), 796c02a5a31740a3b246b45119ade2ce (127.12.148.66:39255)
I20260808 04:40:11.297991 15425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:11.294423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:39359 (local address 127.12.148.65:39607)
0808 04:40:11.294547 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:11.294551 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:11.294613 (+ 62us) server_negotiation.cc:407] Connection header received
0808 04:40:11.294773 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:11.294777 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:11.294830 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:11.294907 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:11.295216 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.295831 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.296890 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.297485 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.297606 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:11.297687 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:11.297831 (+ 144us) server_negotiation.cc:299] Negotiation successful
0808 04:40:11.297887 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 04:40:11.298028 15243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:11.294343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:39607 (local address 127.12.148.67:39359)
0808 04:40:11.294535 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:11.294550 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:11.294650 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:11.294922 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:11.294925 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:11.294952 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:11.295073 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:11.295079 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.295948 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.295951 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:11.296752 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:11.296761 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.297586 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.297589 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:11.297714 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:11.297741 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 04:40:11.297819 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 04:40:11.297888 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112}
I20260808 04:40:11.298581 14924 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e336d888bf1242d5a6cb736bc177b6f3" candidate_uuid: "99396916be07442ba1cdba42b842df64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" is_pre_election: true
I20260808 04:40:11.298740 15430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:11.294523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:53869 (local address 127.12.148.66:39255)
0808 04:40:11.294634 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:11.294638 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:11.294903 (+ 265us) server_negotiation.cc:407] Connection header received
0808 04:40:11.295012 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:11.295014 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:11.295062 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:11.295145 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:11.295461 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.295969 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.297696 (+ 1727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.298251 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.298358 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:11.298407 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:11.298574 (+ 167us) server_negotiation.cc:299] Negotiation successful
0808 04:40:11.298640 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 04:40:11.298738 15447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:11.294414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:39255 (local address 127.12.148.67:53869)
0808 04:40:11.294810 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:11.294823 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:11.294921 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:11.295192 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:11.295195 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:11.295216 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:11.295341 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:11.295348 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.296075 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.296078 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:11.297563 (+ 1485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:11.297573 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.298371 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.298374 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:11.298467 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:11.298484 (+ 17us) client_negotiation.cc:769] Sending connection context
0808 04:40:11.298549 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 04:40:11.298610 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":119,"threads_started":1}
I20260808 04:40:11.298873 14924 raft_consensus.cc:2454] T e336d888bf1242d5a6cb736bc177b6f3 P 890c3ecb47ee4cf38d746f327aa9fc54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99396916be07442ba1cdba42b842df64 in term 0.
I20260808 04:40:11.299330 15229 leader_election.cc:302] T e336d888bf1242d5a6cb736bc177b6f3 P 99396916be07442ba1cdba42b842df64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 890c3ecb47ee4cf38d746f327aa9fc54, 99396916be07442ba1cdba42b842df64; no voters:
I20260808 04:40:11.299326 15127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e336d888bf1242d5a6cb736bc177b6f3" candidate_uuid: "99396916be07442ba1cdba42b842df64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "796c02a5a31740a3b246b45119ade2ce" is_pre_election: true
I20260808 04:40:11.299574 15127 raft_consensus.cc:2454] T e336d888bf1242d5a6cb736bc177b6f3 P 796c02a5a31740a3b246b45119ade2ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99396916be07442ba1cdba42b842df64 in term 0.
I20260808 04:40:11.299577 15445 raft_consensus.cc:2781] T e336d888bf1242d5a6cb736bc177b6f3 P 99396916be07442ba1cdba42b842df64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:40:11.299655 15445 raft_consensus.cc:482] T e336d888bf1242d5a6cb736bc177b6f3 P 99396916be07442ba1cdba42b842df64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:40:11.299698 15445 raft_consensus.cc:3037] T e336d888bf1242d5a6cb736bc177b6f3 P 99396916be07442ba1cdba42b842df64 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:11.300702 15445 raft_consensus.cc:504] T e336d888bf1242d5a6cb736bc177b6f3 P 99396916be07442ba1cdba42b842df64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39607 } } peers { permanent_uuid: "99396916be07442ba1cdba42b842df64" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44549 } } peers { permanent_uuid: "796c02a5a31740a3b246b45119ade2ce" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 39255 } }
I20260808 04:40:11.301025 15445 leader_election.cc:288] T e336d888bf1242d5a6cb736bc177b6f3 P 99396916be07442ba1cdba42b842df64 [CANDIDATE]: Term 1 election: Requested vote from peers 890c3ecb47ee4cf38d746f327aa9fc54 (127.12.148.65:39607), 796c02a5a31740a3b246b45119ade2ce (127.12.148.66:39255)
I20260808 04:40:11.301342 14924 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e336d888bf1242d5a6cb736bc177b6f3" candidate_uuid: "99396916be07442ba1cdba42b842df64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "890c3ecb47ee4cf38d746f327aa9fc54"
I20260808 04:40:11.301380 15127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e336d888bf1242d5a6cb736bc177b6f3" candidate_uuid: "99396916be07442ba1cdba42b842df64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "796c02a5a31740a3b246b45119ade2ce"
I20260808 04:40:11.301481 14924 raft_consensus.cc:3037] T e336d888bf1242d5a6cb736bc177b6f3 P 890c3ecb47ee4cf38d746f327aa9fc54 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:11.301487 15127 raft_consensus.cc:3037] T e336d888bf1242d5a6cb736bc177b6f3 P 796c02a5a31740a3b246b45119ade2ce [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:11.302721 15127 raft_consensus.cc:2454] T e336d888bf1242d5a6cb736bc177b6f3 P 796c02a5a31740a3b246b45119ade2ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99396916be07442ba1cdba42b842df64 in term 1.
I20260808 04:40:11.302721 14924 raft_consensus.cc:2454] T e336d888bf1242d5a6cb736bc177b6f3 P 890c3ecb47ee4cf38d746f327aa9fc54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99396916be07442ba1cdba42b842df64 in term 1.
I20260808 04:40:11.303017 15229 leader_election.cc:302] T e336d888bf1242d5a6cb736bc177b6f3 P 99396916be07442ba1cdba42b842df64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 890c3ecb47ee4cf38d746f327aa9fc54, 99396916be07442ba1cdba42b842df64; no voters:
I20260808 04:40:11.303176 15445 raft_consensus.cc:2781] T e336d888bf1242d5a6cb736bc177b6f3 P 99396916be07442ba1cdba42b842df64 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:11.303426 15445 raft_consensus.cc:686] T e336d888bf1242d5a6cb736bc177b6f3 P 99396916be07442ba1cdba42b842df64 [term 1 LEADER]: Becoming Leader. State: Replica: 99396916be07442ba1cdba42b842df64, State: Running, Role: LEADER
I20260808 04:40:11.303769 15445 consensus_queue.cc:237] T e336d888bf1242d5a6cb736bc177b6f3 P 99396916be07442ba1cdba42b842df64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39607 } } peers { permanent_uuid: "99396916be07442ba1cdba42b842df64" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44549 } } peers { permanent_uuid: "796c02a5a31740a3b246b45119ade2ce" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 39255 } }
I20260808 04:40:11.306825 14686 catalog_manager.cc:5495] T e336d888bf1242d5a6cb736bc177b6f3 P 99396916be07442ba1cdba42b842df64 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99396916be07442ba1cdba42b842df64 (127.12.148.67). New cstate: current_term: 1 leader_uuid: "99396916be07442ba1cdba42b842df64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99396916be07442ba1cdba42b842df64" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "796c02a5a31740a3b246b45119ade2ce" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 39255 } health_report { overall_health: UNKNOWN } } }
I20260808 04:40:11.347221 15432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:11.344096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52210 (local address 127.12.148.67:44549)
0808 04:40:11.344203 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:11.344206 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:11.344219 (+ 13us) server_negotiation.cc:407] Connection header received
0808 04:40:11.344396 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:11.344398 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:11.344460 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:11.344548 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:11.344742 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.345241 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.346035 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.346249 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.346325 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:11.346557 (+ 232us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:11.346938 (+ 381us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:11.347017 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:11.347067 (+ 50us) server_negotiation.cc:299] Negotiation successful
0808 04:40:11.347113 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 04:40:11.352461 14924 raft_consensus.cc:1261] T e336d888bf1242d5a6cb736bc177b6f3 P 890c3ecb47ee4cf38d746f327aa9fc54 [term 1 FOLLOWER]: Refusing update from remote peer 99396916be07442ba1cdba42b842df64: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:11.352777 15127 raft_consensus.cc:1261] T e336d888bf1242d5a6cb736bc177b6f3 P 796c02a5a31740a3b246b45119ade2ce [term 1 FOLLOWER]: Refusing update from remote peer 99396916be07442ba1cdba42b842df64: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:11.353129 15448 consensus_queue.cc:1035] T e336d888bf1242d5a6cb736bc177b6f3 P 99396916be07442ba1cdba42b842df64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:11.353374 15445 consensus_queue.cc:1035] T e336d888bf1242d5a6cb736bc177b6f3 P 99396916be07442ba1cdba42b842df64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "796c02a5a31740a3b246b45119ade2ce" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 39255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:11.359117 15451 mvcc.cc:205] Tried to move back new op lower bound from 7316127790493401088 to 7316127790302650368. Current Snapshot: MvccSnapshot[applied={T|T < 7316127790493401088}]
I20260808 04:40:11.360376 15452 mvcc.cc:205] Tried to move back new op lower bound from 7316127790493401088 to 7316127790302650368. Current Snapshot: MvccSnapshot[applied={T|T < 7316127790493401088}]
I20260808 04:40:11.370107 14686 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48116:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:11.370327 14686 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48116:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:11.372694 14686 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1fa24221de434845ba2ca3767460519d: Sending DeleteTablet for 3 replicas of tablet e336d888bf1242d5a6cb736bc177b6f3
I20260808 04:40:11.373589 15097 tablet_service.cc:1514] Processing DeleteTablet for tablet e336d888bf1242d5a6cb736bc177b6f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:11 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:57492
I20260808 04:40:11.373584 14877 tablet_service.cc:1514] Processing DeleteTablet for tablet e336d888bf1242d5a6cb736bc177b6f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:11 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:33890
I20260808 04:40:11.373605 15302 tablet_service.cc:1514] Processing DeleteTablet for tablet e336d888bf1242d5a6cb736bc177b6f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:11 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:52194
I20260808 04:40:11.374276 15466 tablet_replica.cc:330] T e336d888bf1242d5a6cb736bc177b6f3 P 890c3ecb47ee4cf38d746f327aa9fc54: stopping tablet replica
I20260808 04:40:11.374457 15468 tablet_replica.cc:330] T e336d888bf1242d5a6cb736bc177b6f3 P 796c02a5a31740a3b246b45119ade2ce: stopping tablet replica
I20260808 04:40:11.374708 15466 raft_consensus.cc:2229] T e336d888bf1242d5a6cb736bc177b6f3 P 890c3ecb47ee4cf38d746f327aa9fc54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:11.374886 15468 raft_consensus.cc:2229] T e336d888bf1242d5a6cb736bc177b6f3 P 796c02a5a31740a3b246b45119ade2ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:11.374961 15466 raft_consensus.cc:2258] T e336d888bf1242d5a6cb736bc177b6f3 P 890c3ecb47ee4cf38d746f327aa9fc54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:11.375324 15468 raft_consensus.cc:2258] T e336d888bf1242d5a6cb736bc177b6f3 P 796c02a5a31740a3b246b45119ade2ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:11.375712 15469 tablet_replica.cc:330] T e336d888bf1242d5a6cb736bc177b6f3 P 99396916be07442ba1cdba42b842df64: stopping tablet replica
I20260808 04:40:11.375996 15469 raft_consensus.cc:2229] T e336d888bf1242d5a6cb736bc177b6f3 P 99396916be07442ba1cdba42b842df64 [term 1 LEADER]: Raft consensus shutting down.
I20260808 04:40:11.376361 15469 raft_consensus.cc:2258] T e336d888bf1242d5a6cb736bc177b6f3 P 99396916be07442ba1cdba42b842df64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:11.376830 14686 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48116:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:40:11.377241 14686 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:40:11.377453 15468 ts_tablet_manager.cc:1905] T e336d888bf1242d5a6cb736bc177b6f3 P 796c02a5a31740a3b246b45119ade2ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:11.378010 15469 ts_tablet_manager.cc:1905] T e336d888bf1242d5a6cb736bc177b6f3 P 99396916be07442ba1cdba42b842df64: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:11.378496 15466 ts_tablet_manager.cc:1905] T e336d888bf1242d5a6cb736bc177b6f3 P 890c3ecb47ee4cf38d746f327aa9fc54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:11.380923 15468 ts_tablet_manager.cc:1918] T e336d888bf1242d5a6cb736bc177b6f3 P 796c02a5a31740a3b246b45119ade2ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:40:11.381016 15468 log.cc:1196] T e336d888bf1242d5a6cb736bc177b6f3 P 796c02a5a31740a3b246b45119ade2ce: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-1/wal/wals/e336d888bf1242d5a6cb736bc177b6f3
I20260808 04:40:11.381217 15468 ts_tablet_manager.cc:1939] T e336d888bf1242d5a6cb736bc177b6f3 P 796c02a5a31740a3b246b45119ade2ce: Deleting consensus metadata
I20260808 04:40:11.382081 15097 tablet_service.cc:1467] Processing CreateTablet for tablet 13e17d50269a48d187efa18f2de18fcd (DEFAULT_TABLE table=test-table [id=3a1219c317e5461db0a020cde28bc297]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:11.382320 15097 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13e17d50269a48d187efa18f2de18fcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:11.382503 14877 tablet_service.cc:1467] Processing CreateTablet for tablet 13e17d50269a48d187efa18f2de18fcd (DEFAULT_TABLE table=test-table [id=3a1219c317e5461db0a020cde28bc297]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:11.382687 14877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13e17d50269a48d187efa18f2de18fcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:11.383528 15466 ts_tablet_manager.cc:1918] T e336d888bf1242d5a6cb736bc177b6f3 P 890c3ecb47ee4cf38d746f327aa9fc54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:40:11.383616 15466 log.cc:1196] T e336d888bf1242d5a6cb736bc177b6f3 P 890c3ecb47ee4cf38d746f327aa9fc54: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-0/wal/wals/e336d888bf1242d5a6cb736bc177b6f3
I20260808 04:40:11.383882 15466 ts_tablet_manager.cc:1939] T e336d888bf1242d5a6cb736bc177b6f3 P 890c3ecb47ee4cf38d746f327aa9fc54: Deleting consensus metadata
I20260808 04:40:11.384305 15435 tablet_bootstrap.cc:492] T 13e17d50269a48d187efa18f2de18fcd P 796c02a5a31740a3b246b45119ade2ce: Bootstrap starting.
I20260808 04:40:11.384598 15302 tablet_service.cc:1467] Processing CreateTablet for tablet 13e17d50269a48d187efa18f2de18fcd (DEFAULT_TABLE table=test-table [id=3a1219c317e5461db0a020cde28bc297]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:11.384905 15302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13e17d50269a48d187efa18f2de18fcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:11.385228 15435 tablet_bootstrap.cc:654] T 13e17d50269a48d187efa18f2de18fcd P 796c02a5a31740a3b246b45119ade2ce: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:11.385703 14667 catalog_manager.cc:4841] TS 796c02a5a31740a3b246b45119ade2ce (127.12.148.66:39255): tablet e336d888bf1242d5a6cb736bc177b6f3 (table test-table [id=ae9cba3e60ee4d00ad483b1708ce267d]) successfully deleted
I20260808 04:40:11.386160 15434 tablet_bootstrap.cc:492] T 13e17d50269a48d187efa18f2de18fcd P 890c3ecb47ee4cf38d746f327aa9fc54: Bootstrap starting.
I20260808 04:40:11.387040 15434 tablet_bootstrap.cc:654] T 13e17d50269a48d187efa18f2de18fcd P 890c3ecb47ee4cf38d746f327aa9fc54: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:11.387166 15433 tablet_bootstrap.cc:492] T 13e17d50269a48d187efa18f2de18fcd P 99396916be07442ba1cdba42b842df64: Bootstrap starting.
I20260808 04:40:11.387557 14663 catalog_manager.cc:4841] TS 890c3ecb47ee4cf38d746f327aa9fc54 (127.12.148.65:39607): tablet e336d888bf1242d5a6cb736bc177b6f3 (table test-table [id=ae9cba3e60ee4d00ad483b1708ce267d]) successfully deleted
I20260808 04:40:11.388160 15433 tablet_bootstrap.cc:654] T 13e17d50269a48d187efa18f2de18fcd P 99396916be07442ba1cdba42b842df64: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:11.388927 15434 tablet_bootstrap.cc:492] T 13e17d50269a48d187efa18f2de18fcd P 890c3ecb47ee4cf38d746f327aa9fc54: No bootstrap required, opened a new log
I20260808 04:40:11.389030 15434 ts_tablet_manager.cc:1397] T 13e17d50269a48d187efa18f2de18fcd P 890c3ecb47ee4cf38d746f327aa9fc54: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 04:40:11.389338 15433 tablet_bootstrap.cc:492] T 13e17d50269a48d187efa18f2de18fcd P 99396916be07442ba1cdba42b842df64: No bootstrap required, opened a new log
I20260808 04:40:11.389432 15433 ts_tablet_manager.cc:1397] T 13e17d50269a48d187efa18f2de18fcd P 99396916be07442ba1cdba42b842df64: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 04:40:11.389771 15434 raft_consensus.cc:348] T 13e17d50269a48d187efa18f2de18fcd P 890c3ecb47ee4cf38d746f327aa9fc54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39607 } } peers { permanent_uuid: "796c02a5a31740a3b246b45119ade2ce" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 39255 } } peers { permanent_uuid: "99396916be07442ba1cdba42b842df64" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44549 } }
I20260808 04:40:11.389890 15434 raft_consensus.cc:374] T 13e17d50269a48d187efa18f2de18fcd P 890c3ecb47ee4cf38d746f327aa9fc54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:11.389879 15433 raft_consensus.cc:348] T 13e17d50269a48d187efa18f2de18fcd P 99396916be07442ba1cdba42b842df64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39607 } } peers { permanent_uuid: "796c02a5a31740a3b246b45119ade2ce" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 39255 } } peers { permanent_uuid: "99396916be07442ba1cdba42b842df64" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44549 } }
I20260808 04:40:11.389927 15434 raft_consensus.cc:729] T 13e17d50269a48d187efa18f2de18fcd P 890c3ecb47ee4cf38d746f327aa9fc54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 890c3ecb47ee4cf38d746f327aa9fc54, State: Initialized, Role: FOLLOWER
I20260808 04:40:11.389982 15433 raft_consensus.cc:374] T 13e17d50269a48d187efa18f2de18fcd P 99396916be07442ba1cdba42b842df64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:11.390017 15433 raft_consensus.cc:729] T 13e17d50269a48d187efa18f2de18fcd P 99396916be07442ba1cdba42b842df64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99396916be07442ba1cdba42b842df64, State: Initialized, Role: FOLLOWER
I20260808 04:40:11.390064 15434 consensus_queue.cc:260] T 13e17d50269a48d187efa18f2de18fcd P 890c3ecb47ee4cf38d746f327aa9fc54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39607 } } peers { permanent_uuid: "796c02a5a31740a3b246b45119ade2ce" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 39255 } } peers { permanent_uuid: "99396916be07442ba1cdba42b842df64" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44549 } }
I20260808 04:40:11.390129 15433 consensus_queue.cc:260] T 13e17d50269a48d187efa18f2de18fcd P 99396916be07442ba1cdba42b842df64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39607 } } peers { permanent_uuid: "796c02a5a31740a3b246b45119ade2ce" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 39255 } } peers { permanent_uuid: "99396916be07442ba1cdba42b842df64" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44549 } }
I20260808 04:40:11.390331 15434 ts_tablet_manager.cc:1428] T 13e17d50269a48d187efa18f2de18fcd P 890c3ecb47ee4cf38d746f327aa9fc54: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 04:40:11.390376 15433 ts_tablet_manager.cc:1428] T 13e17d50269a48d187efa18f2de18fcd P 99396916be07442ba1cdba42b842df64: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 04:40:11.390566 15469 ts_tablet_manager.cc:1918] T e336d888bf1242d5a6cb736bc177b6f3 P 99396916be07442ba1cdba42b842df64: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:40:11.390748 15469 log.cc:1196] T e336d888bf1242d5a6cb736bc177b6f3 P 99396916be07442ba1cdba42b842df64: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-2/wal/wals/e336d888bf1242d5a6cb736bc177b6f3
I20260808 04:40:11.391170 15469 ts_tablet_manager.cc:1939] T e336d888bf1242d5a6cb736bc177b6f3 P 99396916be07442ba1cdba42b842df64: Deleting consensus metadata
I20260808 04:40:11.392280 14663 catalog_manager.cc:4841] TS 99396916be07442ba1cdba42b842df64 (127.12.148.67:44549): tablet e336d888bf1242d5a6cb736bc177b6f3 (table test-table [id=ae9cba3e60ee4d00ad483b1708ce267d]) successfully deleted
I20260808 04:40:11.392931 15435 tablet_bootstrap.cc:492] T 13e17d50269a48d187efa18f2de18fcd P 796c02a5a31740a3b246b45119ade2ce: No bootstrap required, opened a new log
I20260808 04:40:11.393025 15435 ts_tablet_manager.cc:1397] T 13e17d50269a48d187efa18f2de18fcd P 796c02a5a31740a3b246b45119ade2ce: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260808 04:40:11.393456 15435 raft_consensus.cc:348] T 13e17d50269a48d187efa18f2de18fcd P 796c02a5a31740a3b246b45119ade2ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39607 } } peers { permanent_uuid: "796c02a5a31740a3b246b45119ade2ce" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 39255 } } peers { permanent_uuid: "99396916be07442ba1cdba42b842df64" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44549 } }
I20260808 04:40:11.393570 15435 raft_consensus.cc:374] T 13e17d50269a48d187efa18f2de18fcd P 796c02a5a31740a3b246b45119ade2ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:11.393602 15435 raft_consensus.cc:729] T 13e17d50269a48d187efa18f2de18fcd P 796c02a5a31740a3b246b45119ade2ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 796c02a5a31740a3b246b45119ade2ce, State: Initialized, Role: FOLLOWER
I20260808 04:40:11.393736 15435 consensus_queue.cc:260] T 13e17d50269a48d187efa18f2de18fcd P 796c02a5a31740a3b246b45119ade2ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39607 } } peers { permanent_uuid: "796c02a5a31740a3b246b45119ade2ce" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 39255 } } peers { permanent_uuid: "99396916be07442ba1cdba42b842df64" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44549 } }
I20260808 04:40:11.393963 15435 ts_tablet_manager.cc:1428] T 13e17d50269a48d187efa18f2de18fcd P 796c02a5a31740a3b246b45119ade2ce: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20260808 04:40:11.420212 15194 tablet.cc:2369] T 13e17d50269a48d187efa18f2de18fcd P 796c02a5a31740a3b246b45119ade2ce: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:40:11.625439 15446 raft_consensus.cc:482] T 13e17d50269a48d187efa18f2de18fcd P 890c3ecb47ee4cf38d746f327aa9fc54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:40:11.625595 15446 raft_consensus.cc:504] T 13e17d50269a48d187efa18f2de18fcd P 890c3ecb47ee4cf38d746f327aa9fc54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39607 } } peers { permanent_uuid: "796c02a5a31740a3b246b45119ade2ce" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 39255 } } peers { permanent_uuid: "99396916be07442ba1cdba42b842df64" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44549 } }
I20260808 04:40:11.626693 15446 leader_election.cc:288] T 13e17d50269a48d187efa18f2de18fcd P 890c3ecb47ee4cf38d746f327aa9fc54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 796c02a5a31740a3b246b45119ade2ce (127.12.148.66:39255), 99396916be07442ba1cdba42b842df64 (127.12.148.67:44549)
W20260808 04:40:11.628182 15397 tablet.cc:2369] T 13e17d50269a48d187efa18f2de18fcd P 99396916be07442ba1cdba42b842df64: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:40:11.631369 15430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:11.627021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:60341 (local address 127.12.148.66:39255)
0808 04:40:11.627149 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:11.627153 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:11.627342 (+ 189us) server_negotiation.cc:407] Connection header received
0808 04:40:11.627481 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:11.627484 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:11.627528 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:11.627590 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:11.627882 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.628452 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.630124 (+ 1672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.630736 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.630890 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:11.630933 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:11.631162 (+ 229us) server_negotiation.cc:299] Negotiation successful
0808 04:40:11.631238 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 04:40:11.631369 15432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:11.627072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:56765 (local address 127.12.148.67:44549)
0808 04:40:11.627196 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:11.627200 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:11.627379 (+ 179us) server_negotiation.cc:407] Connection header received
0808 04:40:11.627483 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:11.627486 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:11.627528 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:11.627591 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:11.627905 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.628552 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.630124 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.630736 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.630869 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:11.630927 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:11.631162 (+ 235us) server_negotiation.cc:299] Negotiation successful
0808 04:40:11.631238 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 04:40:11.631409 15478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:11.626929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:39255 (local address 127.12.148.65:60341)
0808 04:40:11.627248 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:11.627260 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:11.627368 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:11.627613 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:11.627616 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:11.627665 (+ 49us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:11.627779 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:11.627783 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.628555 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.628558 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:11.629995 (+ 1437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:11.630007 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.630870 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.630874 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:11.631002 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:11.631074 (+ 72us) client_negotiation.cc:769] Sending connection context
0808 04:40:11.631139 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 04:40:11.631229 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"mutex_wait_us":84,"thread_start_us":84,"threads_started":1}
I20260808 04:40:11.631423 15477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:11.626959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.67:44549 (local address 127.12.148.65:56765)
0808 04:40:11.627279 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:11.627291 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:11.627393 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:11.627608 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:11.627611 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:11.627626 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:11.627800 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:11.627806 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.628655 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.628659 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:11.629995 (+ 1336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:11.630007 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.630870 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.630874 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:11.630998 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:11.631063 (+ 65us) client_negotiation.cc:769] Sending connection context
0808 04:40:11.631139 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 04:40:11.631229 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"mutex_wait_us":120,"spinlock_wait_cycles":59136,"thread_start_us":102,"threads_started":1}
I20260808 04:40:11.631991 15127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13e17d50269a48d187efa18f2de18fcd" candidate_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "796c02a5a31740a3b246b45119ade2ce" is_pre_election: true
I20260808 04:40:11.632166 15127 raft_consensus.cc:2454] T 13e17d50269a48d187efa18f2de18fcd P 796c02a5a31740a3b246b45119ade2ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 890c3ecb47ee4cf38d746f327aa9fc54 in term 0.
I20260808 04:40:11.632133 15334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13e17d50269a48d187efa18f2de18fcd" candidate_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99396916be07442ba1cdba42b842df64" is_pre_election: true
I20260808 04:40:11.632361 15334 raft_consensus.cc:2454] T 13e17d50269a48d187efa18f2de18fcd P 99396916be07442ba1cdba42b842df64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 890c3ecb47ee4cf38d746f327aa9fc54 in term 0.
I20260808 04:40:11.632522 14831 leader_election.cc:302] T 13e17d50269a48d187efa18f2de18fcd P 890c3ecb47ee4cf38d746f327aa9fc54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 796c02a5a31740a3b246b45119ade2ce, 890c3ecb47ee4cf38d746f327aa9fc54; no voters:
I20260808 04:40:11.632781 15446 raft_consensus.cc:2781] T 13e17d50269a48d187efa18f2de18fcd P 890c3ecb47ee4cf38d746f327aa9fc54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:40:11.632844 15446 raft_consensus.cc:482] T 13e17d50269a48d187efa18f2de18fcd P 890c3ecb47ee4cf38d746f327aa9fc54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:40:11.632890 15446 raft_consensus.cc:3037] T 13e17d50269a48d187efa18f2de18fcd P 890c3ecb47ee4cf38d746f327aa9fc54 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:11.633909 15446 raft_consensus.cc:504] T 13e17d50269a48d187efa18f2de18fcd P 890c3ecb47ee4cf38d746f327aa9fc54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39607 } } peers { permanent_uuid: "796c02a5a31740a3b246b45119ade2ce" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 39255 } } peers { permanent_uuid: "99396916be07442ba1cdba42b842df64" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44549 } }
I20260808 04:40:11.634236 15446 leader_election.cc:288] T 13e17d50269a48d187efa18f2de18fcd P 890c3ecb47ee4cf38d746f327aa9fc54 [CANDIDATE]: Term 1 election: Requested vote from peers 796c02a5a31740a3b246b45119ade2ce (127.12.148.66:39255), 99396916be07442ba1cdba42b842df64 (127.12.148.67:44549)
I20260808 04:40:11.634542 15127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13e17d50269a48d187efa18f2de18fcd" candidate_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "796c02a5a31740a3b246b45119ade2ce"
I20260808 04:40:11.634644 15334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13e17d50269a48d187efa18f2de18fcd" candidate_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99396916be07442ba1cdba42b842df64"
I20260808 04:40:11.634670 15127 raft_consensus.cc:3037] T 13e17d50269a48d187efa18f2de18fcd P 796c02a5a31740a3b246b45119ade2ce [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:11.634756 15334 raft_consensus.cc:3037] T 13e17d50269a48d187efa18f2de18fcd P 99396916be07442ba1cdba42b842df64 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:11.635581 15127 raft_consensus.cc:2454] T 13e17d50269a48d187efa18f2de18fcd P 796c02a5a31740a3b246b45119ade2ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 890c3ecb47ee4cf38d746f327aa9fc54 in term 1.
I20260808 04:40:11.635668 15334 raft_consensus.cc:2454] T 13e17d50269a48d187efa18f2de18fcd P 99396916be07442ba1cdba42b842df64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 890c3ecb47ee4cf38d746f327aa9fc54 in term 1.
I20260808 04:40:11.635842 14831 leader_election.cc:302] T 13e17d50269a48d187efa18f2de18fcd P 890c3ecb47ee4cf38d746f327aa9fc54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 796c02a5a31740a3b246b45119ade2ce, 890c3ecb47ee4cf38d746f327aa9fc54; no voters:
I20260808 04:40:11.636020 15446 raft_consensus.cc:2781] T 13e17d50269a48d187efa18f2de18fcd P 890c3ecb47ee4cf38d746f327aa9fc54 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:11.636235 15446 raft_consensus.cc:686] T 13e17d50269a48d187efa18f2de18fcd P 890c3ecb47ee4cf38d746f327aa9fc54 [term 1 LEADER]: Becoming Leader. State: Replica: 890c3ecb47ee4cf38d746f327aa9fc54, State: Running, Role: LEADER
I20260808 04:40:11.636478 15446 consensus_queue.cc:237] T 13e17d50269a48d187efa18f2de18fcd P 890c3ecb47ee4cf38d746f327aa9fc54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39607 } } peers { permanent_uuid: "796c02a5a31740a3b246b45119ade2ce" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 39255 } } peers { permanent_uuid: "99396916be07442ba1cdba42b842df64" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44549 } }
I20260808 04:40:11.638810 14686 catalog_manager.cc:5495] T 13e17d50269a48d187efa18f2de18fcd P 890c3ecb47ee4cf38d746f327aa9fc54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 890c3ecb47ee4cf38d746f327aa9fc54 (127.12.148.65). New cstate: current_term: 1 leader_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "796c02a5a31740a3b246b45119ade2ce" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 39255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99396916be07442ba1cdba42b842df64" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44549 } health_report { overall_health: UNKNOWN } } }
Aug 08 04:40:11 dist-test-slave-t7g5 krb5kdc[14612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164010, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:40:11.711104 15490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:11.703330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48126 (local address 127.12.148.126:35947)
0808 04:40:11.703529 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:11.703534 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:11.703636 (+ 102us) server_negotiation.cc:407] Connection header received
0808 04:40:11.703772 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:11.703775 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:11.703815 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:11.703889 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:11.704556 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.705090 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.705880 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.706114 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.706200 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:11.708335 (+ 2135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:11.708338 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:11.708340 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:11.708360 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:11.709428 (+ 1068us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:11.709909 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:11.709913 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:11.709915 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:11.710004 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:11.710246 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:11.710249 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:11.710251 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:11.710422 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:11.710509 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:11.710793 (+ 284us) server_negotiation.cc:299] Negotiation successful
0808 04:40:11.710967 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":99,"server-negotiator.queue_time_us":152,"thread_start_us":79,"threads_started":1}
I20260808 04:40:11.711104 15488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:11.703276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:35947 (local address 127.0.0.1:48126)
0808 04:40:11.703553 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:11.703568 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:11.703689 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:11.703917 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:11.703919 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:11.704345 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:11.704436 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:11.704452 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.705186 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.705189 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:11.705776 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:11.705785 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.706212 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.706215 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:11.706323 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:11.706818 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:11.706829 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:11.708205 (+ 1376us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:11.709527 (+ 1322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:11.709536 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:11.709543 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:11.709824 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:11.710084 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:11.710087 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:11.710090 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:11.710172 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:11.710523 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:11.710530 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:11.710639 (+ 109us) client_negotiation.cc:769] Sending connection context
0808 04:40:11.710734 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 04:40:11.710901 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"mutex_wait_us":3,"thread_start_us":84,"threads_started":1}
I20260808 04:40:11.715660 14686 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:48126:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 04:40:11.716377 14686 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:40:11.721069 14877 tablet_service.cc:1467] Processing CreateTablet for tablet 4dfac3e1c30c44b6b37e3a75b0bd47b5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8069a9881a6b42758cbcce10fccc1d7d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 04:40:11.721195 15097 tablet_service.cc:1467] Processing CreateTablet for tablet 4dfac3e1c30c44b6b37e3a75b0bd47b5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8069a9881a6b42758cbcce10fccc1d7d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 04:40:11.721481 14877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4dfac3e1c30c44b6b37e3a75b0bd47b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:11.721551 15097 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4dfac3e1c30c44b6b37e3a75b0bd47b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:11.724586 15435 tablet_bootstrap.cc:492] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 796c02a5a31740a3b246b45119ade2ce: Bootstrap starting.
I20260808 04:40:11.725325 15435 tablet_bootstrap.cc:654] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 796c02a5a31740a3b246b45119ade2ce: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:11.726454 15435 tablet_bootstrap.cc:492] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 796c02a5a31740a3b246b45119ade2ce: No bootstrap required, opened a new log
I20260808 04:40:11.726542 15435 ts_tablet_manager.cc:1397] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 796c02a5a31740a3b246b45119ade2ce: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 04:40:11.726984 15435 raft_consensus.cc:348] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 796c02a5a31740a3b246b45119ade2ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39607 } } peers { permanent_uuid: "796c02a5a31740a3b246b45119ade2ce" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 39255 } } peers { permanent_uuid: "99396916be07442ba1cdba42b842df64" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44549 } }
I20260808 04:40:11.727102 15435 raft_consensus.cc:374] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 796c02a5a31740a3b246b45119ade2ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:11.727136 15435 raft_consensus.cc:729] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 796c02a5a31740a3b246b45119ade2ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 796c02a5a31740a3b246b45119ade2ce, State: Initialized, Role: FOLLOWER
I20260808 04:40:11.727172 15434 tablet_bootstrap.cc:492] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 890c3ecb47ee4cf38d746f327aa9fc54: Bootstrap starting.
I20260808 04:40:11.727131 15302 tablet_service.cc:1467] Processing CreateTablet for tablet 4dfac3e1c30c44b6b37e3a75b0bd47b5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8069a9881a6b42758cbcce10fccc1d7d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 04:40:11.727252 15435 consensus_queue.cc:260] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 796c02a5a31740a3b246b45119ade2ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39607 } } peers { permanent_uuid: "796c02a5a31740a3b246b45119ade2ce" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 39255 } } peers { permanent_uuid: "99396916be07442ba1cdba42b842df64" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44549 } }
I20260808 04:40:11.727494 15435 ts_tablet_manager.cc:1428] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 796c02a5a31740a3b246b45119ade2ce: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 04:40:11.727525 15302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4dfac3e1c30c44b6b37e3a75b0bd47b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:11.727774 15444 tablet_replica.cc:439] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 796c02a5a31740a3b246b45119ade2ce: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39607 } } peers { permanent_uuid: "796c02a5a31740a3b246b45119ade2ce" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 39255 } } peers { permanent_uuid: "99396916be07442ba1cdba42b842df64" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44549 } } }
I20260808 04:40:11.727923 15444 tablet_replica.cc:442] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 796c02a5a31740a3b246b45119ade2ce: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 04:40:11.727993 15434 tablet_bootstrap.cc:654] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 890c3ecb47ee4cf38d746f327aa9fc54: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:11.729265 15434 tablet_bootstrap.cc:492] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 890c3ecb47ee4cf38d746f327aa9fc54: No bootstrap required, opened a new log
I20260808 04:40:11.729337 15434 ts_tablet_manager.cc:1397] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 890c3ecb47ee4cf38d746f327aa9fc54: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 04:40:11.729748 15434 raft_consensus.cc:348] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 890c3ecb47ee4cf38d746f327aa9fc54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39607 } } peers { permanent_uuid: "796c02a5a31740a3b246b45119ade2ce" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 39255 } } peers { permanent_uuid: "99396916be07442ba1cdba42b842df64" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44549 } }
I20260808 04:40:11.729862 15434 raft_consensus.cc:374] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 890c3ecb47ee4cf38d746f327aa9fc54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:11.729890 15434 raft_consensus.cc:729] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 890c3ecb47ee4cf38d746f327aa9fc54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 890c3ecb47ee4cf38d746f327aa9fc54, State: Initialized, Role: FOLLOWER
I20260808 04:40:11.729993 15434 consensus_queue.cc:260] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 890c3ecb47ee4cf38d746f327aa9fc54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39607 } } peers { permanent_uuid: "796c02a5a31740a3b246b45119ade2ce" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 39255 } } peers { permanent_uuid: "99396916be07442ba1cdba42b842df64" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44549 } }
I20260808 04:40:11.730191 15433 tablet_bootstrap.cc:492] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 99396916be07442ba1cdba42b842df64: Bootstrap starting.
I20260808 04:40:11.730257 15434 ts_tablet_manager.cc:1428] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 890c3ecb47ee4cf38d746f327aa9fc54: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 04:40:11.730486 15446 tablet_replica.cc:439] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 890c3ecb47ee4cf38d746f327aa9fc54: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39607 } } peers { permanent_uuid: "796c02a5a31740a3b246b45119ade2ce" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 39255 } } peers { permanent_uuid: "99396916be07442ba1cdba42b842df64" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44549 } } }
I20260808 04:40:11.730614 15446 tablet_replica.cc:442] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 890c3ecb47ee4cf38d746f327aa9fc54: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 04:40:11.730994 15433 tablet_bootstrap.cc:654] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 99396916be07442ba1cdba42b842df64: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:11.732065 15433 tablet_bootstrap.cc:492] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 99396916be07442ba1cdba42b842df64: No bootstrap required, opened a new log
I20260808 04:40:11.732156 15433 ts_tablet_manager.cc:1397] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 99396916be07442ba1cdba42b842df64: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 04:40:11.732555 15433 raft_consensus.cc:348] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 99396916be07442ba1cdba42b842df64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39607 } } peers { permanent_uuid: "796c02a5a31740a3b246b45119ade2ce" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 39255 } } peers { permanent_uuid: "99396916be07442ba1cdba42b842df64" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44549 } }
I20260808 04:40:11.732645 15433 raft_consensus.cc:374] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 99396916be07442ba1cdba42b842df64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:11.732666 15433 raft_consensus.cc:729] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 99396916be07442ba1cdba42b842df64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99396916be07442ba1cdba42b842df64, State: Initialized, Role: FOLLOWER
I20260808 04:40:11.732765 15433 consensus_queue.cc:260] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 99396916be07442ba1cdba42b842df64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39607 } } peers { permanent_uuid: "796c02a5a31740a3b246b45119ade2ce" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 39255 } } peers { permanent_uuid: "99396916be07442ba1cdba42b842df64" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44549 } }
I20260808 04:40:11.733023 15433 ts_tablet_manager.cc:1428] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 99396916be07442ba1cdba42b842df64: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 04:40:11.733213 15445 tablet_replica.cc:439] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 99396916be07442ba1cdba42b842df64: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39607 } } peers { permanent_uuid: "796c02a5a31740a3b246b45119ade2ce" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 39255 } } peers { permanent_uuid: "99396916be07442ba1cdba42b842df64" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44549 } } }
I20260808 04:40:11.733345 15445 tablet_replica.cc:442] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 99396916be07442ba1cdba42b842df64: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 04:40:11.894550 15445 raft_consensus.cc:482] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 99396916be07442ba1cdba42b842df64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:40:11.894685 15445 raft_consensus.cc:504] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 99396916be07442ba1cdba42b842df64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39607 } } peers { permanent_uuid: "796c02a5a31740a3b246b45119ade2ce" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 39255 } } peers { permanent_uuid: "99396916be07442ba1cdba42b842df64" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44549 } }
I20260808 04:40:11.895102 15445 leader_election.cc:288] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 99396916be07442ba1cdba42b842df64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 890c3ecb47ee4cf38d746f327aa9fc54 (127.12.148.65:39607), 796c02a5a31740a3b246b45119ade2ce (127.12.148.66:39255)
I20260808 04:40:11.895577 14924 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4dfac3e1c30c44b6b37e3a75b0bd47b5" candidate_uuid: "99396916be07442ba1cdba42b842df64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" is_pre_election: true
I20260808 04:40:11.895573 15127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4dfac3e1c30c44b6b37e3a75b0bd47b5" candidate_uuid: "99396916be07442ba1cdba42b842df64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "796c02a5a31740a3b246b45119ade2ce" is_pre_election: true
I20260808 04:40:11.895718 14924 raft_consensus.cc:2454] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 890c3ecb47ee4cf38d746f327aa9fc54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99396916be07442ba1cdba42b842df64 in term 0.
I20260808 04:40:11.895730 15127 raft_consensus.cc:2454] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 796c02a5a31740a3b246b45119ade2ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99396916be07442ba1cdba42b842df64 in term 0.
I20260808 04:40:11.896005 15233 leader_election.cc:302] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 99396916be07442ba1cdba42b842df64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 796c02a5a31740a3b246b45119ade2ce, 99396916be07442ba1cdba42b842df64; no voters:
I20260808 04:40:11.896165 15445 raft_consensus.cc:2781] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 99396916be07442ba1cdba42b842df64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:40:11.896229 15445 raft_consensus.cc:482] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 99396916be07442ba1cdba42b842df64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:40:11.896262 15445 raft_consensus.cc:3037] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 99396916be07442ba1cdba42b842df64 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:11.897194 15445 raft_consensus.cc:504] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 99396916be07442ba1cdba42b842df64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39607 } } peers { permanent_uuid: "796c02a5a31740a3b246b45119ade2ce" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 39255 } } peers { permanent_uuid: "99396916be07442ba1cdba42b842df64" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44549 } }
I20260808 04:40:11.897483 15445 leader_election.cc:288] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 99396916be07442ba1cdba42b842df64 [CANDIDATE]: Term 1 election: Requested vote from peers 890c3ecb47ee4cf38d746f327aa9fc54 (127.12.148.65:39607), 796c02a5a31740a3b246b45119ade2ce (127.12.148.66:39255)
I20260808 04:40:11.897780 14924 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4dfac3e1c30c44b6b37e3a75b0bd47b5" candidate_uuid: "99396916be07442ba1cdba42b842df64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "890c3ecb47ee4cf38d746f327aa9fc54"
I20260808 04:40:11.897897 14924 raft_consensus.cc:3037] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 890c3ecb47ee4cf38d746f327aa9fc54 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:11.897895 15127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4dfac3e1c30c44b6b37e3a75b0bd47b5" candidate_uuid: "99396916be07442ba1cdba42b842df64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "796c02a5a31740a3b246b45119ade2ce"
I20260808 04:40:11.898002 15127 raft_consensus.cc:3037] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 796c02a5a31740a3b246b45119ade2ce [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:11.898785 14924 raft_consensus.cc:2454] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 890c3ecb47ee4cf38d746f327aa9fc54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99396916be07442ba1cdba42b842df64 in term 1.
I20260808 04:40:11.898833 15127 raft_consensus.cc:2454] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 796c02a5a31740a3b246b45119ade2ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99396916be07442ba1cdba42b842df64 in term 1.
I20260808 04:40:11.899044 15229 leader_election.cc:302] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 99396916be07442ba1cdba42b842df64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 890c3ecb47ee4cf38d746f327aa9fc54, 99396916be07442ba1cdba42b842df64; no voters:
I20260808 04:40:11.899207 15445 raft_consensus.cc:2781] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 99396916be07442ba1cdba42b842df64 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:11.899359 15445 raft_consensus.cc:686] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 99396916be07442ba1cdba42b842df64 [term 1 LEADER]: Becoming Leader. State: Replica: 99396916be07442ba1cdba42b842df64, State: Running, Role: LEADER
I20260808 04:40:11.899502 15445 consensus_queue.cc:237] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 99396916be07442ba1cdba42b842df64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39607 } } peers { permanent_uuid: "796c02a5a31740a3b246b45119ade2ce" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 39255 } } peers { permanent_uuid: "99396916be07442ba1cdba42b842df64" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44549 } }
I20260808 04:40:11.900069 15496 tablet_replica.cc:439] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 99396916be07442ba1cdba42b842df64: TxnStatusTablet state changed. Reason: New leader 99396916be07442ba1cdba42b842df64. Latest consensus state: current_term: 1 leader_uuid: "99396916be07442ba1cdba42b842df64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39607 } } peers { permanent_uuid: "796c02a5a31740a3b246b45119ade2ce" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 39255 } } peers { permanent_uuid: "99396916be07442ba1cdba42b842df64" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44549 } } }
I20260808 04:40:11.900179 15496 tablet_replica.cc:442] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 99396916be07442ba1cdba42b842df64: This TxnStatusTablet replica's current role is: LEADER
I20260808 04:40:11.900471 15499 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 04:40:11.900691 15499 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 04:40:11.901075 14686 catalog_manager.cc:5495] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 99396916be07442ba1cdba42b842df64 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99396916be07442ba1cdba42b842df64 (127.12.148.67). New cstate: current_term: 1 leader_uuid: "99396916be07442ba1cdba42b842df64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "796c02a5a31740a3b246b45119ade2ce" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 39255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99396916be07442ba1cdba42b842df64" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44549 } health_report { overall_health: HEALTHY } } }
I20260808 04:40:11.917140 15432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:11.914117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52220 (local address 127.12.148.67:44549)
0808 04:40:11.914236 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:11.914240 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:11.914254 (+ 14us) server_negotiation.cc:407] Connection header received
0808 04:40:11.914428 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:11.914431 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:11.914479 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:11.914540 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:11.914772 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.915294 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.916132 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.916346 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.916431 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:11.916703 (+ 272us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:11.916773 (+ 70us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:11.916831 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:11.916952 (+ 121us) server_negotiation.cc:299] Negotiation successful
0808 04:40:11.917002 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 04:40:11.917140 15488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:11.914049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.67:44549 (local address 127.0.0.1:52220)
0808 04:40:11.914197 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:11.914213 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:11.914318 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:11.914570 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:11.914573 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:11.914580 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 04:40:11.914676 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:11.914681 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.915398 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.915401 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:11.916020 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:11.916029 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.916450 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.916454 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:11.916535 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:11.916579 (+ 44us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 04:40:11.916853 (+ 274us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 04:40:11.916868 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 04:40:11.916925 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 04:40:11.917017 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 04:40:11.920068 15127 raft_consensus.cc:1261] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 796c02a5a31740a3b246b45119ade2ce [term 1 FOLLOWER]: Refusing update from remote peer 99396916be07442ba1cdba42b842df64: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:11.920468 15496 consensus_queue.cc:1035] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 99396916be07442ba1cdba42b842df64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "796c02a5a31740a3b246b45119ade2ce" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 39255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:11.920579 14924 raft_consensus.cc:1261] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 890c3ecb47ee4cf38d746f327aa9fc54 [term 1 FOLLOWER]: Refusing update from remote peer 99396916be07442ba1cdba42b842df64: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:11.920985 15496 consensus_queue.cc:1035] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 99396916be07442ba1cdba42b842df64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:11.922212 15444 tablet_replica.cc:439] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 796c02a5a31740a3b246b45119ade2ce: TxnStatusTablet state changed. Reason: New leader 99396916be07442ba1cdba42b842df64. Latest consensus state: current_term: 1 leader_uuid: "99396916be07442ba1cdba42b842df64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39607 } } peers { permanent_uuid: "796c02a5a31740a3b246b45119ade2ce" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 39255 } } peers { permanent_uuid: "99396916be07442ba1cdba42b842df64" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44549 } } }
I20260808 04:40:11.922330 15444 tablet_replica.cc:442] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 796c02a5a31740a3b246b45119ade2ce: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 04:40:11.922322 15446 tablet_replica.cc:439] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 890c3ecb47ee4cf38d746f327aa9fc54: TxnStatusTablet state changed. Reason: New leader 99396916be07442ba1cdba42b842df64. Latest consensus state: current_term: 1 leader_uuid: "99396916be07442ba1cdba42b842df64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39607 } } peers { permanent_uuid: "796c02a5a31740a3b246b45119ade2ce" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 39255 } } peers { permanent_uuid: "99396916be07442ba1cdba42b842df64" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44549 } } }
I20260808 04:40:11.922461 15446 tablet_replica.cc:442] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 890c3ecb47ee4cf38d746f327aa9fc54: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 04:40:11.924362 15496 tablet_replica.cc:439] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 99396916be07442ba1cdba42b842df64: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "99396916be07442ba1cdba42b842df64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39607 } } peers { permanent_uuid: "796c02a5a31740a3b246b45119ade2ce" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 39255 } } peers { permanent_uuid: "99396916be07442ba1cdba42b842df64" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44549 } } }
I20260808 04:40:11.924475 15496 tablet_replica.cc:442] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 99396916be07442ba1cdba42b842df64: This TxnStatusTablet replica's current role is: LEADER
I20260808 04:40:11.924983 15446 tablet_replica.cc:439] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 890c3ecb47ee4cf38d746f327aa9fc54: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "99396916be07442ba1cdba42b842df64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39607 } } peers { permanent_uuid: "796c02a5a31740a3b246b45119ade2ce" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 39255 } } peers { permanent_uuid: "99396916be07442ba1cdba42b842df64" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44549 } } }
I20260808 04:40:11.925092 15446 tablet_replica.cc:442] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 890c3ecb47ee4cf38d746f327aa9fc54: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 04:40:11.925698 15504 mvcc.cc:205] Tried to move back new op lower bound from 7316127792820629504 to 7316127792741568512. Current Snapshot: MvccSnapshot[applied={T|T < 7316127792820629504}]
I20260808 04:40:11.926710 15445 tablet_replica.cc:439] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 99396916be07442ba1cdba42b842df64: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "99396916be07442ba1cdba42b842df64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39607 } } peers { permanent_uuid: "796c02a5a31740a3b246b45119ade2ce" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 39255 } } peers { permanent_uuid: "99396916be07442ba1cdba42b842df64" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44549 } } }
I20260808 04:40:11.926811 15445 tablet_replica.cc:442] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 99396916be07442ba1cdba42b842df64: This TxnStatusTablet replica's current role is: LEADER
I20260808 04:40:11.927700 15444 tablet_replica.cc:439] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 796c02a5a31740a3b246b45119ade2ce: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "99396916be07442ba1cdba42b842df64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890c3ecb47ee4cf38d746f327aa9fc54" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39607 } } peers { permanent_uuid: "796c02a5a31740a3b246b45119ade2ce" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 39255 } } peers { permanent_uuid: "99396916be07442ba1cdba42b842df64" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44549 } } }
I20260808 04:40:11.927796 15444 tablet_replica.cc:442] T 4dfac3e1c30c44b6b37e3a75b0bd47b5 P 796c02a5a31740a3b246b45119ade2ce: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 04:40:11.935192 15516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:11.931605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33892 (local address 127.12.148.65:39607)
0808 04:40:11.931826 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:11.931831 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:11.931843 (+ 12us) server_negotiation.cc:407] Connection header received
0808 04:40:11.931911 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:11.931913 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:11.931963 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:11.932085 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:11.932323 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.932845 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.933699 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.933944 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.934035 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:11.934308 (+ 273us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:11.934724 (+ 416us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:11.934826 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:11.934904 (+ 78us) server_negotiation.cc:299] Negotiation successful
0808 04:40:11.934956 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":81,"threads_started":1}
I20260808 04:40:11.946892 15432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:11.943714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:50631 (local address 127.12.148.67:44549)
0808 04:40:11.943820 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:11.943825 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:11.943994 (+ 169us) server_negotiation.cc:407] Connection header received
0808 04:40:11.944104 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:11.944107 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:11.944155 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:11.944213 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:11.944450 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.944921 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.945892 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.946116 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.946202 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:11.946489 (+ 287us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:11.946553 (+ 64us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:11.946610 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:11.946707 (+ 97us) server_negotiation.cc:299] Negotiation successful
0808 04:40:11.946758 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 04:40:11.946909 15520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:11.943641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.67:44549 (local address 127.12.148.65:50631)
0808 04:40:11.943910 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:11.943922 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:11.944025 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:11.944229 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:11.944231 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:11.944239 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 04:40:11.944350 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:11.944355 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.945021 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.945024 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:11.945783 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:11.945793 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.946221 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.946224 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:11.946316 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:11.946358 (+ 42us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 04:40:11.946635 (+ 277us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 04:40:11.946641 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 04:40:11.946697 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 04:40:11.946775 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":94,"threads_started":1}
I20260808 04:40:11.954823 15127 raft_consensus.cc:1261] T 13e17d50269a48d187efa18f2de18fcd P 796c02a5a31740a3b246b45119ade2ce [term 1 FOLLOWER]: Refusing update from remote peer 890c3ecb47ee4cf38d746f327aa9fc54: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:11.955058 15334 raft_consensus.cc:1261] T 13e17d50269a48d187efa18f2de18fcd P 99396916be07442ba1cdba42b842df64 [term 1 FOLLOWER]: Refusing update from remote peer 890c3ecb47ee4cf38d746f327aa9fc54: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:11.955375 15479 consensus_queue.cc:1035] T 13e17d50269a48d187efa18f2de18fcd P 890c3ecb47ee4cf38d746f327aa9fc54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "796c02a5a31740a3b246b45119ade2ce" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 39255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:11.955556 15446 consensus_queue.cc:1035] T 13e17d50269a48d187efa18f2de18fcd P 890c3ecb47ee4cf38d746f327aa9fc54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99396916be07442ba1cdba42b842df64" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:11.978081 15516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:11.974198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:51327 (local address 127.12.148.65:39607)
0808 04:40:11.974324 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:11.974328 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:11.974628 (+ 300us) server_negotiation.cc:407] Connection header received
0808 04:40:11.974790 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:11.974794 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:11.974849 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:11.974897 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:11.975264 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.975860 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.976765 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.977065 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.977168 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:11.977545 (+ 377us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:11.977630 (+ 85us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:11.977736 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:11.977884 (+ 148us) server_negotiation.cc:299] Negotiation successful
0808 04:40:11.977948 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 04:40:11.978108 15533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:11.974138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:39607 (local address 127.12.148.67:51327)
0808 04:40:11.974554 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:11.974568 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:11.974673 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:11.975044 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:11.975046 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:11.975054 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 04:40:11.975136 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:11.975141 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.975980 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.975984 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:11.976650 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:11.976661 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:11.977200 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:11.977204 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:11.977303 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:11.977355 (+ 52us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 04:40:11.977777 (+ 422us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 04:40:11.977784 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 04:40:11.977852 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 04:40:11.977941 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":122,"threads_started":1}
I20260808 04:40:12.000239 14686 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48116:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:12.000391 14686 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48116:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:12.002272 14686 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1fa24221de434845ba2ca3767460519d: Sending DeleteTablet for 3 replicas of tablet 13e17d50269a48d187efa18f2de18fcd
I20260808 04:40:12.002785 14877 tablet_service.cc:1514] Processing DeleteTablet for tablet 13e17d50269a48d187efa18f2de18fcd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:11 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:33890
I20260808 04:40:12.002971 15097 tablet_service.cc:1514] Processing DeleteTablet for tablet 13e17d50269a48d187efa18f2de18fcd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:11 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:57492
I20260808 04:40:12.003496 15302 tablet_service.cc:1514] Processing DeleteTablet for tablet 13e17d50269a48d187efa18f2de18fcd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:11 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:52194
I20260808 04:40:12.003808 15538 tablet_replica.cc:330] T 13e17d50269a48d187efa18f2de18fcd P 99396916be07442ba1cdba42b842df64: stopping tablet replica
I20260808 04:40:12.003935 15538 raft_consensus.cc:2229] T 13e17d50269a48d187efa18f2de18fcd P 99396916be07442ba1cdba42b842df64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:12.004036 15538 raft_consensus.cc:2258] T 13e17d50269a48d187efa18f2de18fcd P 99396916be07442ba1cdba42b842df64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:12.004724 15538 ts_tablet_manager.cc:1905] T 13e17d50269a48d187efa18f2de18fcd P 99396916be07442ba1cdba42b842df64: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:12.004745 15536 tablet_replica.cc:330] T 13e17d50269a48d187efa18f2de18fcd P 890c3ecb47ee4cf38d746f327aa9fc54: stopping tablet replica
I20260808 04:40:12.004935 15536 raft_consensus.cc:2229] T 13e17d50269a48d187efa18f2de18fcd P 890c3ecb47ee4cf38d746f327aa9fc54 [term 1 LEADER]: Raft consensus shutting down.
I20260808 04:40:12.005275 15536 raft_consensus.cc:2258] T 13e17d50269a48d187efa18f2de18fcd P 890c3ecb47ee4cf38d746f327aa9fc54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:12.005973 15536 ts_tablet_manager.cc:1905] T 13e17d50269a48d187efa18f2de18fcd P 890c3ecb47ee4cf38d746f327aa9fc54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:12.007906 15538 ts_tablet_manager.cc:1918] T 13e17d50269a48d187efa18f2de18fcd P 99396916be07442ba1cdba42b842df64: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 04:40:12.007997 15538 log.cc:1196] T 13e17d50269a48d187efa18f2de18fcd P 99396916be07442ba1cdba42b842df64: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-2/wal/wals/13e17d50269a48d187efa18f2de18fcd
I20260808 04:40:12.008249 15538 ts_tablet_manager.cc:1939] T 13e17d50269a48d187efa18f2de18fcd P 99396916be07442ba1cdba42b842df64: Deleting consensus metadata
I20260808 04:40:12.008939 14663 catalog_manager.cc:4841] TS 99396916be07442ba1cdba42b842df64 (127.12.148.67:44549): tablet 13e17d50269a48d187efa18f2de18fcd (table test-table [id=3a1219c317e5461db0a020cde28bc297]) successfully deleted
I20260808 04:40:12.009907 15536 ts_tablet_manager.cc:1918] T 13e17d50269a48d187efa18f2de18fcd P 890c3ecb47ee4cf38d746f327aa9fc54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 04:40:12.009975 15536 log.cc:1196] T 13e17d50269a48d187efa18f2de18fcd P 890c3ecb47ee4cf38d746f327aa9fc54: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-0/wal/wals/13e17d50269a48d187efa18f2de18fcd
I20260808 04:40:12.010197 15536 ts_tablet_manager.cc:1939] T 13e17d50269a48d187efa18f2de18fcd P 890c3ecb47ee4cf38d746f327aa9fc54: Deleting consensus metadata
I20260808 04:40:12.010834 14663 catalog_manager.cc:4841] TS 890c3ecb47ee4cf38d746f327aa9fc54 (127.12.148.65:39607): tablet 13e17d50269a48d187efa18f2de18fcd (table test-table [id=3a1219c317e5461db0a020cde28bc297]) successfully deleted
I20260808 04:40:12.013840 15537 tablet_replica.cc:330] T 13e17d50269a48d187efa18f2de18fcd P 796c02a5a31740a3b246b45119ade2ce: stopping tablet replica
I20260808 04:40:12.013985 15537 raft_consensus.cc:2229] T 13e17d50269a48d187efa18f2de18fcd P 796c02a5a31740a3b246b45119ade2ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:12.014106 15537 raft_consensus.cc:2258] T 13e17d50269a48d187efa18f2de18fcd P 796c02a5a31740a3b246b45119ade2ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:12.014844 15537 ts_tablet_manager.cc:1905] T 13e17d50269a48d187efa18f2de18fcd P 796c02a5a31740a3b246b45119ade2ce: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 08 04:40:12 dist-test-slave-t7g5 krb5kdc[14612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164011, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.148.65@KRBTEST.COM
I20260808 04:40:12.018224 15537 ts_tablet_manager.cc:1918] T 13e17d50269a48d187efa18f2de18fcd P 796c02a5a31740a3b246b45119ade2ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 04:40:12.018695 15537 log.cc:1196] T 13e17d50269a48d187efa18f2de18fcd P 796c02a5a31740a3b246b45119ade2ce: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786164004017495-12881-0/minicluster-data/ts-1/wal/wals/13e17d50269a48d187efa18f2de18fcd
I20260808 04:40:12.019295 15537 ts_tablet_manager.cc:1939] T 13e17d50269a48d187efa18f2de18fcd P 796c02a5a31740a3b246b45119ade2ce: Deleting consensus metadata
I20260808 04:40:12.020078 14667 catalog_manager.cc:4841] TS 796c02a5a31740a3b246b45119ade2ce (127.12.148.66:39255): tablet 13e17d50269a48d187efa18f2de18fcd (table test-table [id=3a1219c317e5461db0a020cde28bc297]) successfully deleted
I20260808 04:40:12.021859 15516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:12.008463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33902 (local address 127.12.148.65:39607)
0808 04:40:12.008606 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:12.008610 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:12.010923 (+ 2313us) server_negotiation.cc:407] Connection header received
0808 04:40:12.011096 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:12.011099 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:12.011145 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:12.011209 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:12.011980 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:12.012493 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:12.013386 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:12.013611 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:12.013729 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:12.017963 (+ 4234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:12.017976 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:12.017992 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:12.018020 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:12.020035 (+ 2015us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:12.020511 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:12.020517 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:12.020519 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:12.020603 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:12.020859 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:12.020863 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:12.020865 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:12.021109 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:12.021299 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:12.021512 (+ 213us) server_negotiation.cc:299] Negotiation successful
0808 04:40:12.021627 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
W20260808 04:40:12.022379 14982 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33902
I20260808 04:40:12.032589 15490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:12.024225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48140 (local address 127.12.148.126:35947)
0808 04:40:12.024343 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:12.024347 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:12.025900 (+ 1553us) server_negotiation.cc:407] Connection header received
0808 04:40:12.025998 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:12.026001 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:12.026050 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:12.026114 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:12.026727 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:12.027260 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:12.028019 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:12.028253 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:12.028360 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:12.029551 (+ 1191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:12.029555 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:12.029558 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:12.029583 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:12.030920 (+ 1337us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:12.031353 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:12.031357 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:12.031358 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:12.031450 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:12.031726 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:12.031729 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:12.031731 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:12.031917 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:12.032089 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:12.032306 (+ 217us) server_negotiation.cc:299] Negotiation successful
0808 04:40:12.032432 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
W20260808 04:40:12.032938 14686 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48140
I20260808 04:40:12.034308 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 14799
I20260808 04:40:12.047186 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 15004
I20260808 04:40:12.076015 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 15209
I20260808 04:40:12.085940 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 14638
2026-08-08T04:40:12Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (3085 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:40:12 dist-test-slave-t7g5 krb5kdc[15546](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:40:12 dist-test-slave-t7g5 krb5kdc[15546](info): set up 2 sockets
Aug 08 04:40:12 dist-test-slave-t7g5 krb5kdc[15546](info): commencing operation
krb5kdc: starting...
W20260808 04:40:13.234630 12881 mini_kdc.cc:121] Time spent starting KDC: real 1.124s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Aug 08 04:40:13 dist-test-slave-t7g5 krb5kdc[15546](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164013, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:40:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:40:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.148.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
I20260808 04:40:13.354081 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:33293
--webserver_interface=127.12.148.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:46251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:33293
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:13.463647 15566 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:13.463914 15566 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:13.463980 15566 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:13.467927 15566 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:40:13.467984 15566 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 04:40:13.468006 15566 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:13.468029 15566 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:13.468050 15566 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:40:13.468078 15566 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:40:13.473114 15566 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:46251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:33293
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:33293
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15566
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:13.474112 15566 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:13.475091 15566 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:13.483063 15576 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:13.483079 15578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:13.483084 15580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:13.483357 15566 server_base.cc:1034] running on GCE node
I20260808 04:40:13.483974 15566 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:13.485002 15566 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:13.486159 15566 hybrid_clock.cc:648] HybridClock initialized: now 1786164013486147 us; error 29 us; skew 500 ppm
Aug 08 04:40:13 dist-test-slave-t7g5 krb5kdc[15546](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164013, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:13.488710 15566 init.cc:377] Logged in from keytab as kudu/127.12.148.126@KRBTEST.COM (short username kudu)
I20260808 04:40:13.489550 15566 webserver.cc:460] Webserver started at http://127.12.148.126:44725/ using document root <none> and password file <none>
I20260808 04:40:13.490089 15566 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:13.490152 15566 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:13.490316 15566 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:13.492250 15566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "33a5ded9ceca4981b04941788592f599"
format_stamp: "Formatted at 2026-08-08 04:40:13 on dist-test-slave-t7g5"
server_key: "4dc57b65e193042bcb50fbff5b7f38c3"
server_key_iv: "2fcf57256a38c41e7f540dc159a17de3"
server_key_version: "encryptionkey@0"
I20260808 04:40:13.492759 15566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "33a5ded9ceca4981b04941788592f599"
format_stamp: "Formatted at 2026-08-08 04:40:13 on dist-test-slave-t7g5"
server_key: "4dc57b65e193042bcb50fbff5b7f38c3"
server_key_iv: "2fcf57256a38c41e7f540dc159a17de3"
server_key_version: "encryptionkey@0"
I20260808 04:40:13.496323 15566 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260808 04:40:13.498627 15588 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:13.499830 15566 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:40:13.499953 15566 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "33a5ded9ceca4981b04941788592f599"
format_stamp: "Formatted at 2026-08-08 04:40:13 on dist-test-slave-t7g5"
server_key: "4dc57b65e193042bcb50fbff5b7f38c3"
server_key_iv: "2fcf57256a38c41e7f540dc159a17de3"
server_key_version: "encryptionkey@0"
I20260808 04:40:13.500070 15566 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:13.533335 15566 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:13.536798 15566 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:13.537045 15566 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:13.544828 15566 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:33293
I20260808 04:40:13.544863 15678 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:33293 every 8 connection(s)
I20260808 04:40:13.545801 15566 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:40:13.548486 15679 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:13.549975 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 15566
I20260808 04:40:13.550062 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:40:13.550302 12881 external_mini_cluster.cc:1428] Setting key 67ef514fcbb92e01e17ad1d5715512e9
I20260808 04:40:13.554405 15679 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33a5ded9ceca4981b04941788592f599: Bootstrap starting.
I20260808 04:40:13.556586 15679 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 33a5ded9ceca4981b04941788592f599: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:13.557438 15679 log.cc:824] T 00000000000000000000000000000000 P 33a5ded9ceca4981b04941788592f599: Log is configured to *not* fsync() on all Append() calls
Aug 08 04:40:13 dist-test-slave-t7g5 krb5kdc[15546](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164013, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:40:13.559603 15679 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33a5ded9ceca4981b04941788592f599: No bootstrap required, opened a new log
I20260808 04:40:13.562835 15679 raft_consensus.cc:348] T 00000000000000000000000000000000 P 33a5ded9ceca4981b04941788592f599 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33a5ded9ceca4981b04941788592f599" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 33293 } }
I20260808 04:40:13.563077 15679 raft_consensus.cc:374] T 00000000000000000000000000000000 P 33a5ded9ceca4981b04941788592f599 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:13.563136 15679 raft_consensus.cc:729] T 00000000000000000000000000000000 P 33a5ded9ceca4981b04941788592f599 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33a5ded9ceca4981b04941788592f599, State: Initialized, Role: FOLLOWER
I20260808 04:40:13.563560 15679 consensus_queue.cc:260] T 00000000000000000000000000000000 P 33a5ded9ceca4981b04941788592f599 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33a5ded9ceca4981b04941788592f599" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 33293 } }
I20260808 04:40:13.563694 15679 raft_consensus.cc:388] T 00000000000000000000000000000000 P 33a5ded9ceca4981b04941788592f599 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:40:13.563774 15679 raft_consensus.cc:482] T 00000000000000000000000000000000 P 33a5ded9ceca4981b04941788592f599 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:40:13.563880 15679 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 33a5ded9ceca4981b04941788592f599 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:13.564666 15690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:13.551741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50586 (local address 127.12.148.126:33293)
0808 04:40:13.552175 (+ 434us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:13.552194 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:13.552229 (+ 35us) server_negotiation.cc:407] Connection header received
0808 04:40:13.552866 (+ 637us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:13.552884 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:13.553211 (+ 327us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:13.553525 (+ 314us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:13.554317 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:13.555314 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:13.556167 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:13.556646 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:13.556786 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:13.559504 (+ 2718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:13.559509 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:13.559522 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:13.559548 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:13.561928 (+ 2380us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:13.562395 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:13.562399 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:13.562403 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:13.562507 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:13.562772 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:13.562773 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:13.562775 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:13.563146 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:13.563357 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:13.563629 (+ 272us) server_negotiation.cc:299] Negotiation successful
0808 04:40:13.563930 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":278,"thread_start_us":123,"threads_started":1}
I20260808 04:40:13.564672 15679 raft_consensus.cc:504] T 00000000000000000000000000000000 P 33a5ded9ceca4981b04941788592f599 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33a5ded9ceca4981b04941788592f599" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 33293 } }
I20260808 04:40:13.565037 15679 leader_election.cc:302] T 00000000000000000000000000000000 P 33a5ded9ceca4981b04941788592f599 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 33a5ded9ceca4981b04941788592f599; no voters:
I20260808 04:40:13.565322 15679 leader_election.cc:288] T 00000000000000000000000000000000 P 33a5ded9ceca4981b04941788592f599 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:40:13.565404 15692 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 33a5ded9ceca4981b04941788592f599 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:13.565634 15692 raft_consensus.cc:686] T 00000000000000000000000000000000 P 33a5ded9ceca4981b04941788592f599 [term 1 LEADER]: Becoming Leader. State: Replica: 33a5ded9ceca4981b04941788592f599, State: Running, Role: LEADER
I20260808 04:40:13.566001 15692 consensus_queue.cc:237] T 00000000000000000000000000000000 P 33a5ded9ceca4981b04941788592f599 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33a5ded9ceca4981b04941788592f599" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 33293 } }
I20260808 04:40:13.566634 15679 sys_catalog.cc:564] T 00000000000000000000000000000000 P 33a5ded9ceca4981b04941788592f599 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:40:13.567207 15692 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33a5ded9ceca4981b04941788592f599 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 33a5ded9ceca4981b04941788592f599. Latest consensus state: current_term: 1 leader_uuid: "33a5ded9ceca4981b04941788592f599" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33a5ded9ceca4981b04941788592f599" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 33293 } } }
I20260808 04:40:13.567407 15692 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33a5ded9ceca4981b04941788592f599 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:13.567646 15695 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33a5ded9ceca4981b04941788592f599 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "33a5ded9ceca4981b04941788592f599" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33a5ded9ceca4981b04941788592f599" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 33293 } } }
I20260808 04:40:13.567747 15695 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33a5ded9ceca4981b04941788592f599 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:13.567857 15702 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:40:13.570972 15702 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:40:13.576215 15702 catalog_manager.cc:1347] Generated new cluster ID: 2936044c8db2430cac40d94a2b45999c
I20260808 04:40:13.576282 15702 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:40:13.606637 15702 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:40:13.607590 15702 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:40:13.612977 15702 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 33a5ded9ceca4981b04941788592f599: Generated new TSK 0
I20260808 04:40:13.613860 15702 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.148.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab.
Entry for principal kudu/127.12.148.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab.
I20260808 04:40:13.640692 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.65:0
--local_ip_for_outbound_sockets=127.12.148.65
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:33293
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:46251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:13.750509 15732 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:13.750758 15732 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:13.750802 15732 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:13.754693 15732 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:13.754752 15732 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:13.754791 15732 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 04:40:13.754809 15732 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 04:40:13.754839 15732 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.65
I20260808 04:40:13.760010 15732 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:46251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.148.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.148.126:33293
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15732
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.65
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:13.760946 15732 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:13.761927 15732 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:13.773324 15740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:13.773296 15739 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:13.773746 15732 server_base.cc:1034] running on GCE node
W20260808 04:40:13.774005 15743 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:13.774434 15732 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:13.775210 15732 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:13.776381 15732 hybrid_clock.cc:648] HybridClock initialized: now 1786164013776360 us; error 37 us; skew 500 ppm
Aug 08 04:40:13 dist-test-slave-t7g5 krb5kdc[15546](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164013, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:13.779166 15732 init.cc:377] Logged in from keytab as kudu/127.12.148.65@KRBTEST.COM (short username kudu)
I20260808 04:40:13.780045 15732 webserver.cc:460] Webserver started at http://127.12.148.65:44793/ using document root <none> and password file <none>
I20260808 04:40:13.780572 15732 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:13.780642 15732 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:13.780841 15732 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:13.782847 15732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-0/data/instance:
uuid: "b45e1dd47fb74be3b60f54560303c790"
format_stamp: "Formatted at 2026-08-08 04:40:13 on dist-test-slave-t7g5"
server_key: "acf0a0f1bc0dfa24c316e7171e9f8f30"
server_key_iv: "0b9755fa37cd35516a38d08c86593966"
server_key_version: "encryptionkey@0"
I20260808 04:40:13.783377 15732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance:
uuid: "b45e1dd47fb74be3b60f54560303c790"
format_stamp: "Formatted at 2026-08-08 04:40:13 on dist-test-slave-t7g5"
server_key: "acf0a0f1bc0dfa24c316e7171e9f8f30"
server_key_iv: "0b9755fa37cd35516a38d08c86593966"
server_key_version: "encryptionkey@0"
I20260808 04:40:13.786995 15732 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 04:40:13.789316 15754 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:13.790548 15732 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:40:13.790656 15732 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-0/wal
uuid: "b45e1dd47fb74be3b60f54560303c790"
format_stamp: "Formatted at 2026-08-08 04:40:13 on dist-test-slave-t7g5"
server_key: "acf0a0f1bc0dfa24c316e7171e9f8f30"
server_key_iv: "0b9755fa37cd35516a38d08c86593966"
server_key_version: "encryptionkey@0"
I20260808 04:40:13.790752 15732 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:13.813486 15732 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:13.816293 15732 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:13.816473 15732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:13.817962 15732 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:13.818014 15732 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:13.818068 15732 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:13.818094 15732 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 04:40:13 dist-test-slave-t7g5 krb5kdc[15546](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164013, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:40:13.828382 15732 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.65:36587
I20260808 04:40:13.828469 15919 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.65:36587 every 8 connection(s)
I20260808 04:40:13.829481 15732 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
I20260808 04:40:13.831421 15690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:13.818777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:38397 (local address 127.12.148.126:33293)
0808 04:40:13.818893 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:13.818897 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:13.819952 (+ 1055us) server_negotiation.cc:407] Connection header received
0808 04:40:13.820989 (+ 1037us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:13.820993 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:13.821055 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:13.821106 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:13.822672 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:13.823235 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:13.824925 (+ 1690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:13.825165 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:13.825262 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:13.827748 (+ 2486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:13.827752 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:13.827755 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:13.827787 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:13.829410 (+ 1623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:13.830013 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:13.830016 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:13.830019 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:13.830116 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:13.830485 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:13.830488 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:13.830489 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:13.830671 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:13.830745 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:13.831187 (+ 442us) server_negotiation.cc:299] Negotiation successful
0808 04:40:13.831292 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 04:40:13.832134 15766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:13.819309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:33293 (local address 127.12.148.65:38397)
0808 04:40:13.819801 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:13.819844 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:13.820740 (+ 896us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:13.821523 (+ 783us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:13.821532 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:13.821942 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:13.822530 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:13.822546 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:13.823359 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:13.823363 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:13.824783 (+ 1420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:13.824797 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:13.825325 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:13.825329 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:13.825505 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:13.826041 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:13.826057 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:13.827575 (+ 1518us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:13.829539 (+ 1964us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:13.829545 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:13.829559 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:13.829890 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:13.830202 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:13.830205 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:13.830207 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:13.830378 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:13.830755 (+ 377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:13.830759 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:13.830982 (+ 223us) client_negotiation.cc:769] Sending connection context
0808 04:40:13.831132 (+ 150us) client_negotiation.cc:240] Negotiation successful
0808 04:40:13.831368 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":153,"threads_started":1}
I20260808 04:40:13.833307 15920 heartbeater.cc:347] Connected to a master server at 127.12.148.126:33293
I20260808 04:40:13.833443 15920 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:13.834002 15920 heartbeater.cc:511] Master 127.12.148.126:33293 requested a full tablet report, sending...
I20260808 04:40:13.835644 15608 ts_manager.cc:194] Registered new tserver with Master: b45e1dd47fb74be3b60f54560303c790 (127.12.148.65:36587)
I20260808 04:40:13.836791 15608 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.65@KRBTEST.COM'} at 127.12.148.65:38397
I20260808 04:40:13.836848 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 15732
I20260808 04:40:13.836951 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance
I20260808 04:40:13.837234 12881 external_mini_cluster.cc:1428] Setting key 86da8adb9627d00ee93ccd3d34b5a51a
I20260808 04:40:13.842470 15690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:13.835587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:50163 (local address 127.12.148.126:33293)
0808 04:40:13.835686 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:13.835691 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:13.835915 (+ 224us) server_negotiation.cc:407] Connection header received
0808 04:40:13.836005 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:13.836007 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:13.836050 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:13.836112 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:13.836517 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:13.837223 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:13.838238 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:13.838557 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:13.838653 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:13.839807 (+ 1154us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:13.839810 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:13.839812 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:13.839832 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:13.840982 (+ 1150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:13.841359 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:13.841363 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:13.841365 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:13.841449 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:13.841722 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:13.841726 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:13.841728 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:13.841895 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:13.841982 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:13.842218 (+ 236us) server_negotiation.cc:299] Negotiation successful
0808 04:40:13.842318 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 04:40:13.842478 15930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:13.835540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:33293 (local address 127.12.148.65:50163)
0808 04:40:13.835825 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:13.835839 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:13.835932 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:13.836137 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:13.836139 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:13.836319 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:13.836418 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:13.836423 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:13.837367 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:13.837371 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:13.838119 (+ 748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:13.838131 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:13.838689 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:13.838693 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:13.838787 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:13.839270 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:13.839284 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:13.839684 (+ 400us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:13.841080 (+ 1396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:13.841084 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:13.841086 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:13.841275 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:13.841530 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:13.841533 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:13.841535 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:13.841616 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:13.841984 (+ 368us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:13.841987 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:13.842072 (+ 85us) client_negotiation.cc:769] Sending connection context
0808 04:40:13.842155 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 04:40:13.842291 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":119,"threads_started":1}
WARNING: no policy specified for kudu/127.12.148.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab.
Entry for principal kudu/127.12.148.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab.
I20260808 04:40:13.864491 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.66:0
--local_ip_for_outbound_sockets=127.12.148.66
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:33293
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:46251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:13.974817 15934 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:13.975086 15934 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:13.975154 15934 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:13.979207 15934 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:13.979269 15934 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:13.979321 15934 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 04:40:13.979348 15934 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 04:40:13.979401 15934 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.66
I20260808 04:40:13.984686 15934 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:46251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.148.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.148.126:33293
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15934
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.66
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:13.985807 15934 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:13.987002 15934 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:13.996690 15941 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:13.996688 15940 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:13.996659 15943 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:13.996951 15934 server_base.cc:1034] running on GCE node
I20260808 04:40:13.997344 15934 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:13.998087 15934 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:13.999255 15934 hybrid_clock.cc:648] HybridClock initialized: now 1786164013999226 us; error 38 us; skew 500 ppm
Aug 08 04:40:13 dist-test-slave-t7g5 krb5kdc[15546](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164013, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:14.001945 15934 init.cc:377] Logged in from keytab as kudu/127.12.148.66@KRBTEST.COM (short username kudu)
I20260808 04:40:14.002776 15934 webserver.cc:460] Webserver started at http://127.12.148.66:43055/ using document root <none> and password file <none>
I20260808 04:40:14.003345 15934 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:14.003410 15934 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:14.003636 15934 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:14.005729 15934 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-1/data/instance:
uuid: "80591840abe24dd1a2970a3ba0cf4eaa"
format_stamp: "Formatted at 2026-08-08 04:40:13 on dist-test-slave-t7g5"
server_key: "dfb80da82e93aafd934588d881adafe7"
server_key_iv: "a61842cfcd0963cccb70c3a9ac8d50d0"
server_key_version: "encryptionkey@0"
I20260808 04:40:14.006289 15934 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance:
uuid: "80591840abe24dd1a2970a3ba0cf4eaa"
format_stamp: "Formatted at 2026-08-08 04:40:13 on dist-test-slave-t7g5"
server_key: "dfb80da82e93aafd934588d881adafe7"
server_key_iv: "a61842cfcd0963cccb70c3a9ac8d50d0"
server_key_version: "encryptionkey@0"
I20260808 04:40:14.009943 15934 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 04:40:14.012259 15954 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:14.013427 15934 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:40:14.013527 15934 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-1/wal
uuid: "80591840abe24dd1a2970a3ba0cf4eaa"
format_stamp: "Formatted at 2026-08-08 04:40:13 on dist-test-slave-t7g5"
server_key: "dfb80da82e93aafd934588d881adafe7"
server_key_iv: "a61842cfcd0963cccb70c3a9ac8d50d0"
server_key_version: "encryptionkey@0"
I20260808 04:40:14.013628 15934 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:14.035178 15934 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:14.037959 15934 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:14.038127 15934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:14.039542 15934 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:14.039592 15934 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:14.039646 15934 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:14.039670 15934 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 04:40:14 dist-test-slave-t7g5 krb5kdc[15546](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164013, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:40:14.049839 15934 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.66:40497
I20260808 04:40:14.049953 16132 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.66:40497 every 8 connection(s)
I20260808 04:40:14.050757 15934 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
I20260808 04:40:14.052976 15690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:14.040354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:46309 (local address 127.12.148.126:33293)
0808 04:40:14.040487 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:14.040491 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:14.041547 (+ 1056us) server_negotiation.cc:407] Connection header received
0808 04:40:14.042629 (+ 1082us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:14.042633 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:14.042689 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:14.042743 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:14.044132 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.044970 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.046198 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.046543 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.046662 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:14.049689 (+ 3027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:14.049694 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:14.049696 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:14.049728 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:14.051219 (+ 1491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:14.051746 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:14.051750 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:14.051751 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:14.051837 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:14.052096 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:14.052098 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:14.052099 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:14.052259 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:14.052330 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:14.052740 (+ 410us) server_negotiation.cc:299] Negotiation successful
0808 04:40:14.052844 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 04:40:14.053735 15966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:14.040930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:33293 (local address 127.12.148.66:46309)
0808 04:40:14.041391 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:14.041434 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:14.042370 (+ 936us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:14.043079 (+ 709us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:14.043085 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:14.043401 (+ 316us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:14.043933 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:14.043951 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.045107 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.045111 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:14.046080 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:14.046089 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.046712 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.046717 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:14.046906 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:14.048037 (+ 1131us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:14.048053 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:14.049476 (+ 1423us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:14.051348 (+ 1872us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:14.051354 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:14.051368 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:14.051665 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:14.051917 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:14.051918 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:14.051920 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:14.052040 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:14.052329 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:14.052333 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:14.052555 (+ 222us) client_negotiation.cc:769] Sending connection context
0808 04:40:14.052704 (+ 149us) client_negotiation.cc:240] Negotiation successful
0808 04:40:14.052937 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":124,"threads_started":1}
I20260808 04:40:14.054858 16134 heartbeater.cc:347] Connected to a master server at 127.12.148.126:33293
I20260808 04:40:14.054997 16134 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:14.055565 16134 heartbeater.cc:511] Master 127.12.148.126:33293 requested a full tablet report, sending...
I20260808 04:40:14.056630 15609 ts_manager.cc:194] Registered new tserver with Master: 80591840abe24dd1a2970a3ba0cf4eaa (127.12.148.66:40497)
I20260808 04:40:14.057260 15609 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.66@KRBTEST.COM'} at 127.12.148.66:46309
I20260808 04:40:14.060937 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 15934
I20260808 04:40:14.061033 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance
I20260808 04:40:14.061295 12881 external_mini_cluster.cc:1428] Setting key f592278204b980d7b96fa2f2ab8785cd
I20260808 04:40:14.063849 15690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:14.057231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:55473 (local address 127.12.148.126:33293)
0808 04:40:14.057342 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:14.057346 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:14.057497 (+ 151us) server_negotiation.cc:407] Connection header received
0808 04:40:14.057612 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:14.057615 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:14.057677 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:14.057745 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:14.058165 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.058808 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.059573 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.059793 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.059875 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:14.060891 (+ 1016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:14.060895 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:14.060897 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:14.060921 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:14.062372 (+ 1451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:14.062739 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:14.062742 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:14.062744 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:14.062824 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:14.063070 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:14.063074 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:14.063075 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:14.063279 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:14.063366 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:14.063619 (+ 253us) server_negotiation.cc:299] Negotiation successful
0808 04:40:14.063716 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 04:40:14.063861 16141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:14.057128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:33293 (local address 127.12.148.66:55473)
0808 04:40:14.057399 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:14.057414 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:14.057525 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:14.057770 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:14.057772 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:14.057967 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:14.058061 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:14.058066 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.058927 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.058930 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:14.059468 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:14.059476 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.059888 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.059891 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:14.059979 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:14.060414 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:14.060468 (+ 54us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:14.060760 (+ 292us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:14.062464 (+ 1704us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:14.062467 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:14.062469 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:14.062652 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:14.062904 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:14.062907 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:14.062909 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:14.062991 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:14.063372 (+ 381us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:14.063375 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:14.063469 (+ 94us) client_negotiation.cc:769] Sending connection context
0808 04:40:14.063553 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 04:40:14.063684 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":88,"threads_started":1}
WARNING: no policy specified for kudu/127.12.148.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab.
Entry for principal kudu/127.12.148.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab.
I20260808 04:40:14.086433 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.67:0
--local_ip_for_outbound_sockets=127.12.148.67
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:33293
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:46251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:14.197257 16144 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:14.197592 16144 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:14.197685 16144 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:14.201726 16144 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:14.201788 16144 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:14.201828 16144 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 04:40:14.201845 16144 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 04:40:14.201881 16144 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.67
I20260808 04:40:14.207082 16144 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:46251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.148.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.148.126:33293
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16144
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.67
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:14.208055 16144 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:14.209019 16144 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:14.218708 16154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:14.218708 16151 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:14.218708 16156 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:14.219063 16144 server_base.cc:1034] running on GCE node
I20260808 04:40:14.219441 16144 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:14.220075 16144 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:14.221236 16144 hybrid_clock.cc:648] HybridClock initialized: now 1786164014221209 us; error 40 us; skew 500 ppm
Aug 08 04:40:14 dist-test-slave-t7g5 krb5kdc[15546](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164014, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:14.223904 16144 init.cc:377] Logged in from keytab as kudu/127.12.148.67@KRBTEST.COM (short username kudu)
I20260808 04:40:14.224776 16144 webserver.cc:460] Webserver started at http://127.12.148.67:43213/ using document root <none> and password file <none>
I20260808 04:40:14.225317 16144 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:14.225382 16144 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:14.225586 16144 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:14.227622 16144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-2/data/instance:
uuid: "0c32b76f12b943d199444ef17ee4308b"
format_stamp: "Formatted at 2026-08-08 04:40:14 on dist-test-slave-t7g5"
server_key: "2e8cd9b090e9e85744a3d1d51fea12fc"
server_key_iv: "51421bdff24ac6c4b88591913e7424a0"
server_key_version: "encryptionkey@0"
I20260808 04:40:14.228161 16144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance:
uuid: "0c32b76f12b943d199444ef17ee4308b"
format_stamp: "Formatted at 2026-08-08 04:40:14 on dist-test-slave-t7g5"
server_key: "2e8cd9b090e9e85744a3d1d51fea12fc"
server_key_iv: "51421bdff24ac6c4b88591913e7424a0"
server_key_version: "encryptionkey@0"
I20260808 04:40:14.231802 16144 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 04:40:14.234217 16166 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:14.235394 16144 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:40:14.235509 16144 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-2/wal
uuid: "0c32b76f12b943d199444ef17ee4308b"
format_stamp: "Formatted at 2026-08-08 04:40:14 on dist-test-slave-t7g5"
server_key: "2e8cd9b090e9e85744a3d1d51fea12fc"
server_key_iv: "51421bdff24ac6c4b88591913e7424a0"
server_key_version: "encryptionkey@0"
I20260808 04:40:14.235610 16144 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:14.253033 16144 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:14.255725 16144 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:14.255903 16144 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:14.257319 16144 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:14.257371 16144 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:14.257414 16144 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:14.257444 16144 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 04:40:14 dist-test-slave-t7g5 krb5kdc[15546](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164014, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:40:14.267306 16144 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.67:46617
I20260808 04:40:14.267488 16338 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.67:46617 every 8 connection(s)
I20260808 04:40:14.268208 16144 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
I20260808 04:40:14.270587 15690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:14.258007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:51349 (local address 127.12.148.126:33293)
0808 04:40:14.258158 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:14.258163 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:14.259458 (+ 1295us) server_negotiation.cc:407] Connection header received
0808 04:40:14.260540 (+ 1082us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:14.260544 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:14.260604 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:14.260699 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:14.261974 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.262784 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.263979 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.264316 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.264445 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:14.266988 (+ 2543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:14.266992 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:14.266995 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:14.267031 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:14.268649 (+ 1618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:14.269235 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:14.269239 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:14.269240 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:14.269336 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:14.269674 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:14.269677 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:14.269678 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:14.269866 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:14.269946 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:14.270362 (+ 416us) server_negotiation.cc:299] Negotiation successful
0808 04:40:14.270468 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 04:40:14.271328 16179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:14.258803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:33293 (local address 127.12.148.67:51349)
0808 04:40:14.259314 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:14.259363 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:14.260333 (+ 970us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:14.260842 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:14.260849 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:14.261225 (+ 376us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:14.261835 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:14.261852 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.262910 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.262914 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:14.263870 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:14.263880 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.264463 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.264467 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:14.264603 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:14.265093 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:14.265109 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:14.266826 (+ 1717us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:14.268772 (+ 1946us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:14.268777 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:14.268810 (+ 33us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:14.269144 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:14.269433 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:14.269435 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:14.269437 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:14.269572 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:14.269950 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:14.269955 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:14.270171 (+ 216us) client_negotiation.cc:769] Sending connection context
0808 04:40:14.270324 (+ 153us) client_negotiation.cc:240] Negotiation successful
0808 04:40:14.270567 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":130,"threads_started":1}
I20260808 04:40:14.271838 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 16144
I20260808 04:40:14.271961 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance
I20260808 04:40:14.272267 12881 external_mini_cluster.cc:1428] Setting key 04a6f39abac3c27d6e89fbff35c038d6
I20260808 04:40:14.272533 16339 heartbeater.cc:347] Connected to a master server at 127.12.148.126:33293
I20260808 04:40:14.272676 16339 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:14.273270 16339 heartbeater.cc:511] Master 127.12.148.126:33293 requested a full tablet report, sending...
I20260808 04:40:14.274621 15608 ts_manager.cc:194] Registered new tserver with Master: 0c32b76f12b943d199444ef17ee4308b (127.12.148.67:46617)
I20260808 04:40:14.275343 15608 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.67@KRBTEST.COM'} at 127.12.148.67:51349
I20260808 04:40:14.280633 15690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:14.274724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:40705 (local address 127.12.148.126:33293)
0808 04:40:14.274832 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:14.274836 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:14.275020 (+ 184us) server_negotiation.cc:407] Connection header received
0808 04:40:14.275127 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:14.275129 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:14.275164 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:14.275223 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:14.275706 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.276395 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.277190 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.277414 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.277491 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:14.278401 (+ 910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:14.278404 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:14.278406 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:14.278422 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:14.279453 (+ 1031us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:14.279784 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:14.279786 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:14.279787 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:14.279850 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:14.280040 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:14.280042 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:14.280043 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:14.280181 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:14.280248 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:14.280440 (+ 192us) server_negotiation.cc:299] Negotiation successful
0808 04:40:14.280531 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 04:40:14.280709 16351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:14.274645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:33293 (local address 127.12.148.67:40705)
0808 04:40:14.274930 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:14.274953 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:14.275052 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:14.275250 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:14.275252 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:14.275464 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:14.275586 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:14.275594 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.276522 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.276524 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:14.277080 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:14.277088 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.277498 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.277500 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:14.277561 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:14.278001 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:14.278016 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:14.278305 (+ 289us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:14.279537 (+ 1232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:14.279540 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:14.279541 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:14.279714 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:14.279909 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:14.279911 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:14.279912 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:14.279983 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:14.280241 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:14.280243 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:14.280312 (+ 69us) client_negotiation.cc:769] Sending connection context
0808 04:40:14.280401 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 04:40:14.280532 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":123,"threads_started":1}
I20260808 04:40:14.285787 12881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 04:40:14 dist-test-slave-t7g5 krb5kdc[15546](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164014, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 04:40:14 dist-test-slave-t7g5 krb5kdc[15546](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164014, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:40:14.310937 15690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:14.303651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34554 (local address 127.12.148.126:33293)
0808 04:40:14.303769 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:14.303773 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:14.303785 (+ 12us) server_negotiation.cc:407] Connection header received
0808 04:40:14.303822 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:14.303825 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:14.303870 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:14.303949 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:14.304603 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.305151 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.305986 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.306193 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.306260 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:14.308429 (+ 2169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:14.308432 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:14.308434 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:14.308458 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:14.309549 (+ 1091us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:14.309985 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:14.309988 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:14.309989 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:14.310069 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:14.310272 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:14.310274 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:14.310275 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:14.310436 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:14.310530 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:14.310686 (+ 156us) server_negotiation.cc:299] Negotiation successful
0808 04:40:14.310776 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 04:40:14.313445 15608 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34554:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:40:14.316350 15608 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:40:14.329990 16367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:14.324096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:40497 (local address 127.0.0.1:39080)
0808 04:40:14.324571 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:14.324643 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:14.324777 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:14.325413 (+ 636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:14.325419 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:14.325441 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:14.325579 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:14.325586 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.327154 (+ 1568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.327158 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:14.328518 (+ 1360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:14.328528 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.329489 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.329491 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:14.329578 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:14.329608 (+ 30us) client_negotiation.cc:769] Sending connection context
0808 04:40:14.329735 (+ 127us) client_negotiation.cc:240] Negotiation successful
0808 04:40:14.329846 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"mutex_wait_us":99,"thread_start_us":67,"threads_started":1}
I20260808 04:40:14.330005 16368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:14.324221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39080 (local address 127.12.148.66:40497)
0808 04:40:14.324914 (+ 693us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:14.324929 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:14.324953 (+ 24us) server_negotiation.cc:407] Connection header received
0808 04:40:14.325028 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:14.325033 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:14.325245 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:14.325757 (+ 512us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:14.325900 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.327032 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.328643 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.329368 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.329496 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:14.329709 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:14.329771 (+ 62us) server_negotiation.cc:299] Negotiation successful
0808 04:40:14.329864 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":111,"threads_started":1}
I20260808 04:40:14.331182 16369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:14.324828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.67:46617 (local address 127.0.0.1:32844)
0808 04:40:14.325044 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:14.325056 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:14.325144 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:14.326108 (+ 964us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:14.326112 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:14.326128 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:14.326236 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:14.326242 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.327419 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.327422 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:14.328793 (+ 1371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:14.328800 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.330774 (+ 1974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.330777 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:14.330896 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:14.330918 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 04:40:14.330991 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 04:40:14.331060 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"mutex_wait_us":161,"thread_start_us":88,"threads_started":1}
I20260808 04:40:14.331245 16370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:14.324990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32844 (local address 127.12.148.67:46617)
0808 04:40:14.325671 (+ 681us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:14.325684 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:14.325707 (+ 23us) server_negotiation.cc:407] Connection header received
0808 04:40:14.325776 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:14.325780 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:14.325967 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:14.326114 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:14.326340 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.327319 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.330052 (+ 2733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.330661 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.330760 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:14.330912 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:14.331029 (+ 117us) server_negotiation.cc:299] Negotiation successful
0808 04:40:14.331119 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":556,"thread_start_us":94,"threads_started":1}
I20260808 04:40:14.332801 16033 tablet_service.cc:1467] Processing CreateTablet for tablet bded693cd1044cdd8ee1c4e0440481de (DEFAULT_TABLE table=test-table [id=963bfd93f9af49719c2128d4dde8aecd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:14.333760 16033 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bded693cd1044cdd8ee1c4e0440481de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:14.333436 16240 tablet_service.cc:1467] Processing CreateTablet for tablet bded693cd1044cdd8ee1c4e0440481de (DEFAULT_TABLE table=test-table [id=963bfd93f9af49719c2128d4dde8aecd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:14.334304 16240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bded693cd1044cdd8ee1c4e0440481de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:14.334604 16364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:14.324202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:36587 (local address 127.0.0.1:35224)
0808 04:40:14.325263 (+ 1061us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:14.325278 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:14.325365 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:14.326239 (+ 874us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:14.326242 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:14.326257 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:14.326346 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:14.326353 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.327496 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.327499 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:14.328780 (+ 1281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:14.328791 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.329850 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.329853 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:14.329960 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:14.329983 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 04:40:14.334406 (+ 4423us) client_negotiation.cc:240] Negotiation successful
0808 04:40:14.334483 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":522,"mutex_wait_us":88,"thread_start_us":105,"threads_started":1}
I20260808 04:40:14.335121 16371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:14.325342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35224 (local address 127.12.148.65:36587)
0808 04:40:14.325844 (+ 502us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:14.325857 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:14.325875 (+ 18us) server_negotiation.cc:407] Connection header received
0808 04:40:14.325933 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:14.325937 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:14.326089 (+ 152us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:14.326476 (+ 387us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:14.326587 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.327381 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.328916 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.329724 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.329824 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:14.329982 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:14.334878 (+ 4896us) server_negotiation.cc:299] Negotiation successful
0808 04:40:14.334988 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":102,"threads_started":1}
I20260808 04:40:14.337798 15823 tablet_service.cc:1467] Processing CreateTablet for tablet bded693cd1044cdd8ee1c4e0440481de (DEFAULT_TABLE table=test-table [id=963bfd93f9af49719c2128d4dde8aecd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:14.338788 15823 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bded693cd1044cdd8ee1c4e0440481de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:14.341809 16373 tablet_bootstrap.cc:492] T bded693cd1044cdd8ee1c4e0440481de P 80591840abe24dd1a2970a3ba0cf4eaa: Bootstrap starting.
I20260808 04:40:14.341956 16372 tablet_bootstrap.cc:492] T bded693cd1044cdd8ee1c4e0440481de P 0c32b76f12b943d199444ef17ee4308b: Bootstrap starting.
I20260808 04:40:14.344025 16373 tablet_bootstrap.cc:654] T bded693cd1044cdd8ee1c4e0440481de P 80591840abe24dd1a2970a3ba0cf4eaa: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:14.344024 16372 tablet_bootstrap.cc:654] T bded693cd1044cdd8ee1c4e0440481de P 0c32b76f12b943d199444ef17ee4308b: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:14.344736 16375 tablet_bootstrap.cc:492] T bded693cd1044cdd8ee1c4e0440481de P b45e1dd47fb74be3b60f54560303c790: Bootstrap starting.
I20260808 04:40:14.344897 16372 log.cc:824] T bded693cd1044cdd8ee1c4e0440481de P 0c32b76f12b943d199444ef17ee4308b: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:14.344897 16373 log.cc:824] T bded693cd1044cdd8ee1c4e0440481de P 80591840abe24dd1a2970a3ba0cf4eaa: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:14.346921 16372 tablet_bootstrap.cc:492] T bded693cd1044cdd8ee1c4e0440481de P 0c32b76f12b943d199444ef17ee4308b: No bootstrap required, opened a new log
I20260808 04:40:14.347059 16375 tablet_bootstrap.cc:654] T bded693cd1044cdd8ee1c4e0440481de P b45e1dd47fb74be3b60f54560303c790: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:14.347112 16372 ts_tablet_manager.cc:1397] T bded693cd1044cdd8ee1c4e0440481de P 0c32b76f12b943d199444ef17ee4308b: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 04:40:14.347195 16373 tablet_bootstrap.cc:492] T bded693cd1044cdd8ee1c4e0440481de P 80591840abe24dd1a2970a3ba0cf4eaa: No bootstrap required, opened a new log
I20260808 04:40:14.347379 16373 ts_tablet_manager.cc:1397] T bded693cd1044cdd8ee1c4e0440481de P 80591840abe24dd1a2970a3ba0cf4eaa: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 04:40:14.348232 16375 log.cc:824] T bded693cd1044cdd8ee1c4e0440481de P b45e1dd47fb74be3b60f54560303c790: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:14.350093 16375 tablet_bootstrap.cc:492] T bded693cd1044cdd8ee1c4e0440481de P b45e1dd47fb74be3b60f54560303c790: No bootstrap required, opened a new log
I20260808 04:40:14.350273 16375 ts_tablet_manager.cc:1397] T bded693cd1044cdd8ee1c4e0440481de P b45e1dd47fb74be3b60f54560303c790: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 04:40:14.350134 16372 raft_consensus.cc:348] T bded693cd1044cdd8ee1c4e0440481de P 0c32b76f12b943d199444ef17ee4308b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:14.350368 16372 raft_consensus.cc:374] T bded693cd1044cdd8ee1c4e0440481de P 0c32b76f12b943d199444ef17ee4308b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:14.350428 16372 raft_consensus.cc:729] T bded693cd1044cdd8ee1c4e0440481de P 0c32b76f12b943d199444ef17ee4308b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c32b76f12b943d199444ef17ee4308b, State: Initialized, Role: FOLLOWER
I20260808 04:40:14.350834 16372 consensus_queue.cc:260] T bded693cd1044cdd8ee1c4e0440481de P 0c32b76f12b943d199444ef17ee4308b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:14.350940 16373 raft_consensus.cc:348] T bded693cd1044cdd8ee1c4e0440481de P 80591840abe24dd1a2970a3ba0cf4eaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:14.351197 16373 raft_consensus.cc:374] T bded693cd1044cdd8ee1c4e0440481de P 80591840abe24dd1a2970a3ba0cf4eaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:14.351254 16373 raft_consensus.cc:729] T bded693cd1044cdd8ee1c4e0440481de P 80591840abe24dd1a2970a3ba0cf4eaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80591840abe24dd1a2970a3ba0cf4eaa, State: Initialized, Role: FOLLOWER
I20260808 04:40:14.351574 16339 heartbeater.cc:503] Master 127.12.148.126:33293 was elected leader, sending a full tablet report...
I20260808 04:40:14.351768 16372 ts_tablet_manager.cc:1428] T bded693cd1044cdd8ee1c4e0440481de P 0c32b76f12b943d199444ef17ee4308b: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260808 04:40:14.352152 16373 consensus_queue.cc:260] T bded693cd1044cdd8ee1c4e0440481de P 80591840abe24dd1a2970a3ba0cf4eaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:14.352780 16134 heartbeater.cc:503] Master 127.12.148.126:33293 was elected leader, sending a full tablet report...
I20260808 04:40:14.353073 16373 ts_tablet_manager.cc:1428] T bded693cd1044cdd8ee1c4e0440481de P 80591840abe24dd1a2970a3ba0cf4eaa: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 04:40:14.354591 16375 raft_consensus.cc:348] T bded693cd1044cdd8ee1c4e0440481de P b45e1dd47fb74be3b60f54560303c790 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:14.354833 16375 raft_consensus.cc:374] T bded693cd1044cdd8ee1c4e0440481de P b45e1dd47fb74be3b60f54560303c790 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:14.354897 16375 raft_consensus.cc:729] T bded693cd1044cdd8ee1c4e0440481de P b45e1dd47fb74be3b60f54560303c790 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b45e1dd47fb74be3b60f54560303c790, State: Initialized, Role: FOLLOWER
I20260808 04:40:14.355280 16380 raft_consensus.cc:482] T bded693cd1044cdd8ee1c4e0440481de P 80591840abe24dd1a2970a3ba0cf4eaa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:40:14.355422 16380 raft_consensus.cc:504] T bded693cd1044cdd8ee1c4e0440481de P 80591840abe24dd1a2970a3ba0cf4eaa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:14.355645 16375 consensus_queue.cc:260] T bded693cd1044cdd8ee1c4e0440481de P b45e1dd47fb74be3b60f54560303c790 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:14.356554 16380 leader_election.cc:288] T bded693cd1044cdd8ee1c4e0440481de P 80591840abe24dd1a2970a3ba0cf4eaa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b45e1dd47fb74be3b60f54560303c790 (127.12.148.65:36587), 0c32b76f12b943d199444ef17ee4308b (127.12.148.67:46617)
I20260808 04:40:14.356701 16375 ts_tablet_manager.cc:1428] T bded693cd1044cdd8ee1c4e0440481de P b45e1dd47fb74be3b60f54560303c790: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260808 04:40:14.357007 15920 heartbeater.cc:503] Master 127.12.148.126:33293 was elected leader, sending a full tablet report...
I20260808 04:40:14.358224 16382 raft_consensus.cc:482] T bded693cd1044cdd8ee1c4e0440481de P b45e1dd47fb74be3b60f54560303c790 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:40:14.358351 16382 raft_consensus.cc:504] T bded693cd1044cdd8ee1c4e0440481de P b45e1dd47fb74be3b60f54560303c790 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:14.360550 16382 leader_election.cc:288] T bded693cd1044cdd8ee1c4e0440481de P b45e1dd47fb74be3b60f54560303c790 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80591840abe24dd1a2970a3ba0cf4eaa (127.12.148.66:40497), 0c32b76f12b943d199444ef17ee4308b (127.12.148.67:46617)
I20260808 04:40:14.360867 15966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:14.356741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:36587 (local address 127.12.148.66:34555)
0808 04:40:14.356847 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:14.356861 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:14.356938 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:14.357603 (+ 665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:14.357605 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:14.357620 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:14.357747 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:14.357753 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.358668 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.358671 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:14.359618 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:14.359628 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.360464 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.360468 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:14.360584 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:14.360607 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 04:40:14.360673 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 04:40:14.360742 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 04:40:14.361178 16371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:14.357327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:34555 (local address 127.12.148.65:36587)
0808 04:40:14.357424 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:14.357428 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:14.357439 (+ 11us) server_negotiation.cc:407] Connection header received
0808 04:40:14.357482 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:14.357484 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:14.357521 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:14.357583 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:14.357841 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.358535 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.359809 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.360358 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.360464 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:14.360514 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:14.361004 (+ 490us) server_negotiation.cc:299] Negotiation successful
0808 04:40:14.361074 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 04:40:14.361892 16370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:14.357088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:33365 (local address 127.12.148.67:46617)
0808 04:40:14.357188 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:14.357193 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:14.357328 (+ 135us) server_negotiation.cc:407] Connection header received
0808 04:40:14.357505 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:14.357508 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:14.357549 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:14.357624 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:14.358024 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.358729 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.360660 (+ 1931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.361213 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.361288 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:14.361334 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:14.361711 (+ 377us) server_negotiation.cc:299] Negotiation successful
0808 04:40:14.361786 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 04:40:14.361850 15854 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bded693cd1044cdd8ee1c4e0440481de" candidate_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b45e1dd47fb74be3b60f54560303c790" is_pre_election: true
I20260808 04:40:14.362035 15854 raft_consensus.cc:2454] T bded693cd1044cdd8ee1c4e0440481de P b45e1dd47fb74be3b60f54560303c790 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80591840abe24dd1a2970a3ba0cf4eaa in term 0.
I20260808 04:40:14.362458 15959 leader_election.cc:302] T bded693cd1044cdd8ee1c4e0440481de P 80591840abe24dd1a2970a3ba0cf4eaa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80591840abe24dd1a2970a3ba0cf4eaa, b45e1dd47fb74be3b60f54560303c790; no voters:
I20260808 04:40:14.362577 16383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:14.356984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.67:46617 (local address 127.12.148.66:33365)
0808 04:40:14.357249 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:14.357262 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:14.357393 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:14.357764 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:14.357767 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:14.357785 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:14.357899 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:14.357905 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.358860 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.358863 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:14.360522 (+ 1659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:14.360532 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.361454 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.361458 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:14.361545 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:14.361568 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 04:40:14.362327 (+ 759us) client_negotiation.cc:240] Negotiation successful
0808 04:40:14.362409 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":99,"threads_started":1}
I20260808 04:40:14.362828 16380 raft_consensus.cc:2781] T bded693cd1044cdd8ee1c4e0440481de P 80591840abe24dd1a2970a3ba0cf4eaa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:40:14.362932 16380 raft_consensus.cc:482] T bded693cd1044cdd8ee1c4e0440481de P 80591840abe24dd1a2970a3ba0cf4eaa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:40:14.362991 16380 raft_consensus.cc:3037] T bded693cd1044cdd8ee1c4e0440481de P 80591840abe24dd1a2970a3ba0cf4eaa [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:14.363111 16270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bded693cd1044cdd8ee1c4e0440481de" candidate_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c32b76f12b943d199444ef17ee4308b" is_pre_election: true
I20260808 04:40:14.363353 16270 raft_consensus.cc:2454] T bded693cd1044cdd8ee1c4e0440481de P 0c32b76f12b943d199444ef17ee4308b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80591840abe24dd1a2970a3ba0cf4eaa in term 0.
I20260808 04:40:14.364142 16380 raft_consensus.cc:504] T bded693cd1044cdd8ee1c4e0440481de P 80591840abe24dd1a2970a3ba0cf4eaa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:14.364439 16380 leader_election.cc:288] T bded693cd1044cdd8ee1c4e0440481de P 80591840abe24dd1a2970a3ba0cf4eaa [CANDIDATE]: Term 1 election: Requested vote from peers b45e1dd47fb74be3b60f54560303c790 (127.12.148.65:36587), 0c32b76f12b943d199444ef17ee4308b (127.12.148.67:46617)
I20260808 04:40:14.364795 16368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:14.360336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:60159 (local address 127.12.148.66:40497)
0808 04:40:14.360421 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:14.360425 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:14.360870 (+ 445us) server_negotiation.cc:407] Connection header received
0808 04:40:14.361042 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:14.361045 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:14.361082 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:14.361123 (+ 41us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:14.361479 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.362176 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.363568 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.364164 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.364246 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:14.364284 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:14.364625 (+ 341us) server_negotiation.cc:299] Negotiation successful
0808 04:40:14.364692 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 04:40:14.364802 15854 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bded693cd1044cdd8ee1c4e0440481de" candidate_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b45e1dd47fb74be3b60f54560303c790"
I20260808 04:40:14.364802 16270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bded693cd1044cdd8ee1c4e0440481de" candidate_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c32b76f12b943d199444ef17ee4308b"
I20260808 04:40:14.364903 15854 raft_consensus.cc:3037] T bded693cd1044cdd8ee1c4e0440481de P b45e1dd47fb74be3b60f54560303c790 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:14.364915 16270 raft_consensus.cc:3037] T bded693cd1044cdd8ee1c4e0440481de P 0c32b76f12b943d199444ef17ee4308b [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:14.365135 16384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:14.360049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:40497 (local address 127.12.148.65:60159)
0808 04:40:14.360796 (+ 747us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:14.360809 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:14.360946 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:14.361234 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:14.361237 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:14.361254 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:14.361354 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:14.361361 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.362293 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.362296 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:14.363417 (+ 1121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:14.363429 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.364376 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.364380 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:14.364489 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:14.364511 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 04:40:14.364907 (+ 396us) client_negotiation.cc:240] Negotiation successful
0808 04:40:14.364979 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":685,"thread_start_us":93,"threads_started":1}
I20260808 04:40:14.366081 16270 raft_consensus.cc:2454] T bded693cd1044cdd8ee1c4e0440481de P 0c32b76f12b943d199444ef17ee4308b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80591840abe24dd1a2970a3ba0cf4eaa in term 1.
I20260808 04:40:14.366081 15854 raft_consensus.cc:2454] T bded693cd1044cdd8ee1c4e0440481de P b45e1dd47fb74be3b60f54560303c790 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80591840abe24dd1a2970a3ba0cf4eaa in term 1.
I20260808 04:40:14.366400 15959 leader_election.cc:302] T bded693cd1044cdd8ee1c4e0440481de P 80591840abe24dd1a2970a3ba0cf4eaa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c32b76f12b943d199444ef17ee4308b, 80591840abe24dd1a2970a3ba0cf4eaa; no voters:
I20260808 04:40:14.366492 16370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:14.361026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:33319 (local address 127.12.148.67:46617)
0808 04:40:14.362041 (+ 1015us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:14.362045 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:14.362059 (+ 14us) server_negotiation.cc:407] Connection header received
0808 04:40:14.362096 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:14.362099 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:14.362136 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:14.362206 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:14.363624 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.364303 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.365534 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.365974 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.366075 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:14.366118 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:14.366312 (+ 194us) server_negotiation.cc:299] Negotiation successful
0808 04:40:14.366379 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":960,"thread_start_us":100,"threads_started":1}
I20260808 04:40:14.366734 16060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bded693cd1044cdd8ee1c4e0440481de" candidate_uuid: "b45e1dd47fb74be3b60f54560303c790" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" is_pre_election: true
I20260808 04:40:14.366850 16385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:14.360719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.67:46617 (local address 127.12.148.65:33319)
0808 04:40:14.361641 (+ 922us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:14.361677 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:14.361759 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:14.362223 (+ 464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:14.362226 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:14.362245 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:14.363508 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:14.363516 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.364418 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.364421 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:14.365420 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:14.365429 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.366076 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.366080 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:14.366176 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:14.366198 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 04:40:14.366650 (+ 452us) client_negotiation.cc:240] Negotiation successful
0808 04:40:14.366720 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":859,"thread_start_us":88,"threads_started":1}
I20260808 04:40:14.366966 16060 raft_consensus.cc:2379] T bded693cd1044cdd8ee1c4e0440481de P 80591840abe24dd1a2970a3ba0cf4eaa [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b45e1dd47fb74be3b60f54560303c790 in current term 1: Already voted for candidate 80591840abe24dd1a2970a3ba0cf4eaa in this term.
I20260808 04:40:14.367206 16270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bded693cd1044cdd8ee1c4e0440481de" candidate_uuid: "b45e1dd47fb74be3b60f54560303c790" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c32b76f12b943d199444ef17ee4308b" is_pre_election: true
I20260808 04:40:14.367291 16380 raft_consensus.cc:2781] T bded693cd1044cdd8ee1c4e0440481de P 80591840abe24dd1a2970a3ba0cf4eaa [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:14.367362 16270 raft_consensus.cc:2379] T bded693cd1044cdd8ee1c4e0440481de P 0c32b76f12b943d199444ef17ee4308b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b45e1dd47fb74be3b60f54560303c790 in current term 1: Already voted for candidate 80591840abe24dd1a2970a3ba0cf4eaa in this term.
I20260808 04:40:14.367493 16380 raft_consensus.cc:686] T bded693cd1044cdd8ee1c4e0440481de P 80591840abe24dd1a2970a3ba0cf4eaa [term 1 LEADER]: Becoming Leader. State: Replica: 80591840abe24dd1a2970a3ba0cf4eaa, State: Running, Role: LEADER
I20260808 04:40:14.367776 15759 leader_election.cc:302] T bded693cd1044cdd8ee1c4e0440481de P b45e1dd47fb74be3b60f54560303c790 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b45e1dd47fb74be3b60f54560303c790; no voters: 0c32b76f12b943d199444ef17ee4308b, 80591840abe24dd1a2970a3ba0cf4eaa
I20260808 04:40:14.367786 16380 consensus_queue.cc:237] T bded693cd1044cdd8ee1c4e0440481de P 80591840abe24dd1a2970a3ba0cf4eaa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:14.369172 16381 raft_consensus.cc:2726] T bded693cd1044cdd8ee1c4e0440481de P b45e1dd47fb74be3b60f54560303c790 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260808 04:40:14.370546 15609 catalog_manager.cc:5495] T bded693cd1044cdd8ee1c4e0440481de P 80591840abe24dd1a2970a3ba0cf4eaa reported cstate change: term changed from 0 to 1, leader changed from <none> to 80591840abe24dd1a2970a3ba0cf4eaa (127.12.148.66). New cstate: current_term: 1 leader_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } health_report { overall_health: UNKNOWN } } }
Aug 08 04:40:14 dist-test-slave-t7g5 krb5kdc[15546](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164013, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:40:14.410699 16403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:14.403234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:33293 (local address 127.0.0.1:34564)
0808 04:40:14.403508 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:14.403520 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:14.403617 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:14.403809 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:14.403811 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:14.404191 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:14.404287 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:14.404292 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.405022 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.405025 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:14.405572 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:14.405579 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.406015 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.406018 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:14.406105 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:14.406643 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:14.406655 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:14.408017 (+ 1362us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:14.409344 (+ 1327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:14.409353 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:14.409357 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:14.409588 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:14.409830 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:14.409833 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:14.409834 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:14.409917 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:14.410218 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:14.410223 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:14.410327 (+ 104us) client_negotiation.cc:769] Sending connection context
0808 04:40:14.410414 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 04:40:14.410538 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":110,"threads_started":1}
I20260808 04:40:14.410712 15690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:14.403295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34564 (local address 127.12.148.126:33293)
0808 04:40:14.403415 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:14.403419 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:14.403586 (+ 167us) server_negotiation.cc:407] Connection header received
0808 04:40:14.403680 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:14.403682 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:14.403723 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:14.403786 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:14.404402 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.404913 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.405704 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.405911 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.406005 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:14.408140 (+ 2135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:14.408144 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:14.408146 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:14.408167 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:14.409247 (+ 1080us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:14.409679 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:14.409682 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:14.409684 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:14.409760 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:14.409990 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:14.409992 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:14.409993 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:14.410142 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:14.410210 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:14.410453 (+ 243us) server_negotiation.cc:299] Negotiation successful
0808 04:40:14.410587 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":67,"server-negotiator.queue_time_us":31}
I20260808 04:40:14.414235 15609 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:34564:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 04:40:14.414911 15609 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:40:14.419554 16033 tablet_service.cc:1467] Processing CreateTablet for tablet b1ee686b64ea472a8e2fae26e6149429 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=da2c86f02cce4cdf9f428ba5ec015367]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 04:40:14.419489 15823 tablet_service.cc:1467] Processing CreateTablet for tablet b1ee686b64ea472a8e2fae26e6149429 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=da2c86f02cce4cdf9f428ba5ec015367]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 04:40:14.420215 16033 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1ee686b64ea472a8e2fae26e6149429. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:14.420217 15823 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1ee686b64ea472a8e2fae26e6149429. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:14.419963 16240 tablet_service.cc:1467] Processing CreateTablet for tablet b1ee686b64ea472a8e2fae26e6149429 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=da2c86f02cce4cdf9f428ba5ec015367]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 04:40:14.420534 16240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1ee686b64ea472a8e2fae26e6149429. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:14.422646 16373 tablet_bootstrap.cc:492] T b1ee686b64ea472a8e2fae26e6149429 P 80591840abe24dd1a2970a3ba0cf4eaa: Bootstrap starting.
I20260808 04:40:14.423061 16375 tablet_bootstrap.cc:492] T b1ee686b64ea472a8e2fae26e6149429 P b45e1dd47fb74be3b60f54560303c790: Bootstrap starting.
I20260808 04:40:14.423287 16372 tablet_bootstrap.cc:492] T b1ee686b64ea472a8e2fae26e6149429 P 0c32b76f12b943d199444ef17ee4308b: Bootstrap starting.
I20260808 04:40:14.423614 16373 tablet_bootstrap.cc:654] T b1ee686b64ea472a8e2fae26e6149429 P 80591840abe24dd1a2970a3ba0cf4eaa: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:14.424116 16372 tablet_bootstrap.cc:654] T b1ee686b64ea472a8e2fae26e6149429 P 0c32b76f12b943d199444ef17ee4308b: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:14.424340 16375 tablet_bootstrap.cc:654] T b1ee686b64ea472a8e2fae26e6149429 P b45e1dd47fb74be3b60f54560303c790: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:14.424988 16373 tablet_bootstrap.cc:492] T b1ee686b64ea472a8e2fae26e6149429 P 80591840abe24dd1a2970a3ba0cf4eaa: No bootstrap required, opened a new log
I20260808 04:40:14.425077 16373 ts_tablet_manager.cc:1397] T b1ee686b64ea472a8e2fae26e6149429 P 80591840abe24dd1a2970a3ba0cf4eaa: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 04:40:14.425289 16372 tablet_bootstrap.cc:492] T b1ee686b64ea472a8e2fae26e6149429 P 0c32b76f12b943d199444ef17ee4308b: No bootstrap required, opened a new log
I20260808 04:40:14.425371 16372 ts_tablet_manager.cc:1397] T b1ee686b64ea472a8e2fae26e6149429 P 0c32b76f12b943d199444ef17ee4308b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 04:40:14.425532 16373 raft_consensus.cc:348] T b1ee686b64ea472a8e2fae26e6149429 P 80591840abe24dd1a2970a3ba0cf4eaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:14.425632 16373 raft_consensus.cc:374] T b1ee686b64ea472a8e2fae26e6149429 P 80591840abe24dd1a2970a3ba0cf4eaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:14.425685 16375 tablet_bootstrap.cc:492] T b1ee686b64ea472a8e2fae26e6149429 P b45e1dd47fb74be3b60f54560303c790: No bootstrap required, opened a new log
I20260808 04:40:14.425704 16373 raft_consensus.cc:729] T b1ee686b64ea472a8e2fae26e6149429 P 80591840abe24dd1a2970a3ba0cf4eaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80591840abe24dd1a2970a3ba0cf4eaa, State: Initialized, Role: FOLLOWER
I20260808 04:40:14.425767 16375 ts_tablet_manager.cc:1397] T b1ee686b64ea472a8e2fae26e6149429 P b45e1dd47fb74be3b60f54560303c790: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 04:40:14.425822 16372 raft_consensus.cc:348] T b1ee686b64ea472a8e2fae26e6149429 P 0c32b76f12b943d199444ef17ee4308b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:14.425829 16373 consensus_queue.cc:260] T b1ee686b64ea472a8e2fae26e6149429 P 80591840abe24dd1a2970a3ba0cf4eaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:14.425915 16372 raft_consensus.cc:374] T b1ee686b64ea472a8e2fae26e6149429 P 0c32b76f12b943d199444ef17ee4308b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:14.425943 16372 raft_consensus.cc:729] T b1ee686b64ea472a8e2fae26e6149429 P 0c32b76f12b943d199444ef17ee4308b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c32b76f12b943d199444ef17ee4308b, State: Initialized, Role: FOLLOWER
I20260808 04:40:14.426049 16372 consensus_queue.cc:260] T b1ee686b64ea472a8e2fae26e6149429 P 0c32b76f12b943d199444ef17ee4308b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:14.426128 16373 ts_tablet_manager.cc:1428] T b1ee686b64ea472a8e2fae26e6149429 P 80591840abe24dd1a2970a3ba0cf4eaa: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 04:40:14.426098 16380 tablet_replica.cc:439] T b1ee686b64ea472a8e2fae26e6149429 P 80591840abe24dd1a2970a3ba0cf4eaa: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } } }
I20260808 04:40:14.426230 16380 tablet_replica.cc:442] T b1ee686b64ea472a8e2fae26e6149429 P 80591840abe24dd1a2970a3ba0cf4eaa: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 04:40:14.426205 16375 raft_consensus.cc:348] T b1ee686b64ea472a8e2fae26e6149429 P b45e1dd47fb74be3b60f54560303c790 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:14.426290 16372 ts_tablet_manager.cc:1428] T b1ee686b64ea472a8e2fae26e6149429 P 0c32b76f12b943d199444ef17ee4308b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 04:40:14.426295 16375 raft_consensus.cc:374] T b1ee686b64ea472a8e2fae26e6149429 P b45e1dd47fb74be3b60f54560303c790 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:14.426327 16375 raft_consensus.cc:729] T b1ee686b64ea472a8e2fae26e6149429 P b45e1dd47fb74be3b60f54560303c790 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b45e1dd47fb74be3b60f54560303c790, State: Initialized, Role: FOLLOWER
I20260808 04:40:14.426442 16375 consensus_queue.cc:260] T b1ee686b64ea472a8e2fae26e6149429 P b45e1dd47fb74be3b60f54560303c790 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:14.426532 16379 tablet_replica.cc:439] T b1ee686b64ea472a8e2fae26e6149429 P 0c32b76f12b943d199444ef17ee4308b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } } }
I20260808 04:40:14.426656 16379 tablet_replica.cc:442] T b1ee686b64ea472a8e2fae26e6149429 P 0c32b76f12b943d199444ef17ee4308b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 04:40:14.426679 16375 ts_tablet_manager.cc:1428] T b1ee686b64ea472a8e2fae26e6149429 P b45e1dd47fb74be3b60f54560303c790: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 04:40:14.426771 16381 tablet_replica.cc:439] T b1ee686b64ea472a8e2fae26e6149429 P b45e1dd47fb74be3b60f54560303c790: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } } }
I20260808 04:40:14.426898 16381 tablet_replica.cc:442] T b1ee686b64ea472a8e2fae26e6149429 P b45e1dd47fb74be3b60f54560303c790: This TxnStatusTablet replica's current role is: FOLLOWER
W20260808 04:40:14.519688 16340 tablet.cc:2369] T b1ee686b64ea472a8e2fae26e6149429 P 0c32b76f12b943d199444ef17ee4308b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 04:40:14.551879 16135 tablet.cc:2369] T b1ee686b64ea472a8e2fae26e6149429 P 80591840abe24dd1a2970a3ba0cf4eaa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:40:14.552250 16381 raft_consensus.cc:482] T b1ee686b64ea472a8e2fae26e6149429 P b45e1dd47fb74be3b60f54560303c790 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:40:14.552382 16381 raft_consensus.cc:504] T b1ee686b64ea472a8e2fae26e6149429 P b45e1dd47fb74be3b60f54560303c790 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:14.552805 16381 leader_election.cc:288] T b1ee686b64ea472a8e2fae26e6149429 P b45e1dd47fb74be3b60f54560303c790 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80591840abe24dd1a2970a3ba0cf4eaa (127.12.148.66:40497), 0c32b76f12b943d199444ef17ee4308b (127.12.148.67:46617)
I20260808 04:40:14.553241 16060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1ee686b64ea472a8e2fae26e6149429" candidate_uuid: "b45e1dd47fb74be3b60f54560303c790" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" is_pre_election: true
I20260808 04:40:14.553238 16270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1ee686b64ea472a8e2fae26e6149429" candidate_uuid: "b45e1dd47fb74be3b60f54560303c790" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c32b76f12b943d199444ef17ee4308b" is_pre_election: true
I20260808 04:40:14.553391 16270 raft_consensus.cc:2454] T b1ee686b64ea472a8e2fae26e6149429 P 0c32b76f12b943d199444ef17ee4308b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b45e1dd47fb74be3b60f54560303c790 in term 0.
I20260808 04:40:14.553411 16060 raft_consensus.cc:2454] T b1ee686b64ea472a8e2fae26e6149429 P 80591840abe24dd1a2970a3ba0cf4eaa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b45e1dd47fb74be3b60f54560303c790 in term 0.
I20260808 04:40:14.553722 15759 leader_election.cc:302] T b1ee686b64ea472a8e2fae26e6149429 P b45e1dd47fb74be3b60f54560303c790 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c32b76f12b943d199444ef17ee4308b, b45e1dd47fb74be3b60f54560303c790; no voters:
I20260808 04:40:14.553915 16381 raft_consensus.cc:2781] T b1ee686b64ea472a8e2fae26e6149429 P b45e1dd47fb74be3b60f54560303c790 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:40:14.553975 16381 raft_consensus.cc:482] T b1ee686b64ea472a8e2fae26e6149429 P b45e1dd47fb74be3b60f54560303c790 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:40:14.554016 16381 raft_consensus.cc:3037] T b1ee686b64ea472a8e2fae26e6149429 P b45e1dd47fb74be3b60f54560303c790 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:14.555289 16381 raft_consensus.cc:504] T b1ee686b64ea472a8e2fae26e6149429 P b45e1dd47fb74be3b60f54560303c790 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:14.555652 16381 leader_election.cc:288] T b1ee686b64ea472a8e2fae26e6149429 P b45e1dd47fb74be3b60f54560303c790 [CANDIDATE]: Term 1 election: Requested vote from peers 80591840abe24dd1a2970a3ba0cf4eaa (127.12.148.66:40497), 0c32b76f12b943d199444ef17ee4308b (127.12.148.67:46617)
I20260808 04:40:14.556026 16270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1ee686b64ea472a8e2fae26e6149429" candidate_uuid: "b45e1dd47fb74be3b60f54560303c790" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c32b76f12b943d199444ef17ee4308b"
I20260808 04:40:14.556034 16060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1ee686b64ea472a8e2fae26e6149429" candidate_uuid: "b45e1dd47fb74be3b60f54560303c790" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80591840abe24dd1a2970a3ba0cf4eaa"
I20260808 04:40:14.556142 16060 raft_consensus.cc:3037] T b1ee686b64ea472a8e2fae26e6149429 P 80591840abe24dd1a2970a3ba0cf4eaa [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:14.556146 16270 raft_consensus.cc:3037] T b1ee686b64ea472a8e2fae26e6149429 P 0c32b76f12b943d199444ef17ee4308b [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:14.557066 16270 raft_consensus.cc:2454] T b1ee686b64ea472a8e2fae26e6149429 P 0c32b76f12b943d199444ef17ee4308b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b45e1dd47fb74be3b60f54560303c790 in term 1.
I20260808 04:40:14.557245 16060 raft_consensus.cc:2454] T b1ee686b64ea472a8e2fae26e6149429 P 80591840abe24dd1a2970a3ba0cf4eaa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b45e1dd47fb74be3b60f54560303c790 in term 1.
I20260808 04:40:14.557348 15759 leader_election.cc:302] T b1ee686b64ea472a8e2fae26e6149429 P b45e1dd47fb74be3b60f54560303c790 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c32b76f12b943d199444ef17ee4308b, b45e1dd47fb74be3b60f54560303c790; no voters:
I20260808 04:40:14.557579 16381 raft_consensus.cc:2781] T b1ee686b64ea472a8e2fae26e6149429 P b45e1dd47fb74be3b60f54560303c790 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:14.557721 16381 raft_consensus.cc:686] T b1ee686b64ea472a8e2fae26e6149429 P b45e1dd47fb74be3b60f54560303c790 [term 1 LEADER]: Becoming Leader. State: Replica: b45e1dd47fb74be3b60f54560303c790, State: Running, Role: LEADER
I20260808 04:40:14.558075 16381 consensus_queue.cc:237] T b1ee686b64ea472a8e2fae26e6149429 P b45e1dd47fb74be3b60f54560303c790 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:14.560364 16382 tablet_replica.cc:439] T b1ee686b64ea472a8e2fae26e6149429 P b45e1dd47fb74be3b60f54560303c790: TxnStatusTablet state changed. Reason: New leader b45e1dd47fb74be3b60f54560303c790. Latest consensus state: current_term: 1 leader_uuid: "b45e1dd47fb74be3b60f54560303c790" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } } }
I20260808 04:40:14.560482 16382 tablet_replica.cc:442] T b1ee686b64ea472a8e2fae26e6149429 P b45e1dd47fb74be3b60f54560303c790: This TxnStatusTablet replica's current role is: LEADER
I20260808 04:40:14.560770 16413 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 04:40:14.560973 16413 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 04:40:14.561372 15609 catalog_manager.cc:5495] T b1ee686b64ea472a8e2fae26e6149429 P b45e1dd47fb74be3b60f54560303c790 reported cstate change: term changed from 0 to 1, leader changed from <none> to b45e1dd47fb74be3b60f54560303c790 (127.12.148.65). New cstate: current_term: 1 leader_uuid: "b45e1dd47fb74be3b60f54560303c790" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } health_report { overall_health: UNKNOWN } } }
I20260808 04:40:14.579543 16403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:14.576027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:36587 (local address 127.0.0.1:35232)
0808 04:40:14.576262 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:14.576277 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:14.576383 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:14.576681 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:14.576683 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:14.576691 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 04:40:14.576794 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:14.576801 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.577487 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.577491 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:14.578136 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:14.578145 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.578551 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.578555 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:14.578653 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:14.578695 (+ 42us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 04:40:14.579275 (+ 580us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 04:40:14.579290 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 04:40:14.579352 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 04:40:14.579433 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128}
I20260808 04:40:14.579542 16371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:14.576121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35232 (local address 127.12.148.65:36587)
0808 04:40:14.576244 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:14.576249 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:14.576324 (+ 75us) server_negotiation.cc:407] Connection header received
0808 04:40:14.576512 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:14.576514 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:14.576565 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:14.576646 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:14.576899 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.577389 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.578250 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.578458 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.578543 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:14.578824 (+ 281us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:14.579182 (+ 358us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:14.579277 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:14.579363 (+ 86us) server_negotiation.cc:299] Negotiation successful
0808 04:40:14.579416 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
W20260808 04:40:14.580777 15922 tablet.cc:2369] T b1ee686b64ea472a8e2fae26e6149429 P b45e1dd47fb74be3b60f54560303c790: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:40:14.584149 16270 raft_consensus.cc:1261] T b1ee686b64ea472a8e2fae26e6149429 P 0c32b76f12b943d199444ef17ee4308b [term 1 FOLLOWER]: Refusing update from remote peer b45e1dd47fb74be3b60f54560303c790: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:14.584141 16060 raft_consensus.cc:1261] T b1ee686b64ea472a8e2fae26e6149429 P 80591840abe24dd1a2970a3ba0cf4eaa [term 1 FOLLOWER]: Refusing update from remote peer b45e1dd47fb74be3b60f54560303c790: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:14.584650 16382 consensus_queue.cc:1035] T b1ee686b64ea472a8e2fae26e6149429 P b45e1dd47fb74be3b60f54560303c790 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:14.584825 16381 consensus_queue.cc:1035] T b1ee686b64ea472a8e2fae26e6149429 P b45e1dd47fb74be3b60f54560303c790 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:14.587971 16380 tablet_replica.cc:439] T b1ee686b64ea472a8e2fae26e6149429 P 80591840abe24dd1a2970a3ba0cf4eaa: TxnStatusTablet state changed. Reason: New leader b45e1dd47fb74be3b60f54560303c790. Latest consensus state: current_term: 1 leader_uuid: "b45e1dd47fb74be3b60f54560303c790" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } } }
I20260808 04:40:14.588084 16380 tablet_replica.cc:442] T b1ee686b64ea472a8e2fae26e6149429 P 80591840abe24dd1a2970a3ba0cf4eaa: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 04:40:14.588126 16379 tablet_replica.cc:439] T b1ee686b64ea472a8e2fae26e6149429 P 0c32b76f12b943d199444ef17ee4308b: TxnStatusTablet state changed. Reason: New leader b45e1dd47fb74be3b60f54560303c790. Latest consensus state: current_term: 1 leader_uuid: "b45e1dd47fb74be3b60f54560303c790" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } } }
I20260808 04:40:14.588229 16379 tablet_replica.cc:442] T b1ee686b64ea472a8e2fae26e6149429 P 0c32b76f12b943d199444ef17ee4308b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 04:40:14.590929 16382 tablet_replica.cc:439] T b1ee686b64ea472a8e2fae26e6149429 P b45e1dd47fb74be3b60f54560303c790: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b45e1dd47fb74be3b60f54560303c790" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } } }
I20260808 04:40:14.591048 16382 tablet_replica.cc:442] T b1ee686b64ea472a8e2fae26e6149429 P b45e1dd47fb74be3b60f54560303c790: This TxnStatusTablet replica's current role is: LEADER
I20260808 04:40:14.591418 16420 mvcc.cc:205] Tried to move back new op lower bound from 7316127803730841600 to 7316127803632340992. Current Snapshot: MvccSnapshot[applied={T|T < 7316127803730841600}]
I20260808 04:40:14.591702 16418 mvcc.cc:205] Tried to move back new op lower bound from 7316127803730841600 to 7316127803632340992. Current Snapshot: MvccSnapshot[applied={T|T < 7316127803730841600}]
I20260808 04:40:14.591789 16379 tablet_replica.cc:439] T b1ee686b64ea472a8e2fae26e6149429 P 0c32b76f12b943d199444ef17ee4308b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b45e1dd47fb74be3b60f54560303c790" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } } }
I20260808 04:40:14.591888 16379 tablet_replica.cc:442] T b1ee686b64ea472a8e2fae26e6149429 P 0c32b76f12b943d199444ef17ee4308b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 04:40:14.592226 16381 tablet_replica.cc:439] T b1ee686b64ea472a8e2fae26e6149429 P b45e1dd47fb74be3b60f54560303c790: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b45e1dd47fb74be3b60f54560303c790" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } } }
I20260808 04:40:14.592335 16381 tablet_replica.cc:442] T b1ee686b64ea472a8e2fae26e6149429 P b45e1dd47fb74be3b60f54560303c790: This TxnStatusTablet replica's current role is: LEADER
I20260808 04:40:14.593149 16380 tablet_replica.cc:439] T b1ee686b64ea472a8e2fae26e6149429 P 80591840abe24dd1a2970a3ba0cf4eaa: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b45e1dd47fb74be3b60f54560303c790" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } } }
I20260808 04:40:14.593258 16380 tablet_replica.cc:442] T b1ee686b64ea472a8e2fae26e6149429 P 80591840abe24dd1a2970a3ba0cf4eaa: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 04:40:14.604346 16368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:14.600454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39092 (local address 127.12.148.66:40497)
0808 04:40:14.600767 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:14.600772 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:14.600784 (+ 12us) server_negotiation.cc:407] Connection header received
0808 04:40:14.600848 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:14.600851 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:14.600902 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:14.601002 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:14.601218 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.602030 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.602866 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.603221 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.603321 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:14.603533 (+ 212us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:14.604020 (+ 487us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:14.604127 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:14.604169 (+ 42us) server_negotiation.cc:299] Negotiation successful
0808 04:40:14.604222 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":240}
I20260808 04:40:14.614751 16436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:14.611311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:36587 (local address 127.12.148.66:59485)
0808 04:40:14.611602 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:14.611614 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:14.611699 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:14.611911 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:14.611913 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:14.611918 (+ 5us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 04:40:14.612010 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:14.612014 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.612954 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.612956 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:14.613537 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:14.613544 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.614128 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.614131 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:14.614196 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:14.614239 (+ 43us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 04:40:14.614527 (+ 288us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 04:40:14.614530 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 04:40:14.614571 (+ 41us) client_negotiation.cc:240] Negotiation successful
0808 04:40:14.614630 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":96,"threads_started":1}
I20260808 04:40:14.614763 16371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:14.611429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:59485 (local address 127.12.148.65:36587)
0808 04:40:14.611553 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:14.611557 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:14.611677 (+ 120us) server_negotiation.cc:407] Connection header received
0808 04:40:14.611768 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:14.611771 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:14.611818 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:14.611895 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:14.612092 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.612861 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.613634 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.614011 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.614112 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:14.614370 (+ 258us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:14.614458 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:14.614525 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:14.614584 (+ 59us) server_negotiation.cc:299] Negotiation successful
0808 04:40:14.614634 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 04:40:14.621853 16270 raft_consensus.cc:1261] T bded693cd1044cdd8ee1c4e0440481de P 0c32b76f12b943d199444ef17ee4308b [term 1 FOLLOWER]: Refusing update from remote peer 80591840abe24dd1a2970a3ba0cf4eaa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:14.622071 15854 raft_consensus.cc:1261] T bded693cd1044cdd8ee1c4e0440481de P b45e1dd47fb74be3b60f54560303c790 [term 1 FOLLOWER]: Refusing update from remote peer 80591840abe24dd1a2970a3ba0cf4eaa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:14.622617 16380 consensus_queue.cc:1035] T bded693cd1044cdd8ee1c4e0440481de P 80591840abe24dd1a2970a3ba0cf4eaa [LEADER]: Connected to new peer: Peer: permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:14.622864 16392 consensus_queue.cc:1035] T bded693cd1044cdd8ee1c4e0440481de P 80591840abe24dd1a2970a3ba0cf4eaa [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:14.626727 16419 mvcc.cc:205] Tried to move back new op lower bound from 7316127803887091712 to 7316127802852876288. Current Snapshot: MvccSnapshot[applied={T|T < 7316127803887091712}]
I20260808 04:40:14.646090 16368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:14.642494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:54907 (local address 127.12.148.66:40497)
0808 04:40:14.642602 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:14.642607 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:14.642814 (+ 207us) server_negotiation.cc:407] Connection header received
0808 04:40:14.642940 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:14.642943 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:14.642986 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:14.643045 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:14.643289 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.643953 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.645075 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.645293 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.645376 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:14.645648 (+ 272us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:14.645754 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:14.645812 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:14.645901 (+ 89us) server_negotiation.cc:299] Negotiation successful
0808 04:40:14.645951 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 04:40:14.646111 16443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:14.642449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:40497 (local address 127.12.148.65:54907)
0808 04:40:14.642738 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:14.642751 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:14.642848 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:14.643061 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:14.643063 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:14.643083 (+ 20us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 04:40:14.643196 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:14.643201 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.644054 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.644057 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:14.644971 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:14.644981 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:14.645386 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:14.645390 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:14.645485 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:14.645529 (+ 44us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 04:40:14.645828 (+ 299us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 04:40:14.645834 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 04:40:14.645899 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 04:40:14.645974 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":102,"threads_started":1}
I20260808 04:40:14.667985 15608 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34554:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:14.668213 15608 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34554:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:14.670984 15608 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 33a5ded9ceca4981b04941788592f599: Sending DeleteTablet for 3 replicas of tablet bded693cd1044cdd8ee1c4e0440481de
I20260808 04:40:14.671646 16033 tablet_service.cc:1514] Processing DeleteTablet for tablet bded693cd1044cdd8ee1c4e0440481de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:14 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:39080
I20260808 04:40:14.672042 16240 tablet_service.cc:1514] Processing DeleteTablet for tablet bded693cd1044cdd8ee1c4e0440481de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:14 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:32844
I20260808 04:40:14.672587 16448 tablet_replica.cc:330] T bded693cd1044cdd8ee1c4e0440481de P 0c32b76f12b943d199444ef17ee4308b: stopping tablet replica
I20260808 04:40:14.672924 16448 raft_consensus.cc:2229] T bded693cd1044cdd8ee1c4e0440481de P 0c32b76f12b943d199444ef17ee4308b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:14.672958 15823 tablet_service.cc:1514] Processing DeleteTablet for tablet bded693cd1044cdd8ee1c4e0440481de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:14 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:35224
I20260808 04:40:14.673146 16448 raft_consensus.cc:2258] T bded693cd1044cdd8ee1c4e0440481de P 0c32b76f12b943d199444ef17ee4308b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:14.674211 15608 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34554:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:40:14.674612 15608 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:40:14.674705 16448 ts_tablet_manager.cc:1905] T bded693cd1044cdd8ee1c4e0440481de P 0c32b76f12b943d199444ef17ee4308b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:14.676620 16447 tablet_replica.cc:330] T bded693cd1044cdd8ee1c4e0440481de P 80591840abe24dd1a2970a3ba0cf4eaa: stopping tablet replica
I20260808 04:40:14.677001 16447 raft_consensus.cc:2229] T bded693cd1044cdd8ee1c4e0440481de P 80591840abe24dd1a2970a3ba0cf4eaa [term 1 LEADER]: Raft consensus shutting down.
I20260808 04:40:14.677415 16447 raft_consensus.cc:2258] T bded693cd1044cdd8ee1c4e0440481de P 80591840abe24dd1a2970a3ba0cf4eaa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:14.677918 16450 tablet_replica.cc:330] T bded693cd1044cdd8ee1c4e0440481de P b45e1dd47fb74be3b60f54560303c790: stopping tablet replica
I20260808 04:40:14.678211 16450 raft_consensus.cc:2229] T bded693cd1044cdd8ee1c4e0440481de P b45e1dd47fb74be3b60f54560303c790 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:14.678402 16450 raft_consensus.cc:2258] T bded693cd1044cdd8ee1c4e0440481de P b45e1dd47fb74be3b60f54560303c790 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:14.678995 16447 ts_tablet_manager.cc:1905] T bded693cd1044cdd8ee1c4e0440481de P 80591840abe24dd1a2970a3ba0cf4eaa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:14.679677 16450 ts_tablet_manager.cc:1905] T bded693cd1044cdd8ee1c4e0440481de P b45e1dd47fb74be3b60f54560303c790: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:14.681049 16240 tablet_service.cc:1467] Processing CreateTablet for tablet f2e7a37fcf7143c8894f9102bfe17da4 (DEFAULT_TABLE table=test-table [id=6f52955a1382411a9a0b42fdfe45ca5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:14.681046 16033 tablet_service.cc:1467] Processing CreateTablet for tablet f2e7a37fcf7143c8894f9102bfe17da4 (DEFAULT_TABLE table=test-table [id=6f52955a1382411a9a0b42fdfe45ca5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:14.681305 16240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2e7a37fcf7143c8894f9102bfe17da4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:14.681316 16033 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2e7a37fcf7143c8894f9102bfe17da4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:14.683686 15823 tablet_service.cc:1467] Processing CreateTablet for tablet f2e7a37fcf7143c8894f9102bfe17da4 (DEFAULT_TABLE table=test-table [id=6f52955a1382411a9a0b42fdfe45ca5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:14.683938 15823 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2e7a37fcf7143c8894f9102bfe17da4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:14.685690 16448 ts_tablet_manager.cc:1918] T bded693cd1044cdd8ee1c4e0440481de P 0c32b76f12b943d199444ef17ee4308b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 04:40:14.685781 16448 log.cc:1196] T bded693cd1044cdd8ee1c4e0440481de P 0c32b76f12b943d199444ef17ee4308b: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-2/wal/wals/bded693cd1044cdd8ee1c4e0440481de
I20260808 04:40:14.686403 16373 tablet_bootstrap.cc:492] T f2e7a37fcf7143c8894f9102bfe17da4 P 80591840abe24dd1a2970a3ba0cf4eaa: Bootstrap starting.
I20260808 04:40:14.686841 16448 ts_tablet_manager.cc:1939] T bded693cd1044cdd8ee1c4e0440481de P 0c32b76f12b943d199444ef17ee4308b: Deleting consensus metadata
I20260808 04:40:14.687354 16373 tablet_bootstrap.cc:654] T f2e7a37fcf7143c8894f9102bfe17da4 P 80591840abe24dd1a2970a3ba0cf4eaa: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:14.687971 16372 tablet_bootstrap.cc:492] T f2e7a37fcf7143c8894f9102bfe17da4 P 0c32b76f12b943d199444ef17ee4308b: Bootstrap starting.
I20260808 04:40:14.687994 15592 catalog_manager.cc:4841] TS 0c32b76f12b943d199444ef17ee4308b (127.12.148.67:46617): tablet bded693cd1044cdd8ee1c4e0440481de (table test-table [id=963bfd93f9af49719c2128d4dde8aecd]) successfully deleted
I20260808 04:40:14.688850 16372 tablet_bootstrap.cc:654] T f2e7a37fcf7143c8894f9102bfe17da4 P 0c32b76f12b943d199444ef17ee4308b: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:14.689479 16375 tablet_bootstrap.cc:492] T f2e7a37fcf7143c8894f9102bfe17da4 P b45e1dd47fb74be3b60f54560303c790: Bootstrap starting.
I20260808 04:40:14.690375 16375 tablet_bootstrap.cc:654] T f2e7a37fcf7143c8894f9102bfe17da4 P b45e1dd47fb74be3b60f54560303c790: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:14.690398 16372 tablet_bootstrap.cc:492] T f2e7a37fcf7143c8894f9102bfe17da4 P 0c32b76f12b943d199444ef17ee4308b: No bootstrap required, opened a new log
I20260808 04:40:14.690471 16372 ts_tablet_manager.cc:1397] T f2e7a37fcf7143c8894f9102bfe17da4 P 0c32b76f12b943d199444ef17ee4308b: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 04:40:14.690873 16372 raft_consensus.cc:348] T f2e7a37fcf7143c8894f9102bfe17da4 P 0c32b76f12b943d199444ef17ee4308b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:14.690990 16372 raft_consensus.cc:374] T f2e7a37fcf7143c8894f9102bfe17da4 P 0c32b76f12b943d199444ef17ee4308b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:14.691018 16372 raft_consensus.cc:729] T f2e7a37fcf7143c8894f9102bfe17da4 P 0c32b76f12b943d199444ef17ee4308b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c32b76f12b943d199444ef17ee4308b, State: Initialized, Role: FOLLOWER
I20260808 04:40:14.691131 16372 consensus_queue.cc:260] T f2e7a37fcf7143c8894f9102bfe17da4 P 0c32b76f12b943d199444ef17ee4308b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:14.691365 16372 ts_tablet_manager.cc:1428] T f2e7a37fcf7143c8894f9102bfe17da4 P 0c32b76f12b943d199444ef17ee4308b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 04:40:14.691404 16450 ts_tablet_manager.cc:1918] T bded693cd1044cdd8ee1c4e0440481de P b45e1dd47fb74be3b60f54560303c790: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 04:40:14.691501 16450 log.cc:1196] T bded693cd1044cdd8ee1c4e0440481de P b45e1dd47fb74be3b60f54560303c790: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-0/wal/wals/bded693cd1044cdd8ee1c4e0440481de
I20260808 04:40:14.691814 16450 ts_tablet_manager.cc:1939] T bded693cd1044cdd8ee1c4e0440481de P b45e1dd47fb74be3b60f54560303c790: Deleting consensus metadata
I20260808 04:40:14.692943 15592 catalog_manager.cc:4841] TS b45e1dd47fb74be3b60f54560303c790 (127.12.148.65:36587): tablet bded693cd1044cdd8ee1c4e0440481de (table test-table [id=963bfd93f9af49719c2128d4dde8aecd]) successfully deleted
I20260808 04:40:14.693607 16447 ts_tablet_manager.cc:1918] T bded693cd1044cdd8ee1c4e0440481de P 80591840abe24dd1a2970a3ba0cf4eaa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 04:40:14.693822 16447 log.cc:1196] T bded693cd1044cdd8ee1c4e0440481de P 80591840abe24dd1a2970a3ba0cf4eaa: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-1/wal/wals/bded693cd1044cdd8ee1c4e0440481de
I20260808 04:40:14.694236 16447 ts_tablet_manager.cc:1939] T bded693cd1044cdd8ee1c4e0440481de P 80591840abe24dd1a2970a3ba0cf4eaa: Deleting consensus metadata
I20260808 04:40:14.695853 16375 tablet_bootstrap.cc:492] T f2e7a37fcf7143c8894f9102bfe17da4 P b45e1dd47fb74be3b60f54560303c790: No bootstrap required, opened a new log
I20260808 04:40:14.695943 16375 ts_tablet_manager.cc:1397] T f2e7a37fcf7143c8894f9102bfe17da4 P b45e1dd47fb74be3b60f54560303c790: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260808 04:40:14.696400 16375 raft_consensus.cc:348] T f2e7a37fcf7143c8894f9102bfe17da4 P b45e1dd47fb74be3b60f54560303c790 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:14.696516 16375 raft_consensus.cc:374] T f2e7a37fcf7143c8894f9102bfe17da4 P b45e1dd47fb74be3b60f54560303c790 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:14.696550 16375 raft_consensus.cc:729] T f2e7a37fcf7143c8894f9102bfe17da4 P b45e1dd47fb74be3b60f54560303c790 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b45e1dd47fb74be3b60f54560303c790, State: Initialized, Role: FOLLOWER
I20260808 04:40:14.696676 16375 consensus_queue.cc:260] T f2e7a37fcf7143c8894f9102bfe17da4 P b45e1dd47fb74be3b60f54560303c790 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:14.696940 16375 ts_tablet_manager.cc:1428] T f2e7a37fcf7143c8894f9102bfe17da4 P b45e1dd47fb74be3b60f54560303c790: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 04:40:14.698153 16373 tablet_bootstrap.cc:492] T f2e7a37fcf7143c8894f9102bfe17da4 P 80591840abe24dd1a2970a3ba0cf4eaa: No bootstrap required, opened a new log
I20260808 04:40:14.698243 16373 ts_tablet_manager.cc:1397] T f2e7a37fcf7143c8894f9102bfe17da4 P 80591840abe24dd1a2970a3ba0cf4eaa: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.002s
I20260808 04:40:14.698840 16373 raft_consensus.cc:348] T f2e7a37fcf7143c8894f9102bfe17da4 P 80591840abe24dd1a2970a3ba0cf4eaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:14.698954 16373 raft_consensus.cc:374] T f2e7a37fcf7143c8894f9102bfe17da4 P 80591840abe24dd1a2970a3ba0cf4eaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:14.698990 16373 raft_consensus.cc:729] T f2e7a37fcf7143c8894f9102bfe17da4 P 80591840abe24dd1a2970a3ba0cf4eaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80591840abe24dd1a2970a3ba0cf4eaa, State: Initialized, Role: FOLLOWER
I20260808 04:40:14.699115 16373 consensus_queue.cc:260] T f2e7a37fcf7143c8894f9102bfe17da4 P 80591840abe24dd1a2970a3ba0cf4eaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:14.699362 16373 ts_tablet_manager.cc:1428] T f2e7a37fcf7143c8894f9102bfe17da4 P 80591840abe24dd1a2970a3ba0cf4eaa: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 04:40:14.700402 15589 catalog_manager.cc:4841] TS 80591840abe24dd1a2970a3ba0cf4eaa (127.12.148.66:40497): tablet bded693cd1044cdd8ee1c4e0440481de (table test-table [id=963bfd93f9af49719c2128d4dde8aecd]) successfully deleted
I20260808 04:40:14.790766 16440 raft_consensus.cc:482] T f2e7a37fcf7143c8894f9102bfe17da4 P 80591840abe24dd1a2970a3ba0cf4eaa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:40:14.790915 16440 raft_consensus.cc:504] T f2e7a37fcf7143c8894f9102bfe17da4 P 80591840abe24dd1a2970a3ba0cf4eaa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:14.791364 16440 leader_election.cc:288] T f2e7a37fcf7143c8894f9102bfe17da4 P 80591840abe24dd1a2970a3ba0cf4eaa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b45e1dd47fb74be3b60f54560303c790 (127.12.148.65:36587), 0c32b76f12b943d199444ef17ee4308b (127.12.148.67:46617)
I20260808 04:40:14.791824 15854 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2e7a37fcf7143c8894f9102bfe17da4" candidate_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b45e1dd47fb74be3b60f54560303c790" is_pre_election: true
I20260808 04:40:14.791920 16270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2e7a37fcf7143c8894f9102bfe17da4" candidate_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c32b76f12b943d199444ef17ee4308b" is_pre_election: true
I20260808 04:40:14.791996 15854 raft_consensus.cc:2454] T f2e7a37fcf7143c8894f9102bfe17da4 P b45e1dd47fb74be3b60f54560303c790 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80591840abe24dd1a2970a3ba0cf4eaa in term 0.
I20260808 04:40:14.792065 16270 raft_consensus.cc:2454] T f2e7a37fcf7143c8894f9102bfe17da4 P 0c32b76f12b943d199444ef17ee4308b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80591840abe24dd1a2970a3ba0cf4eaa in term 0.
I20260808 04:40:14.792357 15959 leader_election.cc:302] T f2e7a37fcf7143c8894f9102bfe17da4 P 80591840abe24dd1a2970a3ba0cf4eaa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c32b76f12b943d199444ef17ee4308b, 80591840abe24dd1a2970a3ba0cf4eaa; no voters:
I20260808 04:40:14.792559 16440 raft_consensus.cc:2781] T f2e7a37fcf7143c8894f9102bfe17da4 P 80591840abe24dd1a2970a3ba0cf4eaa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:40:14.792626 16440 raft_consensus.cc:482] T f2e7a37fcf7143c8894f9102bfe17da4 P 80591840abe24dd1a2970a3ba0cf4eaa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:40:14.792672 16440 raft_consensus.cc:3037] T f2e7a37fcf7143c8894f9102bfe17da4 P 80591840abe24dd1a2970a3ba0cf4eaa [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:14.793763 16440 raft_consensus.cc:504] T f2e7a37fcf7143c8894f9102bfe17da4 P 80591840abe24dd1a2970a3ba0cf4eaa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:14.794111 16440 leader_election.cc:288] T f2e7a37fcf7143c8894f9102bfe17da4 P 80591840abe24dd1a2970a3ba0cf4eaa [CANDIDATE]: Term 1 election: Requested vote from peers b45e1dd47fb74be3b60f54560303c790 (127.12.148.65:36587), 0c32b76f12b943d199444ef17ee4308b (127.12.148.67:46617)
I20260808 04:40:14.794543 16270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2e7a37fcf7143c8894f9102bfe17da4" candidate_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c32b76f12b943d199444ef17ee4308b"
I20260808 04:40:14.794543 15854 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2e7a37fcf7143c8894f9102bfe17da4" candidate_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b45e1dd47fb74be3b60f54560303c790"
I20260808 04:40:14.794667 16270 raft_consensus.cc:3037] T f2e7a37fcf7143c8894f9102bfe17da4 P 0c32b76f12b943d199444ef17ee4308b [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:14.794667 15854 raft_consensus.cc:3037] T f2e7a37fcf7143c8894f9102bfe17da4 P b45e1dd47fb74be3b60f54560303c790 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:14.795749 16270 raft_consensus.cc:2454] T f2e7a37fcf7143c8894f9102bfe17da4 P 0c32b76f12b943d199444ef17ee4308b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80591840abe24dd1a2970a3ba0cf4eaa in term 1.
I20260808 04:40:14.795749 15854 raft_consensus.cc:2454] T f2e7a37fcf7143c8894f9102bfe17da4 P b45e1dd47fb74be3b60f54560303c790 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80591840abe24dd1a2970a3ba0cf4eaa in term 1.
I20260808 04:40:14.796037 15959 leader_election.cc:302] T f2e7a37fcf7143c8894f9102bfe17da4 P 80591840abe24dd1a2970a3ba0cf4eaa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c32b76f12b943d199444ef17ee4308b, 80591840abe24dd1a2970a3ba0cf4eaa; no voters:
I20260808 04:40:14.796249 16440 raft_consensus.cc:2781] T f2e7a37fcf7143c8894f9102bfe17da4 P 80591840abe24dd1a2970a3ba0cf4eaa [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:14.796346 16440 raft_consensus.cc:686] T f2e7a37fcf7143c8894f9102bfe17da4 P 80591840abe24dd1a2970a3ba0cf4eaa [term 1 LEADER]: Becoming Leader. State: Replica: 80591840abe24dd1a2970a3ba0cf4eaa, State: Running, Role: LEADER
I20260808 04:40:14.796480 16440 consensus_queue.cc:237] T f2e7a37fcf7143c8894f9102bfe17da4 P 80591840abe24dd1a2970a3ba0cf4eaa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:14.798179 15608 catalog_manager.cc:5495] T f2e7a37fcf7143c8894f9102bfe17da4 P 80591840abe24dd1a2970a3ba0cf4eaa reported cstate change: term changed from 0 to 1, leader changed from <none> to 80591840abe24dd1a2970a3ba0cf4eaa (127.12.148.66). New cstate: current_term: 1 leader_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } health_report { overall_health: UNKNOWN } } }
I20260808 04:40:14.818401 16270 raft_consensus.cc:1261] T f2e7a37fcf7143c8894f9102bfe17da4 P 0c32b76f12b943d199444ef17ee4308b [term 1 FOLLOWER]: Refusing update from remote peer 80591840abe24dd1a2970a3ba0cf4eaa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:14.818401 15854 raft_consensus.cc:1261] T f2e7a37fcf7143c8894f9102bfe17da4 P b45e1dd47fb74be3b60f54560303c790 [term 1 FOLLOWER]: Refusing update from remote peer 80591840abe24dd1a2970a3ba0cf4eaa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:14.818781 16440 consensus_queue.cc:1035] T f2e7a37fcf7143c8894f9102bfe17da4 P 80591840abe24dd1a2970a3ba0cf4eaa [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:14.818943 16392 consensus_queue.cc:1035] T f2e7a37fcf7143c8894f9102bfe17da4 P 80591840abe24dd1a2970a3ba0cf4eaa [LEADER]: Connected to new peer: Peer: permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 04:40:14.835659 16419 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 04:40:16.388794 15608 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34554:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:16.388952 15608 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34554:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:16.391108 15608 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 33a5ded9ceca4981b04941788592f599: Sending DeleteTablet for 3 replicas of tablet f2e7a37fcf7143c8894f9102bfe17da4
I20260808 04:40:16.391578 16033 tablet_service.cc:1514] Processing DeleteTablet for tablet f2e7a37fcf7143c8894f9102bfe17da4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:16 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:39080
I20260808 04:40:16.391605 15823 tablet_service.cc:1514] Processing DeleteTablet for tablet f2e7a37fcf7143c8894f9102bfe17da4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:16 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:35224
I20260808 04:40:16.391916 16492 tablet_replica.cc:330] T f2e7a37fcf7143c8894f9102bfe17da4 P 80591840abe24dd1a2970a3ba0cf4eaa: stopping tablet replica
I20260808 04:40:16.391925 16493 tablet_replica.cc:330] T f2e7a37fcf7143c8894f9102bfe17da4 P b45e1dd47fb74be3b60f54560303c790: stopping tablet replica
I20260808 04:40:16.391923 16240 tablet_service.cc:1514] Processing DeleteTablet for tablet f2e7a37fcf7143c8894f9102bfe17da4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:16 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:32844
I20260808 04:40:16.392045 16493 raft_consensus.cc:2229] T f2e7a37fcf7143c8894f9102bfe17da4 P b45e1dd47fb74be3b60f54560303c790 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:16.392045 16492 raft_consensus.cc:2229] T f2e7a37fcf7143c8894f9102bfe17da4 P 80591840abe24dd1a2970a3ba0cf4eaa [term 1 LEADER]: Raft consensus shutting down.
I20260808 04:40:16.392154 16493 raft_consensus.cc:2258] T f2e7a37fcf7143c8894f9102bfe17da4 P b45e1dd47fb74be3b60f54560303c790 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:16.392225 16492 raft_consensus.cc:2258] T f2e7a37fcf7143c8894f9102bfe17da4 P 80591840abe24dd1a2970a3ba0cf4eaa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:16.392714 16493 ts_tablet_manager.cc:1905] T f2e7a37fcf7143c8894f9102bfe17da4 P b45e1dd47fb74be3b60f54560303c790: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:16.392804 16492 ts_tablet_manager.cc:1905] T f2e7a37fcf7143c8894f9102bfe17da4 P 80591840abe24dd1a2970a3ba0cf4eaa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:16.395226 16493 ts_tablet_manager.cc:1918] T f2e7a37fcf7143c8894f9102bfe17da4 P b45e1dd47fb74be3b60f54560303c790: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 04:40:16.395306 16493 log.cc:1196] T f2e7a37fcf7143c8894f9102bfe17da4 P b45e1dd47fb74be3b60f54560303c790: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-0/wal/wals/f2e7a37fcf7143c8894f9102bfe17da4
I20260808 04:40:16.395445 16492 ts_tablet_manager.cc:1918] T f2e7a37fcf7143c8894f9102bfe17da4 P 80591840abe24dd1a2970a3ba0cf4eaa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 04:40:16.395546 16492 log.cc:1196] T f2e7a37fcf7143c8894f9102bfe17da4 P 80591840abe24dd1a2970a3ba0cf4eaa: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-1/wal/wals/f2e7a37fcf7143c8894f9102bfe17da4
I20260808 04:40:16.395582 16493 ts_tablet_manager.cc:1939] T f2e7a37fcf7143c8894f9102bfe17da4 P b45e1dd47fb74be3b60f54560303c790: Deleting consensus metadata
I20260808 04:40:16.395840 16492 ts_tablet_manager.cc:1939] T f2e7a37fcf7143c8894f9102bfe17da4 P 80591840abe24dd1a2970a3ba0cf4eaa: Deleting consensus metadata
I20260808 04:40:16.396055 16494 tablet_replica.cc:330] T f2e7a37fcf7143c8894f9102bfe17da4 P 0c32b76f12b943d199444ef17ee4308b: stopping tablet replica
I20260808 04:40:16.396181 16494 raft_consensus.cc:2229] T f2e7a37fcf7143c8894f9102bfe17da4 P 0c32b76f12b943d199444ef17ee4308b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:16.396209 15592 catalog_manager.cc:4841] TS b45e1dd47fb74be3b60f54560303c790 (127.12.148.65:36587): tablet f2e7a37fcf7143c8894f9102bfe17da4 (table test-table [id=6f52955a1382411a9a0b42fdfe45ca5c]) successfully deleted
I20260808 04:40:16.396303 16494 raft_consensus.cc:2258] T f2e7a37fcf7143c8894f9102bfe17da4 P 0c32b76f12b943d199444ef17ee4308b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:16.396553 15589 catalog_manager.cc:4841] TS 80591840abe24dd1a2970a3ba0cf4eaa (127.12.148.66:40497): tablet f2e7a37fcf7143c8894f9102bfe17da4 (table test-table [id=6f52955a1382411a9a0b42fdfe45ca5c]) successfully deleted
I20260808 04:40:16.396833 16494 ts_tablet_manager.cc:1905] T f2e7a37fcf7143c8894f9102bfe17da4 P 0c32b76f12b943d199444ef17ee4308b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:16.399297 16494 ts_tablet_manager.cc:1918] T f2e7a37fcf7143c8894f9102bfe17da4 P 0c32b76f12b943d199444ef17ee4308b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 04:40:16.399380 16494 log.cc:1196] T f2e7a37fcf7143c8894f9102bfe17da4 P 0c32b76f12b943d199444ef17ee4308b: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-2/wal/wals/f2e7a37fcf7143c8894f9102bfe17da4
I20260808 04:40:16.399659 16494 ts_tablet_manager.cc:1939] T f2e7a37fcf7143c8894f9102bfe17da4 P 0c32b76f12b943d199444ef17ee4308b: Deleting consensus metadata
I20260808 04:40:16.400308 15592 catalog_manager.cc:4841] TS 0c32b76f12b943d199444ef17ee4308b (127.12.148.67:46617): tablet f2e7a37fcf7143c8894f9102bfe17da4 (table test-table [id=6f52955a1382411a9a0b42fdfe45ca5c]) successfully deleted
Aug 08 04:40:16 dist-test-slave-t7g5 krb5kdc[15546](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164016, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 04:40:16 dist-test-slave-t7g5 krb5kdc[15546](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164016, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:40:16.424085 16506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:16.412967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34572 (local address 127.12.148.126:33293)
0808 04:40:16.413244 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:16.413252 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:16.413266 (+ 14us) server_negotiation.cc:407] Connection header received
0808 04:40:16.413410 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:16.413413 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:16.413460 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:16.413533 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:16.414274 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:16.414823 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:16.415687 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:16.415917 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:16.416013 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:16.421260 (+ 5247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:16.421263 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:16.421265 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:16.421288 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:16.422544 (+ 1256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:16.422919 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:16.422923 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:16.422924 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:16.423017 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:16.423264 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:16.423267 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:16.423269 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:16.423450 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:16.423570 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:16.423804 (+ 234us) server_negotiation.cc:299] Negotiation successful
0808 04:40:16.423923 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":97,"threads_started":1}
I20260808 04:40:16.426470 15608 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34572:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:40:16.426860 15608 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:40:16.431253 15823 tablet_service.cc:1467] Processing CreateTablet for tablet 1aa8526eaafb459e81bc1a78f2c0bc3c (DEFAULT_TABLE table=test-table [id=f8a25cb9d0214257976c0b8d2ca7c694]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:16.431298 16240 tablet_service.cc:1467] Processing CreateTablet for tablet 1aa8526eaafb459e81bc1a78f2c0bc3c (DEFAULT_TABLE table=test-table [id=f8a25cb9d0214257976c0b8d2ca7c694]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:16.431282 16033 tablet_service.cc:1467] Processing CreateTablet for tablet 1aa8526eaafb459e81bc1a78f2c0bc3c (DEFAULT_TABLE table=test-table [id=f8a25cb9d0214257976c0b8d2ca7c694]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:16.431553 15823 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1aa8526eaafb459e81bc1a78f2c0bc3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:16.431555 16240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1aa8526eaafb459e81bc1a78f2c0bc3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:16.431578 16033 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1aa8526eaafb459e81bc1a78f2c0bc3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:16.433786 16507 tablet_bootstrap.cc:492] T 1aa8526eaafb459e81bc1a78f2c0bc3c P 80591840abe24dd1a2970a3ba0cf4eaa: Bootstrap starting.
I20260808 04:40:16.434345 16508 tablet_bootstrap.cc:492] T 1aa8526eaafb459e81bc1a78f2c0bc3c P 0c32b76f12b943d199444ef17ee4308b: Bootstrap starting.
I20260808 04:40:16.434587 16509 tablet_bootstrap.cc:492] T 1aa8526eaafb459e81bc1a78f2c0bc3c P b45e1dd47fb74be3b60f54560303c790: Bootstrap starting.
I20260808 04:40:16.434676 16507 tablet_bootstrap.cc:654] T 1aa8526eaafb459e81bc1a78f2c0bc3c P 80591840abe24dd1a2970a3ba0cf4eaa: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:16.435221 16508 tablet_bootstrap.cc:654] T 1aa8526eaafb459e81bc1a78f2c0bc3c P 0c32b76f12b943d199444ef17ee4308b: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:16.435433 16509 tablet_bootstrap.cc:654] T 1aa8526eaafb459e81bc1a78f2c0bc3c P b45e1dd47fb74be3b60f54560303c790: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:16.435712 16507 tablet_bootstrap.cc:492] T 1aa8526eaafb459e81bc1a78f2c0bc3c P 80591840abe24dd1a2970a3ba0cf4eaa: No bootstrap required, opened a new log
I20260808 04:40:16.435797 16507 ts_tablet_manager.cc:1397] T 1aa8526eaafb459e81bc1a78f2c0bc3c P 80591840abe24dd1a2970a3ba0cf4eaa: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 04:40:16.436206 16507 raft_consensus.cc:348] T 1aa8526eaafb459e81bc1a78f2c0bc3c P 80591840abe24dd1a2970a3ba0cf4eaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:16.436318 16507 raft_consensus.cc:374] T 1aa8526eaafb459e81bc1a78f2c0bc3c P 80591840abe24dd1a2970a3ba0cf4eaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:16.436348 16507 raft_consensus.cc:729] T 1aa8526eaafb459e81bc1a78f2c0bc3c P 80591840abe24dd1a2970a3ba0cf4eaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80591840abe24dd1a2970a3ba0cf4eaa, State: Initialized, Role: FOLLOWER
I20260808 04:40:16.436542 16509 tablet_bootstrap.cc:492] T 1aa8526eaafb459e81bc1a78f2c0bc3c P b45e1dd47fb74be3b60f54560303c790: No bootstrap required, opened a new log
I20260808 04:40:16.436514 16507 consensus_queue.cc:260] T 1aa8526eaafb459e81bc1a78f2c0bc3c P 80591840abe24dd1a2970a3ba0cf4eaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:16.436623 16509 ts_tablet_manager.cc:1397] T 1aa8526eaafb459e81bc1a78f2c0bc3c P b45e1dd47fb74be3b60f54560303c790: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 04:40:16.436883 16507 ts_tablet_manager.cc:1428] T 1aa8526eaafb459e81bc1a78f2c0bc3c P 80591840abe24dd1a2970a3ba0cf4eaa: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 04:40:16.436990 16509 raft_consensus.cc:348] T 1aa8526eaafb459e81bc1a78f2c0bc3c P b45e1dd47fb74be3b60f54560303c790 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:16.437093 16509 raft_consensus.cc:374] T 1aa8526eaafb459e81bc1a78f2c0bc3c P b45e1dd47fb74be3b60f54560303c790 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:16.437124 16509 raft_consensus.cc:729] T 1aa8526eaafb459e81bc1a78f2c0bc3c P b45e1dd47fb74be3b60f54560303c790 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b45e1dd47fb74be3b60f54560303c790, State: Initialized, Role: FOLLOWER
I20260808 04:40:16.437274 16509 consensus_queue.cc:260] T 1aa8526eaafb459e81bc1a78f2c0bc3c P b45e1dd47fb74be3b60f54560303c790 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:16.437631 16509 ts_tablet_manager.cc:1428] T 1aa8526eaafb459e81bc1a78f2c0bc3c P b45e1dd47fb74be3b60f54560303c790: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 04:40:16.437683 16508 tablet_bootstrap.cc:492] T 1aa8526eaafb459e81bc1a78f2c0bc3c P 0c32b76f12b943d199444ef17ee4308b: No bootstrap required, opened a new log
I20260808 04:40:16.437755 16508 ts_tablet_manager.cc:1397] T 1aa8526eaafb459e81bc1a78f2c0bc3c P 0c32b76f12b943d199444ef17ee4308b: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 04:40:16.438202 16508 raft_consensus.cc:348] T 1aa8526eaafb459e81bc1a78f2c0bc3c P 0c32b76f12b943d199444ef17ee4308b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:16.438319 16508 raft_consensus.cc:374] T 1aa8526eaafb459e81bc1a78f2c0bc3c P 0c32b76f12b943d199444ef17ee4308b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:16.438352 16508 raft_consensus.cc:729] T 1aa8526eaafb459e81bc1a78f2c0bc3c P 0c32b76f12b943d199444ef17ee4308b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c32b76f12b943d199444ef17ee4308b, State: Initialized, Role: FOLLOWER
I20260808 04:40:16.438469 16508 consensus_queue.cc:260] T 1aa8526eaafb459e81bc1a78f2c0bc3c P 0c32b76f12b943d199444ef17ee4308b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:16.438889 16508 ts_tablet_manager.cc:1428] T 1aa8526eaafb459e81bc1a78f2c0bc3c P 0c32b76f12b943d199444ef17ee4308b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 04:40:16.526604 16382 raft_consensus.cc:482] T 1aa8526eaafb459e81bc1a78f2c0bc3c P b45e1dd47fb74be3b60f54560303c790 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:40:16.526750 16382 raft_consensus.cc:504] T 1aa8526eaafb459e81bc1a78f2c0bc3c P b45e1dd47fb74be3b60f54560303c790 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:16.527156 16382 leader_election.cc:288] T 1aa8526eaafb459e81bc1a78f2c0bc3c P b45e1dd47fb74be3b60f54560303c790 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80591840abe24dd1a2970a3ba0cf4eaa (127.12.148.66:40497), 0c32b76f12b943d199444ef17ee4308b (127.12.148.67:46617)
I20260808 04:40:16.527585 16060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1aa8526eaafb459e81bc1a78f2c0bc3c" candidate_uuid: "b45e1dd47fb74be3b60f54560303c790" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" is_pre_election: true
I20260808 04:40:16.527616 16269 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1aa8526eaafb459e81bc1a78f2c0bc3c" candidate_uuid: "b45e1dd47fb74be3b60f54560303c790" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c32b76f12b943d199444ef17ee4308b" is_pre_election: true
I20260808 04:40:16.527747 16060 raft_consensus.cc:2454] T 1aa8526eaafb459e81bc1a78f2c0bc3c P 80591840abe24dd1a2970a3ba0cf4eaa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b45e1dd47fb74be3b60f54560303c790 in term 0.
I20260808 04:40:16.527766 16269 raft_consensus.cc:2454] T 1aa8526eaafb459e81bc1a78f2c0bc3c P 0c32b76f12b943d199444ef17ee4308b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b45e1dd47fb74be3b60f54560303c790 in term 0.
I20260808 04:40:16.528115 15755 leader_election.cc:302] T 1aa8526eaafb459e81bc1a78f2c0bc3c P b45e1dd47fb74be3b60f54560303c790 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0c32b76f12b943d199444ef17ee4308b, 80591840abe24dd1a2970a3ba0cf4eaa, b45e1dd47fb74be3b60f54560303c790; no voters:
I20260808 04:40:16.528301 16382 raft_consensus.cc:2781] T 1aa8526eaafb459e81bc1a78f2c0bc3c P b45e1dd47fb74be3b60f54560303c790 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:40:16.528365 16382 raft_consensus.cc:482] T 1aa8526eaafb459e81bc1a78f2c0bc3c P b45e1dd47fb74be3b60f54560303c790 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:40:16.528415 16382 raft_consensus.cc:3037] T 1aa8526eaafb459e81bc1a78f2c0bc3c P b45e1dd47fb74be3b60f54560303c790 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:16.529434 16382 raft_consensus.cc:504] T 1aa8526eaafb459e81bc1a78f2c0bc3c P b45e1dd47fb74be3b60f54560303c790 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:16.529801 16382 leader_election.cc:288] T 1aa8526eaafb459e81bc1a78f2c0bc3c P b45e1dd47fb74be3b60f54560303c790 [CANDIDATE]: Term 1 election: Requested vote from peers 80591840abe24dd1a2970a3ba0cf4eaa (127.12.148.66:40497), 0c32b76f12b943d199444ef17ee4308b (127.12.148.67:46617)
I20260808 04:40:16.530140 16060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1aa8526eaafb459e81bc1a78f2c0bc3c" candidate_uuid: "b45e1dd47fb74be3b60f54560303c790" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80591840abe24dd1a2970a3ba0cf4eaa"
I20260808 04:40:16.530174 16269 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1aa8526eaafb459e81bc1a78f2c0bc3c" candidate_uuid: "b45e1dd47fb74be3b60f54560303c790" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c32b76f12b943d199444ef17ee4308b"
I20260808 04:40:16.530256 16060 raft_consensus.cc:3037] T 1aa8526eaafb459e81bc1a78f2c0bc3c P 80591840abe24dd1a2970a3ba0cf4eaa [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:16.530282 16269 raft_consensus.cc:3037] T 1aa8526eaafb459e81bc1a78f2c0bc3c P 0c32b76f12b943d199444ef17ee4308b [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:16.531219 16060 raft_consensus.cc:2454] T 1aa8526eaafb459e81bc1a78f2c0bc3c P 80591840abe24dd1a2970a3ba0cf4eaa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b45e1dd47fb74be3b60f54560303c790 in term 1.
I20260808 04:40:16.531332 16269 raft_consensus.cc:2454] T 1aa8526eaafb459e81bc1a78f2c0bc3c P 0c32b76f12b943d199444ef17ee4308b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b45e1dd47fb74be3b60f54560303c790 in term 1.
I20260808 04:40:16.531478 15755 leader_election.cc:302] T 1aa8526eaafb459e81bc1a78f2c0bc3c P b45e1dd47fb74be3b60f54560303c790 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80591840abe24dd1a2970a3ba0cf4eaa, b45e1dd47fb74be3b60f54560303c790; no voters:
I20260808 04:40:16.531690 16382 raft_consensus.cc:2781] T 1aa8526eaafb459e81bc1a78f2c0bc3c P b45e1dd47fb74be3b60f54560303c790 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:16.531769 16382 raft_consensus.cc:686] T 1aa8526eaafb459e81bc1a78f2c0bc3c P b45e1dd47fb74be3b60f54560303c790 [term 1 LEADER]: Becoming Leader. State: Replica: b45e1dd47fb74be3b60f54560303c790, State: Running, Role: LEADER
I20260808 04:40:16.531899 16382 consensus_queue.cc:237] T 1aa8526eaafb459e81bc1a78f2c0bc3c P b45e1dd47fb74be3b60f54560303c790 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:16.533502 15608 catalog_manager.cc:5495] T 1aa8526eaafb459e81bc1a78f2c0bc3c P b45e1dd47fb74be3b60f54560303c790 reported cstate change: term changed from 0 to 1, leader changed from <none> to b45e1dd47fb74be3b60f54560303c790 (127.12.148.65). New cstate: current_term: 1 leader_uuid: "b45e1dd47fb74be3b60f54560303c790" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } health_report { overall_health: UNKNOWN } } }
I20260808 04:40:16.562536 16523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:16.559563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35246 (local address 127.12.148.65:36587)
0808 04:40:16.559822 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:16.559834 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:16.559851 (+ 17us) server_negotiation.cc:407] Connection header received
0808 04:40:16.559894 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:16.559896 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:16.559937 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:16.560016 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:16.560215 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:16.560736 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:16.561602 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:16.561860 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:16.561932 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:16.562160 (+ 228us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:16.562227 (+ 67us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:16.562275 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:16.562347 (+ 72us) server_negotiation.cc:299] Negotiation successful
0808 04:40:16.562392 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":113,"threads_started":1}
I20260808 04:40:16.570791 16523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:16.567971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:40433 (local address 127.12.148.65:36587)
0808 04:40:16.568054 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:16.568057 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:16.568230 (+ 173us) server_negotiation.cc:407] Connection header received
0808 04:40:16.568341 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:16.568344 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:16.568401 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:16.568464 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:16.568684 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:16.569190 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:16.570008 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:16.570210 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:16.570282 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:16.570459 (+ 177us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:16.570517 (+ 58us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:16.570565 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:16.570636 (+ 71us) server_negotiation.cc:299] Negotiation successful
0808 04:40:16.570682 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":20,"server-negotiator.queue_time_us":25}
I20260808 04:40:16.570813 16526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:16.567913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:36587 (local address 127.12.148.65:40433)
0808 04:40:16.568167 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:16.568180 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:16.568271 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:16.568487 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:16.568489 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:16.568496 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 04:40:16.568585 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:16.568589 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:16.569278 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:16.569280 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:16.569923 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:16.569932 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:16.570289 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:16.570291 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:16.570362 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:16.570384 (+ 22us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 04:40:16.570572 (+ 188us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 04:40:16.570576 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 04:40:16.570627 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 04:40:16.570690 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"mutex_wait_us":1,"thread_start_us":113,"threads_started":1}
I20260808 04:40:16.577885 16269 raft_consensus.cc:1261] T 1aa8526eaafb459e81bc1a78f2c0bc3c P 0c32b76f12b943d199444ef17ee4308b [term 1 FOLLOWER]: Refusing update from remote peer b45e1dd47fb74be3b60f54560303c790: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:16.578214 16060 raft_consensus.cc:1261] T 1aa8526eaafb459e81bc1a78f2c0bc3c P 80591840abe24dd1a2970a3ba0cf4eaa [term 1 FOLLOWER]: Refusing update from remote peer b45e1dd47fb74be3b60f54560303c790: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:16.578267 16382 consensus_queue.cc:1035] T 1aa8526eaafb459e81bc1a78f2c0bc3c P b45e1dd47fb74be3b60f54560303c790 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:16.578581 16382 consensus_queue.cc:1035] T 1aa8526eaafb459e81bc1a78f2c0bc3c P b45e1dd47fb74be3b60f54560303c790 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:16.610025 15609 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:16.610198 15609 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:16.612339 15609 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 33a5ded9ceca4981b04941788592f599: Sending DeleteTablet for 3 replicas of tablet 1aa8526eaafb459e81bc1a78f2c0bc3c
I20260808 04:40:16.612843 15823 tablet_service.cc:1514] Processing DeleteTablet for tablet 1aa8526eaafb459e81bc1a78f2c0bc3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:16 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:35224
I20260808 04:40:16.613024 16493 tablet_replica.cc:330] T 1aa8526eaafb459e81bc1a78f2c0bc3c P b45e1dd47fb74be3b60f54560303c790: stopping tablet replica
I20260808 04:40:16.613015 16240 tablet_service.cc:1514] Processing DeleteTablet for tablet 1aa8526eaafb459e81bc1a78f2c0bc3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:16 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:32844
I20260808 04:40:16.613142 16493 raft_consensus.cc:2229] T 1aa8526eaafb459e81bc1a78f2c0bc3c P b45e1dd47fb74be3b60f54560303c790 [term 1 LEADER]: Raft consensus shutting down.
I20260808 04:40:16.613198 16494 tablet_replica.cc:330] T 1aa8526eaafb459e81bc1a78f2c0bc3c P 0c32b76f12b943d199444ef17ee4308b: stopping tablet replica
I20260808 04:40:16.613300 16494 raft_consensus.cc:2229] T 1aa8526eaafb459e81bc1a78f2c0bc3c P 0c32b76f12b943d199444ef17ee4308b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:16.613399 16494 raft_consensus.cc:2258] T 1aa8526eaafb459e81bc1a78f2c0bc3c P 0c32b76f12b943d199444ef17ee4308b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:16.613409 16493 raft_consensus.cc:2258] T 1aa8526eaafb459e81bc1a78f2c0bc3c P b45e1dd47fb74be3b60f54560303c790 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:16.614053 16033 tablet_service.cc:1514] Processing DeleteTablet for tablet 1aa8526eaafb459e81bc1a78f2c0bc3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:16 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:39080
I20260808 04:40:16.614140 16493 ts_tablet_manager.cc:1905] T 1aa8526eaafb459e81bc1a78f2c0bc3c P b45e1dd47fb74be3b60f54560303c790: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:16.614140 16494 ts_tablet_manager.cc:1905] T 1aa8526eaafb459e81bc1a78f2c0bc3c P 0c32b76f12b943d199444ef17ee4308b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:16.614230 16492 tablet_replica.cc:330] T 1aa8526eaafb459e81bc1a78f2c0bc3c P 80591840abe24dd1a2970a3ba0cf4eaa: stopping tablet replica
I20260808 04:40:16.614326 16492 raft_consensus.cc:2229] T 1aa8526eaafb459e81bc1a78f2c0bc3c P 80591840abe24dd1a2970a3ba0cf4eaa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:16.614426 16492 raft_consensus.cc:2258] T 1aa8526eaafb459e81bc1a78f2c0bc3c P 80591840abe24dd1a2970a3ba0cf4eaa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:16.614777 15609 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34572:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:40:16.615164 15609 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:40:16.616241 16492 ts_tablet_manager.cc:1905] T 1aa8526eaafb459e81bc1a78f2c0bc3c P 80591840abe24dd1a2970a3ba0cf4eaa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:16.616750 16494 ts_tablet_manager.cc:1918] T 1aa8526eaafb459e81bc1a78f2c0bc3c P 0c32b76f12b943d199444ef17ee4308b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 04:40:16.616753 16493 ts_tablet_manager.cc:1918] T 1aa8526eaafb459e81bc1a78f2c0bc3c P b45e1dd47fb74be3b60f54560303c790: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 04:40:16.616816 16493 log.cc:1196] T 1aa8526eaafb459e81bc1a78f2c0bc3c P b45e1dd47fb74be3b60f54560303c790: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-0/wal/wals/1aa8526eaafb459e81bc1a78f2c0bc3c
I20260808 04:40:16.616822 16494 log.cc:1196] T 1aa8526eaafb459e81bc1a78f2c0bc3c P 0c32b76f12b943d199444ef17ee4308b: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-2/wal/wals/1aa8526eaafb459e81bc1a78f2c0bc3c
I20260808 04:40:16.617066 16494 ts_tablet_manager.cc:1939] T 1aa8526eaafb459e81bc1a78f2c0bc3c P 0c32b76f12b943d199444ef17ee4308b: Deleting consensus metadata
I20260808 04:40:16.617441 16493 ts_tablet_manager.cc:1939] T 1aa8526eaafb459e81bc1a78f2c0bc3c P b45e1dd47fb74be3b60f54560303c790: Deleting consensus metadata
I20260808 04:40:16.618628 16492 ts_tablet_manager.cc:1918] T 1aa8526eaafb459e81bc1a78f2c0bc3c P 80591840abe24dd1a2970a3ba0cf4eaa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 04:40:16.618696 16492 log.cc:1196] T 1aa8526eaafb459e81bc1a78f2c0bc3c P 80591840abe24dd1a2970a3ba0cf4eaa: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-1/wal/wals/1aa8526eaafb459e81bc1a78f2c0bc3c
I20260808 04:40:16.618902 16492 ts_tablet_manager.cc:1939] T 1aa8526eaafb459e81bc1a78f2c0bc3c P 80591840abe24dd1a2970a3ba0cf4eaa: Deleting consensus metadata
I20260808 04:40:16.619439 15592 catalog_manager.cc:4841] TS b45e1dd47fb74be3b60f54560303c790 (127.12.148.65:36587): tablet 1aa8526eaafb459e81bc1a78f2c0bc3c (table test-table [id=f8a25cb9d0214257976c0b8d2ca7c694]) successfully deleted
I20260808 04:40:16.619594 15592 catalog_manager.cc:4841] TS 0c32b76f12b943d199444ef17ee4308b (127.12.148.67:46617): tablet 1aa8526eaafb459e81bc1a78f2c0bc3c (table test-table [id=f8a25cb9d0214257976c0b8d2ca7c694]) successfully deleted
I20260808 04:40:16.619800 15589 catalog_manager.cc:4841] TS 80591840abe24dd1a2970a3ba0cf4eaa (127.12.148.66:40497): tablet 1aa8526eaafb459e81bc1a78f2c0bc3c (table test-table [id=f8a25cb9d0214257976c0b8d2ca7c694]) successfully deleted
I20260808 04:40:16.623493 15823 tablet_service.cc:1467] Processing CreateTablet for tablet 9450ffe8e08143f9aed1d8eea0df3793 (DEFAULT_TABLE table=test-table [id=39f55079b9214ebb8140fe2c30b96691]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:16.623679 16033 tablet_service.cc:1467] Processing CreateTablet for tablet 9450ffe8e08143f9aed1d8eea0df3793 (DEFAULT_TABLE table=test-table [id=39f55079b9214ebb8140fe2c30b96691]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:16.623679 16240 tablet_service.cc:1467] Processing CreateTablet for tablet 9450ffe8e08143f9aed1d8eea0df3793 (DEFAULT_TABLE table=test-table [id=39f55079b9214ebb8140fe2c30b96691]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:16.623777 15823 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9450ffe8e08143f9aed1d8eea0df3793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:16.623919 16240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9450ffe8e08143f9aed1d8eea0df3793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:16.623921 16033 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9450ffe8e08143f9aed1d8eea0df3793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:16.626083 16508 tablet_bootstrap.cc:492] T 9450ffe8e08143f9aed1d8eea0df3793 P 0c32b76f12b943d199444ef17ee4308b: Bootstrap starting.
I20260808 04:40:16.626142 16507 tablet_bootstrap.cc:492] T 9450ffe8e08143f9aed1d8eea0df3793 P 80591840abe24dd1a2970a3ba0cf4eaa: Bootstrap starting.
I20260808 04:40:16.626935 16507 tablet_bootstrap.cc:654] T 9450ffe8e08143f9aed1d8eea0df3793 P 80591840abe24dd1a2970a3ba0cf4eaa: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:16.627065 16508 tablet_bootstrap.cc:654] T 9450ffe8e08143f9aed1d8eea0df3793 P 0c32b76f12b943d199444ef17ee4308b: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:16.627980 16509 tablet_bootstrap.cc:492] T 9450ffe8e08143f9aed1d8eea0df3793 P b45e1dd47fb74be3b60f54560303c790: Bootstrap starting.
I20260808 04:40:16.628214 16507 tablet_bootstrap.cc:492] T 9450ffe8e08143f9aed1d8eea0df3793 P 80591840abe24dd1a2970a3ba0cf4eaa: No bootstrap required, opened a new log
I20260808 04:40:16.628294 16507 ts_tablet_manager.cc:1397] T 9450ffe8e08143f9aed1d8eea0df3793 P 80591840abe24dd1a2970a3ba0cf4eaa: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 04:40:16.628633 16507 raft_consensus.cc:348] T 9450ffe8e08143f9aed1d8eea0df3793 P 80591840abe24dd1a2970a3ba0cf4eaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:16.628731 16507 raft_consensus.cc:374] T 9450ffe8e08143f9aed1d8eea0df3793 P 80591840abe24dd1a2970a3ba0cf4eaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:16.628762 16507 raft_consensus.cc:729] T 9450ffe8e08143f9aed1d8eea0df3793 P 80591840abe24dd1a2970a3ba0cf4eaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80591840abe24dd1a2970a3ba0cf4eaa, State: Initialized, Role: FOLLOWER
I20260808 04:40:16.628823 16509 tablet_bootstrap.cc:654] T 9450ffe8e08143f9aed1d8eea0df3793 P b45e1dd47fb74be3b60f54560303c790: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:16.628880 16507 consensus_queue.cc:260] T 9450ffe8e08143f9aed1d8eea0df3793 P 80591840abe24dd1a2970a3ba0cf4eaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:16.629129 16507 ts_tablet_manager.cc:1428] T 9450ffe8e08143f9aed1d8eea0df3793 P 80591840abe24dd1a2970a3ba0cf4eaa: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 04:40:16.629722 16508 tablet_bootstrap.cc:492] T 9450ffe8e08143f9aed1d8eea0df3793 P 0c32b76f12b943d199444ef17ee4308b: No bootstrap required, opened a new log
I20260808 04:40:16.629808 16508 ts_tablet_manager.cc:1397] T 9450ffe8e08143f9aed1d8eea0df3793 P 0c32b76f12b943d199444ef17ee4308b: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260808 04:40:16.630239 16508 raft_consensus.cc:348] T 9450ffe8e08143f9aed1d8eea0df3793 P 0c32b76f12b943d199444ef17ee4308b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:16.630375 16508 raft_consensus.cc:374] T 9450ffe8e08143f9aed1d8eea0df3793 P 0c32b76f12b943d199444ef17ee4308b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:16.630406 16508 raft_consensus.cc:729] T 9450ffe8e08143f9aed1d8eea0df3793 P 0c32b76f12b943d199444ef17ee4308b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c32b76f12b943d199444ef17ee4308b, State: Initialized, Role: FOLLOWER
I20260808 04:40:16.630566 16508 consensus_queue.cc:260] T 9450ffe8e08143f9aed1d8eea0df3793 P 0c32b76f12b943d199444ef17ee4308b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:16.631166 16509 tablet_bootstrap.cc:492] T 9450ffe8e08143f9aed1d8eea0df3793 P b45e1dd47fb74be3b60f54560303c790: No bootstrap required, opened a new log
I20260808 04:40:16.631255 16509 ts_tablet_manager.cc:1397] T 9450ffe8e08143f9aed1d8eea0df3793 P b45e1dd47fb74be3b60f54560303c790: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260808 04:40:16.631628 16509 raft_consensus.cc:348] T 9450ffe8e08143f9aed1d8eea0df3793 P b45e1dd47fb74be3b60f54560303c790 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:16.631736 16509 raft_consensus.cc:374] T 9450ffe8e08143f9aed1d8eea0df3793 P b45e1dd47fb74be3b60f54560303c790 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:16.631767 16509 raft_consensus.cc:729] T 9450ffe8e08143f9aed1d8eea0df3793 P b45e1dd47fb74be3b60f54560303c790 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b45e1dd47fb74be3b60f54560303c790, State: Initialized, Role: FOLLOWER
I20260808 04:40:16.631873 16509 consensus_queue.cc:260] T 9450ffe8e08143f9aed1d8eea0df3793 P b45e1dd47fb74be3b60f54560303c790 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:16.632119 16509 ts_tablet_manager.cc:1428] T 9450ffe8e08143f9aed1d8eea0df3793 P b45e1dd47fb74be3b60f54560303c790: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 04:40:16.632753 16508 ts_tablet_manager.cc:1428] T 9450ffe8e08143f9aed1d8eea0df3793 P 0c32b76f12b943d199444ef17ee4308b: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260808 04:40:16.690322 16517 raft_consensus.cc:482] T 9450ffe8e08143f9aed1d8eea0df3793 P 0c32b76f12b943d199444ef17ee4308b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:40:16.690465 16517 raft_consensus.cc:504] T 9450ffe8e08143f9aed1d8eea0df3793 P 0c32b76f12b943d199444ef17ee4308b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:16.691536 16517 leader_election.cc:288] T 9450ffe8e08143f9aed1d8eea0df3793 P 0c32b76f12b943d199444ef17ee4308b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b45e1dd47fb74be3b60f54560303c790 (127.12.148.65:36587), 80591840abe24dd1a2970a3ba0cf4eaa (127.12.148.66:40497)
I20260808 04:40:16.696255 16539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:16.691912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:37151 (local address 127.12.148.66:40497)
0808 04:40:16.692419 (+ 507us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:16.692432 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:16.692444 (+ 12us) server_negotiation.cc:407] Connection header received
0808 04:40:16.692492 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:16.692494 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:16.692536 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:16.692622 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:16.692973 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:16.693801 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:16.694980 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:16.695630 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:16.695753 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:16.695809 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:16.696033 (+ 224us) server_negotiation.cc:299] Negotiation successful
0808 04:40:16.696115 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":436,"thread_start_us":61,"threads_started":1}
I20260808 04:40:16.696420 16523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:16.692147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:48869 (local address 127.12.148.65:36587)
0808 04:40:16.692273 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:16.692277 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:16.692291 (+ 14us) server_negotiation.cc:407] Connection header received
0808 04:40:16.692343 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:16.692346 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:16.692391 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:16.692479 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:16.692768 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:16.693515 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:16.695174 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:16.695768 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:16.695874 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:16.695919 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:16.696231 (+ 312us) server_negotiation.cc:299] Negotiation successful
0808 04:40:16.696313 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 04:40:16.696416 16537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:16.691775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:40497 (local address 127.12.148.67:37151)
0808 04:40:16.692115 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:16.692128 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:16.692222 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:16.692661 (+ 439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:16.692664 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:16.692684 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:16.692838 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:16.692846 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:16.693930 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:16.693933 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:16.694854 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:16.694864 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:16.695759 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:16.695764 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:16.695886 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:16.695916 (+ 30us) client_negotiation.cc:769] Sending connection context
0808 04:40:16.695999 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 04:40:16.696073 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"spinlock_wait_cycles":25344,"thread_start_us":86,"threads_started":1}
I20260808 04:40:16.696926 16536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:16.691753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:36587 (local address 127.12.148.67:48869)
0808 04:40:16.692083 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:16.692098 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:16.692222 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:16.692493 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:16.692496 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:16.692515 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:16.692653 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:16.692661 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:16.693637 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:16.693641 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:16.695006 (+ 1365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:16.695019 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:16.695973 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:16.695977 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:16.696088 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:16.696112 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 04:40:16.696696 (+ 584us) client_negotiation.cc:240] Negotiation successful
0808 04:40:16.696776 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"spinlock_wait_cycles":5632,"thread_start_us":119,"threads_started":1}
I20260808 04:40:16.696952 16059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9450ffe8e08143f9aed1d8eea0df3793" candidate_uuid: "0c32b76f12b943d199444ef17ee4308b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" is_pre_election: true
I20260808 04:40:16.697115 16059 raft_consensus.cc:2454] T 9450ffe8e08143f9aed1d8eea0df3793 P 80591840abe24dd1a2970a3ba0cf4eaa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c32b76f12b943d199444ef17ee4308b in term 0.
I20260808 04:40:16.697504 16167 leader_election.cc:302] T 9450ffe8e08143f9aed1d8eea0df3793 P 0c32b76f12b943d199444ef17ee4308b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c32b76f12b943d199444ef17ee4308b, 80591840abe24dd1a2970a3ba0cf4eaa; no voters:
I20260808 04:40:16.697690 15854 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9450ffe8e08143f9aed1d8eea0df3793" candidate_uuid: "0c32b76f12b943d199444ef17ee4308b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b45e1dd47fb74be3b60f54560303c790" is_pre_election: true
I20260808 04:40:16.697803 16517 raft_consensus.cc:2781] T 9450ffe8e08143f9aed1d8eea0df3793 P 0c32b76f12b943d199444ef17ee4308b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:40:16.697831 15854 raft_consensus.cc:2454] T 9450ffe8e08143f9aed1d8eea0df3793 P b45e1dd47fb74be3b60f54560303c790 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c32b76f12b943d199444ef17ee4308b in term 0.
I20260808 04:40:16.697857 16517 raft_consensus.cc:482] T 9450ffe8e08143f9aed1d8eea0df3793 P 0c32b76f12b943d199444ef17ee4308b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:40:16.697886 16517 raft_consensus.cc:3037] T 9450ffe8e08143f9aed1d8eea0df3793 P 0c32b76f12b943d199444ef17ee4308b [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:16.698889 16517 raft_consensus.cc:504] T 9450ffe8e08143f9aed1d8eea0df3793 P 0c32b76f12b943d199444ef17ee4308b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:16.699185 16517 leader_election.cc:288] T 9450ffe8e08143f9aed1d8eea0df3793 P 0c32b76f12b943d199444ef17ee4308b [CANDIDATE]: Term 1 election: Requested vote from peers b45e1dd47fb74be3b60f54560303c790 (127.12.148.65:36587), 80591840abe24dd1a2970a3ba0cf4eaa (127.12.148.66:40497)
I20260808 04:40:16.699505 15854 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9450ffe8e08143f9aed1d8eea0df3793" candidate_uuid: "0c32b76f12b943d199444ef17ee4308b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b45e1dd47fb74be3b60f54560303c790"
I20260808 04:40:16.699623 15854 raft_consensus.cc:3037] T 9450ffe8e08143f9aed1d8eea0df3793 P b45e1dd47fb74be3b60f54560303c790 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:16.700707 15854 raft_consensus.cc:2454] T 9450ffe8e08143f9aed1d8eea0df3793 P b45e1dd47fb74be3b60f54560303c790 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c32b76f12b943d199444ef17ee4308b in term 1.
I20260808 04:40:16.700992 16170 leader_election.cc:302] T 9450ffe8e08143f9aed1d8eea0df3793 P 0c32b76f12b943d199444ef17ee4308b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c32b76f12b943d199444ef17ee4308b, b45e1dd47fb74be3b60f54560303c790; no voters:
I20260808 04:40:16.701045 16059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9450ffe8e08143f9aed1d8eea0df3793" candidate_uuid: "0c32b76f12b943d199444ef17ee4308b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80591840abe24dd1a2970a3ba0cf4eaa"
I20260808 04:40:16.701169 16059 raft_consensus.cc:3037] T 9450ffe8e08143f9aed1d8eea0df3793 P 80591840abe24dd1a2970a3ba0cf4eaa [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:16.701205 16517 raft_consensus.cc:2781] T 9450ffe8e08143f9aed1d8eea0df3793 P 0c32b76f12b943d199444ef17ee4308b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:16.701426 16517 raft_consensus.cc:686] T 9450ffe8e08143f9aed1d8eea0df3793 P 0c32b76f12b943d199444ef17ee4308b [term 1 LEADER]: Becoming Leader. State: Replica: 0c32b76f12b943d199444ef17ee4308b, State: Running, Role: LEADER
I20260808 04:40:16.701735 16517 consensus_queue.cc:237] T 9450ffe8e08143f9aed1d8eea0df3793 P 0c32b76f12b943d199444ef17ee4308b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } }
I20260808 04:40:16.702356 16059 raft_consensus.cc:2454] T 9450ffe8e08143f9aed1d8eea0df3793 P 80591840abe24dd1a2970a3ba0cf4eaa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c32b76f12b943d199444ef17ee4308b in term 1.
I20260808 04:40:16.704114 15606 catalog_manager.cc:5495] T 9450ffe8e08143f9aed1d8eea0df3793 P 0c32b76f12b943d199444ef17ee4308b reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c32b76f12b943d199444ef17ee4308b (127.12.148.67). New cstate: current_term: 1 leader_uuid: "0c32b76f12b943d199444ef17ee4308b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c32b76f12b943d199444ef17ee4308b" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 46617 } health_report { overall_health: HEALTHY } } }
I20260808 04:40:16.739049 16544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:16.734988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32848 (local address 127.12.148.67:46617)
0808 04:40:16.735349 (+ 361us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:16.735356 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:16.735366 (+ 10us) server_negotiation.cc:407] Connection header received
0808 04:40:16.735441 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:16.735443 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:16.735505 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:16.735603 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:16.735882 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:16.736424 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:16.737541 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:16.737801 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:16.737878 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:16.738136 (+ 258us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:16.738658 (+ 522us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:16.738747 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:16.738834 (+ 87us) server_negotiation.cc:299] Negotiation successful
0808 04:40:16.738884 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300,"thread_start_us":130,"threads_started":1}
I20260808 04:40:16.749775 16547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:16.746146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:36587 (local address 127.12.148.67:52607)
0808 04:40:16.746430 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:16.746446 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:16.746544 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:16.746802 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:16.746804 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:16.746811 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 04:40:16.746933 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:16.746937 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:16.747913 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:16.747915 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:16.748519 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:16.748526 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:16.749064 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:16.749068 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:16.749146 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:16.749195 (+ 49us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 04:40:16.749484 (+ 289us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 04:40:16.749488 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 04:40:16.749530 (+ 42us) client_negotiation.cc:240] Negotiation successful
0808 04:40:16.749595 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":85,"threads_started":1}
I20260808 04:40:16.749779 16523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:16.746467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:52607 (local address 127.12.148.65:36587)
0808 04:40:16.746589 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:16.746594 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:16.746606 (+ 12us) server_negotiation.cc:407] Connection header received
0808 04:40:16.746656 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:16.746659 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:16.746713 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:16.746801 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:16.747029 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:16.747812 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:16.748629 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:16.748943 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:16.749048 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:16.749320 (+ 272us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:16.749404 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:16.749480 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:16.749542 (+ 62us) server_negotiation.cc:299] Negotiation successful
0808 04:40:16.749600 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 04:40:16.756726 15854 raft_consensus.cc:1261] T 9450ffe8e08143f9aed1d8eea0df3793 P b45e1dd47fb74be3b60f54560303c790 [term 1 FOLLOWER]: Refusing update from remote peer 0c32b76f12b943d199444ef17ee4308b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:16.756754 16059 raft_consensus.cc:1261] T 9450ffe8e08143f9aed1d8eea0df3793 P 80591840abe24dd1a2970a3ba0cf4eaa [term 1 FOLLOWER]: Refusing update from remote peer 0c32b76f12b943d199444ef17ee4308b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:16.757270 16540 consensus_queue.cc:1035] T 9450ffe8e08143f9aed1d8eea0df3793 P 0c32b76f12b943d199444ef17ee4308b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b45e1dd47fb74be3b60f54560303c790" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 36587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:16.757455 16517 consensus_queue.cc:1035] T 9450ffe8e08143f9aed1d8eea0df3793 P 0c32b76f12b943d199444ef17ee4308b [LEADER]: Connected to new peer: Peer: permanent_uuid: "80591840abe24dd1a2970a3ba0cf4eaa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:16.773633 16526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:16.770476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.67:46617 (local address 127.12.148.65:55795)
0808 04:40:16.770670 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:16.770687 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:16.770761 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:16.770974 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:16.770976 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:16.770982 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 04:40:16.771082 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:16.771087 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:16.771880 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:16.771883 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:16.772522 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:16.772531 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:16.772888 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:16.772891 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:16.772971 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:16.773010 (+ 39us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 04:40:16.773335 (+ 325us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 04:40:16.773343 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 04:40:16.773399 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 04:40:16.773507 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":94}
I20260808 04:40:16.773633 16544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:16.770684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:55795 (local address 127.12.148.67:46617)
0808 04:40:16.770794 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:16.770797 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:16.770808 (+ 11us) server_negotiation.cc:407] Connection header received
0808 04:40:16.770846 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:16.770848 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:16.770892 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:16.770967 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:16.771166 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:16.771783 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:16.772607 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:16.772808 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:16.772874 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:16.773139 (+ 265us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:16.773229 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:16.773295 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:16.773426 (+ 131us) server_negotiation.cc:299] Negotiation successful
0808 04:40:16.773496 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
W20260808 04:40:16.774430 16468 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 04:40:18.330521 15606 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:18.330690 15606 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:18.333076 15606 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 33a5ded9ceca4981b04941788592f599: Sending DeleteTablet for 3 replicas of tablet 9450ffe8e08143f9aed1d8eea0df3793
I20260808 04:40:18.333612 15823 tablet_service.cc:1514] Processing DeleteTablet for tablet 9450ffe8e08143f9aed1d8eea0df3793 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:18 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:35224
I20260808 04:40:18.333699 16033 tablet_service.cc:1514] Processing DeleteTablet for tablet 9450ffe8e08143f9aed1d8eea0df3793 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:18 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:39080
I20260808 04:40:18.333765 16240 tablet_service.cc:1514] Processing DeleteTablet for tablet 9450ffe8e08143f9aed1d8eea0df3793 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:18 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:32844
I20260808 04:40:18.334045 16593 tablet_replica.cc:330] T 9450ffe8e08143f9aed1d8eea0df3793 P 80591840abe24dd1a2970a3ba0cf4eaa: stopping tablet replica
I20260808 04:40:18.334177 16593 raft_consensus.cc:2229] T 9450ffe8e08143f9aed1d8eea0df3793 P 80591840abe24dd1a2970a3ba0cf4eaa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:18.334290 16593 raft_consensus.cc:2258] T 9450ffe8e08143f9aed1d8eea0df3793 P 80591840abe24dd1a2970a3ba0cf4eaa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:18.334352 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 15732
I20260808 04:40:18.334530 16594 tablet_replica.cc:330] T 9450ffe8e08143f9aed1d8eea0df3793 P b45e1dd47fb74be3b60f54560303c790: stopping tablet replica
I20260808 04:40:18.334640 16594 raft_consensus.cc:2229] T 9450ffe8e08143f9aed1d8eea0df3793 P b45e1dd47fb74be3b60f54560303c790 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:18.334728 16594 raft_consensus.cc:2258] T 9450ffe8e08143f9aed1d8eea0df3793 P b45e1dd47fb74be3b60f54560303c790 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:18.335379 16593 ts_tablet_manager.cc:1905] T 9450ffe8e08143f9aed1d8eea0df3793 P 80591840abe24dd1a2970a3ba0cf4eaa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:18.337584 16593 ts_tablet_manager.cc:1918] T 9450ffe8e08143f9aed1d8eea0df3793 P 80591840abe24dd1a2970a3ba0cf4eaa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 04:40:18.337673 16593 log.cc:1196] T 9450ffe8e08143f9aed1d8eea0df3793 P 80591840abe24dd1a2970a3ba0cf4eaa: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-1/wal/wals/9450ffe8e08143f9aed1d8eea0df3793
I20260808 04:40:18.337875 16593 ts_tablet_manager.cc:1939] T 9450ffe8e08143f9aed1d8eea0df3793 P 80591840abe24dd1a2970a3ba0cf4eaa: Deleting consensus metadata
I20260808 04:40:18.338500 15589 catalog_manager.cc:4841] TS 80591840abe24dd1a2970a3ba0cf4eaa (127.12.148.66:40497): tablet 9450ffe8e08143f9aed1d8eea0df3793 (table test-table [id=39f55079b9214ebb8140fe2c30b96691]) successfully deleted
I20260808 04:40:18.341514 16597 tablet_replica.cc:330] T 9450ffe8e08143f9aed1d8eea0df3793 P 0c32b76f12b943d199444ef17ee4308b: stopping tablet replica
I20260808 04:40:18.341672 16597 raft_consensus.cc:2229] T 9450ffe8e08143f9aed1d8eea0df3793 P 0c32b76f12b943d199444ef17ee4308b [term 1 LEADER]: Raft consensus shutting down.
I20260808 04:40:18.342033 16597 raft_consensus.cc:2258] T 9450ffe8e08143f9aed1d8eea0df3793 P 0c32b76f12b943d199444ef17ee4308b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:18.343585 16597 ts_tablet_manager.cc:1905] T 9450ffe8e08143f9aed1d8eea0df3793 P 0c32b76f12b943d199444ef17ee4308b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:18.345716 16597 ts_tablet_manager.cc:1918] T 9450ffe8e08143f9aed1d8eea0df3793 P 0c32b76f12b943d199444ef17ee4308b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 04:40:18.345793 16597 log.cc:1196] T 9450ffe8e08143f9aed1d8eea0df3793 P 0c32b76f12b943d199444ef17ee4308b: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786164004017495-12881-0/minicluster-data/ts-2/wal/wals/9450ffe8e08143f9aed1d8eea0df3793
I20260808 04:40:18.346123 16597 ts_tablet_manager.cc:1939] T 9450ffe8e08143f9aed1d8eea0df3793 P 0c32b76f12b943d199444ef17ee4308b: Deleting consensus metadata
I20260808 04:40:18.346827 15592 catalog_manager.cc:4841] TS 0c32b76f12b943d199444ef17ee4308b (127.12.148.67:46617): tablet 9450ffe8e08143f9aed1d8eea0df3793 (table test-table [id=39f55079b9214ebb8140fe2c30b96691]) successfully deleted
W20260808 04:40:18.350190 15592 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.148.65:36587 (error 108)
I20260808 04:40:18.350467 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 15934
I20260808 04:40:18.353696 16601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:18.351374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:36587 (local address 127.0.0.1:35248)
0808 04:40:18.353491 (+ 2117us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:18.353569 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.65:36587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2030,"thread_start_us":1208,"threads_started":1}
W20260808 04:40:18.353832 15592 catalog_manager.cc:4584] TS b45e1dd47fb74be3b60f54560303c790 (127.12.148.65:36587): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9450ffe8e08143f9aed1d8eea0df3793: Network error: Client connection negotiation failed: client connection to 127.12.148.65:36587: connect: Connection refused (error 111)
I20260808 04:40:18.359246 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 16144
I20260808 04:40:18.370674 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 15566
2026-08-08T04:40:18Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6289 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:40:18 dist-test-slave-t7g5 krb5kdc[16606](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:40:18 dist-test-slave-t7g5 krb5kdc[16606](info): set up 2 sockets
Aug 08 04:40:18 dist-test-slave-t7g5 krb5kdc[16606](info): commencing operation
krb5kdc: starting...
W20260808 04:40:19.514497 12881 mini_kdc.cc:121] Time spent starting KDC: real 1.114s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Aug 08 04:40:19 dist-test-slave-t7g5 krb5kdc[16606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164019, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:40:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:40:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.148.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
I20260808 04:40:19.634023 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:45565
--webserver_interface=127.12.148.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:34337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:45565
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:19.745950 16621 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:19.746210 16621 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:19.746255 16621 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:19.750198 16621 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:40:19.750267 16621 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:19.750288 16621 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:19.750312 16621 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:40:19.750337 16621 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:40:19.755614 16621 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:34337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:45565
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:45565
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16621
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:19.756609 16621 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:19.757570 16621 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 04:40:19.765914 16621 server_base.cc:1034] running on GCE node
W20260808 04:40:19.765996 16638 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:19.765996 16633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:19.766216 16634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:19.766789 16621 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:19.767845 16621 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:19.769002 16621 hybrid_clock.cc:648] HybridClock initialized: now 1786164019768982 us; error 30 us; skew 500 ppm
Aug 08 04:40:19 dist-test-slave-t7g5 krb5kdc[16606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164019, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:19.771595 16621 init.cc:377] Logged in from keytab as kudu/127.12.148.126@KRBTEST.COM (short username kudu)
I20260808 04:40:19.772423 16621 webserver.cc:460] Webserver started at http://127.12.148.126:39471/ using document root <none> and password file <none>
I20260808 04:40:19.772948 16621 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:19.773015 16621 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:19.773211 16621 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:19.775264 16621 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "91873d52101245e4acf994b50b6e95e6"
format_stamp: "Formatted at 2026-08-08 04:40:19 on dist-test-slave-t7g5"
server_key: "b557624a3fc7723aaa87c5a6f99c1d57"
server_key_iv: "befbaccb2e73772e40ebf5661de2c630"
server_key_version: "encryptionkey@0"
I20260808 04:40:19.775835 16621 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "91873d52101245e4acf994b50b6e95e6"
format_stamp: "Formatted at 2026-08-08 04:40:19 on dist-test-slave-t7g5"
server_key: "b557624a3fc7723aaa87c5a6f99c1d57"
server_key_iv: "befbaccb2e73772e40ebf5661de2c630"
server_key_version: "encryptionkey@0"
I20260808 04:40:19.779417 16621 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 04:40:19.781628 16648 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:19.782821 16621 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:40:19.782933 16621 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "91873d52101245e4acf994b50b6e95e6"
format_stamp: "Formatted at 2026-08-08 04:40:19 on dist-test-slave-t7g5"
server_key: "b557624a3fc7723aaa87c5a6f99c1d57"
server_key_iv: "befbaccb2e73772e40ebf5661de2c630"
server_key_version: "encryptionkey@0"
I20260808 04:40:19.783038 16621 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:19.819094 16621 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:19.821979 16621 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:19.822165 16621 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:19.829231 16621 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:45565
I20260808 04:40:19.829254 16726 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:45565 every 8 connection(s)
I20260808 04:40:19.830245 16621 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:40:19.832983 16727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:19.838415 16727 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91873d52101245e4acf994b50b6e95e6: Bootstrap starting.
I20260808 04:40:19.840015 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 16621
I20260808 04:40:19.840128 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:40:19.840428 12881 external_mini_cluster.cc:1428] Setting key 9f7d486015ed581080adef8cd3b6377d
I20260808 04:40:19.841084 16727 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 91873d52101245e4acf994b50b6e95e6: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:19.842010 16727 log.cc:824] T 00000000000000000000000000000000 P 91873d52101245e4acf994b50b6e95e6: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:19.843804 16727 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91873d52101245e4acf994b50b6e95e6: No bootstrap required, opened a new log
I20260808 04:40:19.847227 16727 raft_consensus.cc:348] T 00000000000000000000000000000000 P 91873d52101245e4acf994b50b6e95e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91873d52101245e4acf994b50b6e95e6" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45565 } }
I20260808 04:40:19.847458 16727 raft_consensus.cc:374] T 00000000000000000000000000000000 P 91873d52101245e4acf994b50b6e95e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:19.847523 16727 raft_consensus.cc:729] T 00000000000000000000000000000000 P 91873d52101245e4acf994b50b6e95e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91873d52101245e4acf994b50b6e95e6, State: Initialized, Role: FOLLOWER
I20260808 04:40:19.847949 16727 consensus_queue.cc:260] T 00000000000000000000000000000000 P 91873d52101245e4acf994b50b6e95e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91873d52101245e4acf994b50b6e95e6" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45565 } }
I20260808 04:40:19.848093 16727 raft_consensus.cc:388] T 00000000000000000000000000000000 P 91873d52101245e4acf994b50b6e95e6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:40:19.848161 16727 raft_consensus.cc:482] T 00000000000000000000000000000000 P 91873d52101245e4acf994b50b6e95e6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:40:19.848260 16727 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 91873d52101245e4acf994b50b6e95e6 [term 0 FOLLOWER]: Advancing to term 1
Aug 08 04:40:19 dist-test-slave-t7g5 krb5kdc[16606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164019, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:40:19.849105 16727 raft_consensus.cc:504] T 00000000000000000000000000000000 P 91873d52101245e4acf994b50b6e95e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91873d52101245e4acf994b50b6e95e6" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45565 } }
I20260808 04:40:19.849429 16727 leader_election.cc:302] T 00000000000000000000000000000000 P 91873d52101245e4acf994b50b6e95e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 91873d52101245e4acf994b50b6e95e6; no voters:
I20260808 04:40:19.849789 16727 leader_election.cc:288] T 00000000000000000000000000000000 P 91873d52101245e4acf994b50b6e95e6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:40:19.849900 16734 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 91873d52101245e4acf994b50b6e95e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:19.850157 16734 raft_consensus.cc:686] T 00000000000000000000000000000000 P 91873d52101245e4acf994b50b6e95e6 [term 1 LEADER]: Becoming Leader. State: Replica: 91873d52101245e4acf994b50b6e95e6, State: Running, Role: LEADER
I20260808 04:40:19.850536 16734 consensus_queue.cc:237] T 00000000000000000000000000000000 P 91873d52101245e4acf994b50b6e95e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91873d52101245e4acf994b50b6e95e6" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45565 } }
I20260808 04:40:19.851055 16727 sys_catalog.cc:564] T 00000000000000000000000000000000 P 91873d52101245e4acf994b50b6e95e6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:40:19.851905 16735 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91873d52101245e4acf994b50b6e95e6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 91873d52101245e4acf994b50b6e95e6. Latest consensus state: current_term: 1 leader_uuid: "91873d52101245e4acf994b50b6e95e6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91873d52101245e4acf994b50b6e95e6" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45565 } } }
I20260808 04:40:19.852036 16735 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91873d52101245e4acf994b50b6e95e6 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:19.852653 16736 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91873d52101245e4acf994b50b6e95e6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "91873d52101245e4acf994b50b6e95e6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91873d52101245e4acf994b50b6e95e6" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45565 } } }
I20260808 04:40:19.852768 16736 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91873d52101245e4acf994b50b6e95e6 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:19.853406 16748 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:40:19.855062 16731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:19.841549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34776 (local address 127.12.148.126:45565)
0808 04:40:19.842000 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:19.842016 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:19.842051 (+ 35us) server_negotiation.cc:407] Connection header received
0808 04:40:19.842705 (+ 654us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:19.842722 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:19.843038 (+ 316us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:19.843343 (+ 305us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:19.844171 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:19.845156 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:19.846056 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:19.846524 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:19.846673 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:19.849132 (+ 2459us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:19.849138 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:19.849151 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:19.849176 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:19.851205 (+ 2029us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:19.851740 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:19.851746 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:19.851752 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:19.851902 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:19.852189 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:19.852193 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:19.852195 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:19.852708 (+ 513us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:19.852922 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:19.853813 (+ 891us) server_negotiation.cc:299] Negotiation successful
0808 04:40:19.854105 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":312,"thread_start_us":132,"threads_started":1}
I20260808 04:40:19.856660 16748 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:40:19.862144 16748 catalog_manager.cc:1347] Generated new cluster ID: ae73632198aa4a7c83e50ce2bb816d01
I20260808 04:40:19.862207 16748 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:40:19.883970 16748 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:40:19.884883 16748 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:40:19.890111 16748 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 91873d52101245e4acf994b50b6e95e6: Generated new TSK 0
I20260808 04:40:19.890726 16748 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.148.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab.
Entry for principal kudu/127.12.148.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab.
I20260808 04:40:19.918627 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.65:0
--local_ip_for_outbound_sockets=127.12.148.65
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:45565
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:34337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:20.028724 16768 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:20.029000 16768 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:20.029058 16768 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:20.032958 16768 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:20.033017 16768 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:20.033095 16768 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.65
I20260808 04:40:20.038264 16768 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:34337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:45565
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16768
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.65
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:20.039302 16768 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:20.040318 16768 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:20.049503 16778 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:20.049487 16784 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:20.049695 16768 server_base.cc:1034] running on GCE node
W20260808 04:40:20.049511 16779 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:20.050168 16768 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:20.050779 16768 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:20.051946 16768 hybrid_clock.cc:648] HybridClock initialized: now 1786164020051914 us; error 40 us; skew 500 ppm
Aug 08 04:40:20 dist-test-slave-t7g5 krb5kdc[16606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164020, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:20.054862 16768 init.cc:377] Logged in from keytab as kudu/127.12.148.65@KRBTEST.COM (short username kudu)
I20260808 04:40:20.055745 16768 webserver.cc:460] Webserver started at http://127.12.148.65:39159/ using document root <none> and password file <none>
I20260808 04:40:20.056289 16768 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:20.056354 16768 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:20.056560 16768 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:20.058653 16768 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-0/data/instance:
uuid: "1de3532ed81445debb2fc8a863530a0f"
format_stamp: "Formatted at 2026-08-08 04:40:20 on dist-test-slave-t7g5"
server_key: "835c4ce3ba733e344fb8c8832034b67e"
server_key_iv: "ba3a1e7c974ff5331e1d578ede417947"
server_key_version: "encryptionkey@0"
I20260808 04:40:20.059193 16768 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance:
uuid: "1de3532ed81445debb2fc8a863530a0f"
format_stamp: "Formatted at 2026-08-08 04:40:20 on dist-test-slave-t7g5"
server_key: "835c4ce3ba733e344fb8c8832034b67e"
server_key_iv: "ba3a1e7c974ff5331e1d578ede417947"
server_key_version: "encryptionkey@0"
I20260808 04:40:20.062803 16768 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 04:40:20.065167 16795 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:20.066337 16768 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:40:20.066440 16768 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-0/wal
uuid: "1de3532ed81445debb2fc8a863530a0f"
format_stamp: "Formatted at 2026-08-08 04:40:20 on dist-test-slave-t7g5"
server_key: "835c4ce3ba733e344fb8c8832034b67e"
server_key_iv: "ba3a1e7c974ff5331e1d578ede417947"
server_key_version: "encryptionkey@0"
I20260808 04:40:20.066536 16768 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:20.093677 16768 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:20.096855 16768 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:20.097038 16768 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:20.097611 16768 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:20.098456 16768 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:20.098505 16768 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:20.098546 16768 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:20.098575 16768 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:20.106966 16768 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.65:33271
I20260808 04:40:20.107041 16963 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.65:33271 every 8 connection(s)
I20260808 04:40:20.107837 16768 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
I20260808 04:40:20.115199 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 16768
I20260808 04:40:20.115306 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance
I20260808 04:40:20.115585 12881 external_mini_cluster.cc:1428] Setting key a97666c99059141e6592e2a90a1e9c54
Aug 08 04:40:20 dist-test-slave-t7g5 krb5kdc[16606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164020, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:40:20.121519 16731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:20.109590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:59943 (local address 127.12.148.126:45565)
0808 04:40:20.109730 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:20.109733 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:20.110549 (+ 816us) server_negotiation.cc:407] Connection header received
0808 04:40:20.111818 (+ 1269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:20.111822 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:20.111883 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:20.111958 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:20.113121 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:20.113700 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:20.114822 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:20.115063 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:20.115155 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:20.118002 (+ 2847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:20.118005 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:20.118007 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:20.118031 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:20.119569 (+ 1538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:20.120057 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:20.120060 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:20.120062 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:20.120157 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:20.120456 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:20.120459 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:20.120461 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:20.120679 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:20.120774 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:20.121219 (+ 445us) server_negotiation.cc:299] Negotiation successful
0808 04:40:20.121365 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 04:40:20.122288 16968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:20.109957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:45565 (local address 127.12.148.65:59943)
0808 04:40:20.110402 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:20.110446 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:20.111594 (+ 1148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:20.112139 (+ 545us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:20.112146 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:20.112503 (+ 357us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:20.112970 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:20.112983 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:20.113819 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:20.113822 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:20.114693 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:20.114702 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:20.115205 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:20.115209 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:20.115411 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:20.116012 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:20.116032 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:20.117841 (+ 1809us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:20.119698 (+ 1857us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:20.119702 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:20.119714 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:20.119967 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:20.120240 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:20.120242 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:20.120244 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:20.120367 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:20.120769 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:20.120773 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:20.120996 (+ 223us) client_negotiation.cc:769] Sending connection context
0808 04:40:20.121144 (+ 148us) client_negotiation.cc:240] Negotiation successful
0808 04:40:20.121396 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":110,"threads_started":1}
I20260808 04:40:20.123417 16964 heartbeater.cc:347] Connected to a master server at 127.12.148.126:45565
I20260808 04:40:20.123675 16964 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:20.124243 16964 heartbeater.cc:511] Master 127.12.148.126:45565 requested a full tablet report, sending...
I20260808 04:40:20.125841 16670 ts_manager.cc:194] Registered new tserver with Master: 1de3532ed81445debb2fc8a863530a0f (127.12.148.65:33271)
WARNING: no policy specified for kudu/127.12.148.66@KRBTEST.COM; defaulting to no policy
I20260808 04:40:20.126976 16670 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.65@KRBTEST.COM'} at 127.12.148.65:59943
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab.
Entry for principal kudu/127.12.148.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab.
I20260808 04:40:20.142879 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.66:0
--local_ip_for_outbound_sockets=127.12.148.66
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:45565
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:34337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:20.255123 16973 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:20.255378 16973 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:20.255422 16973 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:20.259418 16973 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:20.259474 16973 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:20.259541 16973 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.66
I20260808 04:40:20.264648 16973 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:34337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:45565
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16973
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.66
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:20.265741 16973 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:20.266748 16973 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:20.276233 16982 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:20.276239 16984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:20.276233 16981 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:20.276564 16973 server_base.cc:1034] running on GCE node
I20260808 04:40:20.276964 16973 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:20.277561 16973 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:20.278717 16973 hybrid_clock.cc:648] HybridClock initialized: now 1786164020278688 us; error 39 us; skew 500 ppm
Aug 08 04:40:20 dist-test-slave-t7g5 krb5kdc[16606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164020, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:20.281388 16973 init.cc:377] Logged in from keytab as kudu/127.12.148.66@KRBTEST.COM (short username kudu)
I20260808 04:40:20.282253 16973 webserver.cc:460] Webserver started at http://127.12.148.66:43465/ using document root <none> and password file <none>
I20260808 04:40:20.282755 16973 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:20.282814 16973 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:20.282989 16973 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:20.284998 16973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-1/data/instance:
uuid: "d885845ac5d545f49debd1a20a12b29b"
format_stamp: "Formatted at 2026-08-08 04:40:20 on dist-test-slave-t7g5"
server_key: "b7c147ef7a27f9ea4fe2b9cc913cf5ea"
server_key_iv: "8765e63215abd5c5f4a83812b3e19fba"
server_key_version: "encryptionkey@0"
I20260808 04:40:20.285503 16973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance:
uuid: "d885845ac5d545f49debd1a20a12b29b"
format_stamp: "Formatted at 2026-08-08 04:40:20 on dist-test-slave-t7g5"
server_key: "b7c147ef7a27f9ea4fe2b9cc913cf5ea"
server_key_iv: "8765e63215abd5c5f4a83812b3e19fba"
server_key_version: "encryptionkey@0"
I20260808 04:40:20.289119 16973 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260808 04:40:20.291481 16994 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:20.292647 16973 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 04:40:20.292758 16973 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-1/wal
uuid: "d885845ac5d545f49debd1a20a12b29b"
format_stamp: "Formatted at 2026-08-08 04:40:20 on dist-test-slave-t7g5"
server_key: "b7c147ef7a27f9ea4fe2b9cc913cf5ea"
server_key_iv: "8765e63215abd5c5f4a83812b3e19fba"
server_key_version: "encryptionkey@0"
I20260808 04:40:20.292850 16973 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:20.305699 16973 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:20.308880 16973 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:20.309064 16973 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:20.309638 16973 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:20.310549 16973 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:20.310599 16973 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:20.310652 16973 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:20.310680 16973 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:20.319329 16973 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.66:33343
I20260808 04:40:20.319365 17178 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.66:33343 every 8 connection(s)
I20260808 04:40:20.320196 16973 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
I20260808 04:40:20.329054 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 16973
I20260808 04:40:20.329149 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance
Aug 08 04:40:20 dist-test-slave-t7g5 krb5kdc[16606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164020, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:40:20.329406 12881 external_mini_cluster.cc:1428] Setting key 9deb6dc5500dd3c065c893e6bb16dfc0
I20260808 04:40:20.333319 16731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:20.321910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:56401 (local address 127.12.148.126:45565)
0808 04:40:20.322032 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:20.322035 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:20.322843 (+ 808us) server_negotiation.cc:407] Connection header received
0808 04:40:20.324101 (+ 1258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:20.324105 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:20.324188 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:20.324258 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:20.325434 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:20.326046 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:20.327163 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:20.327385 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:20.327476 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:20.329796 (+ 2320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:20.329800 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:20.329802 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:20.329827 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:20.331335 (+ 1508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:20.331817 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:20.331821 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:20.331823 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:20.331908 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:20.332236 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:20.332239 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:20.332241 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:20.332423 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:20.332514 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:20.333036 (+ 522us) server_negotiation.cc:299] Negotiation successful
0808 04:40:20.333160 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 04:40:20.334136 17181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:20.322261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:45565 (local address 127.12.148.66:56401)
0808 04:40:20.322695 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:20.322738 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:20.323880 (+ 1142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:20.324457 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:20.324464 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:20.324811 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:20.325278 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:20.325292 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:20.326168 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:20.326171 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:20.327039 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:20.327048 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:20.327538 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:20.327542 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:20.327700 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:20.328205 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:20.328221 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:20.329613 (+ 1392us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:20.331454 (+ 1841us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:20.331460 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:20.331473 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:20.331721 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:20.331998 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:20.332001 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:20.332003 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:20.332144 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:20.332525 (+ 381us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:20.332531 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:20.332775 (+ 244us) client_negotiation.cc:769] Sending connection context
0808 04:40:20.332969 (+ 194us) client_negotiation.cc:240] Negotiation successful
0808 04:40:20.333283 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":106,"threads_started":1}
I20260808 04:40:20.335280 17179 heartbeater.cc:347] Connected to a master server at 127.12.148.126:45565
I20260808 04:40:20.335516 17179 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:20.335995 17179 heartbeater.cc:511] Master 127.12.148.126:45565 requested a full tablet report, sending...
I20260808 04:40:20.336998 16670 ts_manager.cc:194] Registered new tserver with Master: d885845ac5d545f49debd1a20a12b29b (127.12.148.66:33343)
I20260808 04:40:20.337586 16670 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.66@KRBTEST.COM'} at 127.12.148.66:56401
WARNING: no policy specified for kudu/127.12.148.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab.
Entry for principal kudu/127.12.148.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab.
I20260808 04:40:20.356673 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.67:0
--local_ip_for_outbound_sockets=127.12.148.67
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:45565
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:34337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:20.467124 17186 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:20.467409 17186 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:20.467453 17186 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:20.471575 17186 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:20.471635 17186 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:20.471692 17186 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.67
I20260808 04:40:20.476946 17186 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:34337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:45565
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17186
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.67
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:20.477996 17186 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:20.478963 17186 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:20.490007 17200 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:20.490007 17197 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:20.490127 17202 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:20.490361 17186 server_base.cc:1034] running on GCE node
I20260808 04:40:20.490798 17186 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:20.491403 17186 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:20.492568 17186 hybrid_clock.cc:648] HybridClock initialized: now 1786164020492535 us; error 50 us; skew 500 ppm
Aug 08 04:40:20 dist-test-slave-t7g5 krb5kdc[16606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164020, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:20.495249 17186 init.cc:377] Logged in from keytab as kudu/127.12.148.67@KRBTEST.COM (short username kudu)
I20260808 04:40:20.496099 17186 webserver.cc:460] Webserver started at http://127.12.148.67:41133/ using document root <none> and password file <none>
I20260808 04:40:20.496682 17186 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:20.496749 17186 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:20.496951 17186 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:20.498967 17186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-2/data/instance:
uuid: "d4e82e3c4f3b485f82d64fa1970dc165"
format_stamp: "Formatted at 2026-08-08 04:40:20 on dist-test-slave-t7g5"
server_key: "b6758e1fbd7c839691aabc65a6e85f22"
server_key_iv: "ab409721b01c497efc78f6feb553c79f"
server_key_version: "encryptionkey@0"
I20260808 04:40:20.499537 17186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance:
uuid: "d4e82e3c4f3b485f82d64fa1970dc165"
format_stamp: "Formatted at 2026-08-08 04:40:20 on dist-test-slave-t7g5"
server_key: "b6758e1fbd7c839691aabc65a6e85f22"
server_key_iv: "ab409721b01c497efc78f6feb553c79f"
server_key_version: "encryptionkey@0"
I20260808 04:40:20.503304 17186 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 04:40:20.505937 17214 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:20.507215 17186 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:40:20.507326 17186 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-2/wal
uuid: "d4e82e3c4f3b485f82d64fa1970dc165"
format_stamp: "Formatted at 2026-08-08 04:40:20 on dist-test-slave-t7g5"
server_key: "b6758e1fbd7c839691aabc65a6e85f22"
server_key_iv: "ab409721b01c497efc78f6feb553c79f"
server_key_version: "encryptionkey@0"
I20260808 04:40:20.507421 17186 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:20.521217 17186 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:20.524191 17186 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:20.524369 17186 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:20.524919 17186 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:20.525759 17186 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:20.525810 17186 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:20.525862 17186 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:20.525888 17186 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:20.534795 17186 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.67:36371
I20260808 04:40:20.534855 17382 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.67:36371 every 8 connection(s)
I20260808 04:40:20.535705 17186 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
I20260808 04:40:20.544469 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 17186
I20260808 04:40:20.544597 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance
I20260808 04:40:20.544924 12881 external_mini_cluster.cc:1428] Setting key 9c5fa4359756a9bcbb80964f8cc27508
Aug 08 04:40:20 dist-test-slave-t7g5 krb5kdc[16606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164020, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:40:20.551487 16731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:20.537734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:43333 (local address 127.12.148.126:45565)
0808 04:40:20.537880 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:20.537885 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:20.538822 (+ 937us) server_negotiation.cc:407] Connection header received
0808 04:40:20.540508 (+ 1686us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:20.540511 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:20.540558 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:20.540633 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:20.542246 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:20.542755 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:20.544505 (+ 1750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:20.544827 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:20.544940 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:20.548023 (+ 3083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:20.548027 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:20.548029 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:20.548054 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:20.549323 (+ 1269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:20.549947 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:20.549950 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:20.549951 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:20.550028 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:20.550369 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:20.550371 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:20.550372 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:20.550551 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:20.550639 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:20.551190 (+ 551us) server_negotiation.cc:299] Negotiation successful
0808 04:40:20.551312 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 04:40:20.552336 17388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:20.538125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:45565 (local address 127.12.148.67:43333)
0808 04:40:20.538639 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:20.538699 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:20.540270 (+ 1571us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:20.540835 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:20.540845 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:20.541369 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:20.542106 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:20.542127 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:20.542876 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:20.542881 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:20.544346 (+ 1465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:20.544359 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:20.544998 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:20.545002 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:20.545210 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:20.545921 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:20.545942 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:20.547844 (+ 1902us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:20.549437 (+ 1593us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:20.549443 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:20.549460 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:20.549843 (+ 383us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:20.550103 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:20.550106 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:20.550109 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:20.550290 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:20.550663 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:20.550670 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:20.550912 (+ 242us) client_negotiation.cc:769] Sending connection context
0808 04:40:20.551087 (+ 175us) client_negotiation.cc:240] Negotiation successful
0808 04:40:20.551441 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":117,"threads_started":1}
I20260808 04:40:20.553550 17383 heartbeater.cc:347] Connected to a master server at 127.12.148.126:45565
I20260808 04:40:20.553804 17383 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:20.554286 17383 heartbeater.cc:511] Master 127.12.148.126:45565 requested a full tablet report, sending...
I20260808 04:40:20.555330 16670 ts_manager.cc:194] Registered new tserver with Master: d4e82e3c4f3b485f82d64fa1970dc165 (127.12.148.67:36371)
I20260808 04:40:20.555888 16670 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.67@KRBTEST.COM'} at 127.12.148.67:43333
I20260808 04:40:20.558915 12881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 04:40:20.577679 16731 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:20.576047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34786 (local address 127.12.148.126:45565)
0808 04:40:20.576197 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:20.576202 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:20.576447 (+ 245us) server_negotiation.cc:407] Connection header received
0808 04:40:20.576587 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:20.576590 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:20.576640 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:20.576707 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:20.577512 (+ 805us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34786: BlockingRecv error: recv got EOF from 127.0.0.1:34786 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 04:40:20.578735 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 16768
I20260808 04:40:20.606616 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 16973
I20260808 04:40:20.613109 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 17186
I20260808 04:40:20.622125 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 16621
2026-08-08T04:40:20Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2249 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164004017495-12881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:40:20 dist-test-slave-t7g5 krb5kdc[17401](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:40:20 dist-test-slave-t7g5 krb5kdc[17401](info): set up 2 sockets
Aug 08 04:40:20 dist-test-slave-t7g5 krb5kdc[17401](info): commencing operation
krb5kdc: starting...
W20260808 04:40:21.763496 12881 mini_kdc.cc:121] Time spent starting KDC: real 1.113s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Aug 08 04:40:21 dist-test-slave-t7g5 krb5kdc[17401](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164021, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:40:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:40:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.148.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
I20260808 04:40:21.881831 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:33295
--webserver_interface=127.12.148.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:39463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:33295
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:21.993031 17417 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:21.993299 17417 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:21.993343 17417 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:21.997447 17417 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:40:21.997524 17417 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:21.997546 17417 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:21.997565 17417 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:40:21.997605 17417 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:40:22.002880 17417 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:39463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:33295
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:33295
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17417
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:22.003953 17417 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:22.004983 17417 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:22.013418 17428 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:22.013428 17430 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:22.013425 17424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:22.013688 17417 server_base.cc:1034] running on GCE node
I20260808 04:40:22.014389 17417 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:22.015470 17417 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:22.016657 17417 hybrid_clock.cc:648] HybridClock initialized: now 1786164022016629 us; error 39 us; skew 500 ppm
Aug 08 04:40:22 dist-test-slave-t7g5 krb5kdc[17401](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164022, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:22.022262 17417 init.cc:377] Logged in from keytab as kudu/127.12.148.126@KRBTEST.COM (short username kudu)
I20260808 04:40:22.023136 17417 webserver.cc:460] Webserver started at http://127.12.148.126:34487/ using document root <none> and password file <none>
I20260808 04:40:22.023658 17417 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:22.023715 17417 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:22.023880 17417 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:22.025936 17417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "64ba0cbd3df74cc9a44ee70eca4d8b33"
format_stamp: "Formatted at 2026-08-08 04:40:22 on dist-test-slave-t7g5"
server_key: "5f44e7d852abe0bd961e93a14bcedda9"
server_key_iv: "e95a24544da5488943e9229311882a5c"
server_key_version: "encryptionkey@0"
I20260808 04:40:22.026463 17417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "64ba0cbd3df74cc9a44ee70eca4d8b33"
format_stamp: "Formatted at 2026-08-08 04:40:22 on dist-test-slave-t7g5"
server_key: "5f44e7d852abe0bd961e93a14bcedda9"
server_key_iv: "e95a24544da5488943e9229311882a5c"
server_key_version: "encryptionkey@0"
I20260808 04:40:22.030161 17417 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:40:22.032478 17438 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:22.033808 17417 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:40:22.033918 17417 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "64ba0cbd3df74cc9a44ee70eca4d8b33"
format_stamp: "Formatted at 2026-08-08 04:40:22 on dist-test-slave-t7g5"
server_key: "5f44e7d852abe0bd961e93a14bcedda9"
server_key_iv: "e95a24544da5488943e9229311882a5c"
server_key_version: "encryptionkey@0"
I20260808 04:40:22.034025 17417 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:22.043061 17417 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:22.045797 17417 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:22.045967 17417 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:22.052533 17417 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:33295
I20260808 04:40:22.052819 17518 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:33295 every 8 connection(s)
I20260808 04:40:22.053459 17417 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:40:22.056255 17519 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:22.057245 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 17417
I20260808 04:40:22.057363 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:40:22.057699 12881 external_mini_cluster.cc:1428] Setting key 756ecdf27881ca97bc34b98b61e4f783
I20260808 04:40:22.062912 17519 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64ba0cbd3df74cc9a44ee70eca4d8b33: Bootstrap starting.
I20260808 04:40:22.065481 17519 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 64ba0cbd3df74cc9a44ee70eca4d8b33: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:22.066241 17519 log.cc:824] T 00000000000000000000000000000000 P 64ba0cbd3df74cc9a44ee70eca4d8b33: Log is configured to *not* fsync() on all Append() calls
Aug 08 04:40:22 dist-test-slave-t7g5 krb5kdc[17401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164021, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:40:22.068248 17519 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64ba0cbd3df74cc9a44ee70eca4d8b33: No bootstrap required, opened a new log
I20260808 04:40:22.071887 17525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:22.059004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45026 (local address 127.12.148.126:33295)
0808 04:40:22.059412 (+ 408us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:22.059428 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:22.059463 (+ 35us) server_negotiation.cc:407] Connection header received
0808 04:40:22.060098 (+ 635us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:22.060114 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:22.060443 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:22.060727 (+ 284us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:22.061625 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:22.063105 (+ 1480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:22.063955 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:22.064633 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:22.064795 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:22.067351 (+ 2556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:22.067357 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:22.067369 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:22.067396 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:22.069111 (+ 1715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:22.069536 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:22.069541 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:22.069546 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:22.069687 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:22.069963 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:22.069967 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:22.069969 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:22.070368 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:22.070550 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:22.070869 (+ 319us) server_negotiation.cc:299] Negotiation successful
0808 04:40:22.071152 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":115,"threads_started":1}
I20260808 04:40:22.071785 17519 raft_consensus.cc:348] T 00000000000000000000000000000000 P 64ba0cbd3df74cc9a44ee70eca4d8b33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64ba0cbd3df74cc9a44ee70eca4d8b33" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 33295 } }
I20260808 04:40:22.071990 17519 raft_consensus.cc:374] T 00000000000000000000000000000000 P 64ba0cbd3df74cc9a44ee70eca4d8b33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:22.072036 17519 raft_consensus.cc:729] T 00000000000000000000000000000000 P 64ba0cbd3df74cc9a44ee70eca4d8b33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64ba0cbd3df74cc9a44ee70eca4d8b33, State: Initialized, Role: FOLLOWER
I20260808 04:40:22.072492 17519 consensus_queue.cc:260] T 00000000000000000000000000000000 P 64ba0cbd3df74cc9a44ee70eca4d8b33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64ba0cbd3df74cc9a44ee70eca4d8b33" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 33295 } }
I20260808 04:40:22.072619 17519 raft_consensus.cc:388] T 00000000000000000000000000000000 P 64ba0cbd3df74cc9a44ee70eca4d8b33 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:40:22.072681 17519 raft_consensus.cc:482] T 00000000000000000000000000000000 P 64ba0cbd3df74cc9a44ee70eca4d8b33 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:40:22.072778 17519 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 64ba0cbd3df74cc9a44ee70eca4d8b33 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:22.073941 17519 raft_consensus.cc:504] T 00000000000000000000000000000000 P 64ba0cbd3df74cc9a44ee70eca4d8b33 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64ba0cbd3df74cc9a44ee70eca4d8b33" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 33295 } }
I20260808 04:40:22.074301 17519 leader_election.cc:302] T 00000000000000000000000000000000 P 64ba0cbd3df74cc9a44ee70eca4d8b33 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 64ba0cbd3df74cc9a44ee70eca4d8b33; no voters:
I20260808 04:40:22.074638 17519 leader_election.cc:288] T 00000000000000000000000000000000 P 64ba0cbd3df74cc9a44ee70eca4d8b33 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:40:22.074748 12881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:40:22.074815 17533 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 64ba0cbd3df74cc9a44ee70eca4d8b33 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:22.075026 17533 raft_consensus.cc:686] T 00000000000000000000000000000000 P 64ba0cbd3df74cc9a44ee70eca4d8b33 [term 1 LEADER]: Becoming Leader. State: Replica: 64ba0cbd3df74cc9a44ee70eca4d8b33, State: Running, Role: LEADER
I20260808 04:40:22.075335 17533 consensus_queue.cc:237] T 00000000000000000000000000000000 P 64ba0cbd3df74cc9a44ee70eca4d8b33 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64ba0cbd3df74cc9a44ee70eca4d8b33" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 33295 } }
I20260808 04:40:22.075917 17519 sys_catalog.cc:564] T 00000000000000000000000000000000 P 64ba0cbd3df74cc9a44ee70eca4d8b33 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:40:22.076807 17534 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64ba0cbd3df74cc9a44ee70eca4d8b33 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "64ba0cbd3df74cc9a44ee70eca4d8b33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64ba0cbd3df74cc9a44ee70eca4d8b33" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 33295 } } }
I20260808 04:40:22.076936 17534 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64ba0cbd3df74cc9a44ee70eca4d8b33 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:22.077244 17536 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64ba0cbd3df74cc9a44ee70eca4d8b33 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 64ba0cbd3df74cc9a44ee70eca4d8b33. Latest consensus state: current_term: 1 leader_uuid: "64ba0cbd3df74cc9a44ee70eca4d8b33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64ba0cbd3df74cc9a44ee70eca4d8b33" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 33295 } } }
I20260808 04:40:22.077350 17536 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64ba0cbd3df74cc9a44ee70eca4d8b33 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:22.077936 17548 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:40:22.080747 17548 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:40:22.086467 17548 catalog_manager.cc:1347] Generated new cluster ID: 73376a80c7f546d8876d96ac11eced7b
I20260808 04:40:22.086535 17548 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:40:22.102533 17548 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:40:22.103749 17548 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:40:22.108803 17525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:22.103084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45028 (local address 127.12.148.126:33295)
0808 04:40:22.103203 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:22.103207 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:22.103600 (+ 393us) server_negotiation.cc:407] Connection header received
0808 04:40:22.103727 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:22.103731 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:22.103783 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:22.103870 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:22.104508 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:22.105287 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:22.106468 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:22.106812 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:22.106899 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:22.107776 (+ 877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:22.107780 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:22.107783 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:40:22.108350 (+ 567us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:22.108386 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:40:22.108405 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:22.108499 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:22.108595 (+ 96us) server_negotiation.cc:299] Negotiation successful
0808 04:40:22.108659 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 04:40:22.109762 17548 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 64ba0cbd3df74cc9a44ee70eca4d8b33: Generated new TSK 0
I20260808 04:40:22.110397 17548 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:40:22.117879 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 17417
2026-08-08T04:40:22Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1495 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:40:22 dist-test-slave-t7g5 krb5kdc[17574](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:40:22 dist-test-slave-t7g5 krb5kdc[17574](info): set up 2 sockets
Aug 08 04:40:22 dist-test-slave-t7g5 krb5kdc[17574](info): commencing operation
krb5kdc: starting...
W20260808 04:40:23.270766 12881 mini_kdc.cc:121] Time spent starting KDC: real 1.125s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Aug 08 04:40:23 dist-test-slave-t7g5 krb5kdc[17574](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164023, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:40:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:40:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.148.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
I20260808 04:40:23.392879 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:41895
--webserver_interface=127.12.148.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:37691
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:41895
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:23.500309 17589 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:23.500581 17589 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:23.500638 17589 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:23.504635 17589 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:40:23.504691 17589 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:23.504716 17589 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:23.504745 17589 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:40:23.504773 17589 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:40:23.509895 17589 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:37691
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:41895
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:41895
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17589
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:23.510848 17589 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:23.511801 17589 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:23.519810 17602 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:23.519820 17598 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:23.519860 17599 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:23.519989 17589 server_base.cc:1034] running on GCE node
I20260808 04:40:23.520746 17589 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:23.521811 17589 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:23.522984 17589 hybrid_clock.cc:648] HybridClock initialized: now 1786164023522968 us; error 26 us; skew 500 ppm
Aug 08 04:40:23 dist-test-slave-t7g5 krb5kdc[17574](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164023, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:23.525596 17589 init.cc:377] Logged in from keytab as kudu/127.12.148.126@KRBTEST.COM (short username kudu)
I20260808 04:40:23.526484 17589 webserver.cc:460] Webserver started at http://127.12.148.126:44121/ using document root <none> and password file <none>
I20260808 04:40:23.527019 17589 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:23.527089 17589 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:23.527302 17589 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:23.529315 17589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "5723bd603f404c899c688803cb845329"
format_stamp: "Formatted at 2026-08-08 04:40:23 on dist-test-slave-t7g5"
server_key: "f53e5c46ecf62c627d461c1e930af4e9"
server_key_iv: "76350c8f25e22a4630e2a95bf7bb14f2"
server_key_version: "encryptionkey@0"
I20260808 04:40:23.529875 17589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "5723bd603f404c899c688803cb845329"
format_stamp: "Formatted at 2026-08-08 04:40:23 on dist-test-slave-t7g5"
server_key: "f53e5c46ecf62c627d461c1e930af4e9"
server_key_iv: "76350c8f25e22a4630e2a95bf7bb14f2"
server_key_version: "encryptionkey@0"
I20260808 04:40:23.533389 17589 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.003s
I20260808 04:40:23.535847 17611 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:23.537026 17589 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:40:23.537151 17589 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "5723bd603f404c899c688803cb845329"
format_stamp: "Formatted at 2026-08-08 04:40:23 on dist-test-slave-t7g5"
server_key: "f53e5c46ecf62c627d461c1e930af4e9"
server_key_iv: "76350c8f25e22a4630e2a95bf7bb14f2"
server_key_version: "encryptionkey@0"
I20260808 04:40:23.537249 17589 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:23.551471 17589 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:23.554220 17589 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:23.554399 17589 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:23.560992 17589 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:41895
I20260808 04:40:23.561239 17687 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:41895 every 8 connection(s)
I20260808 04:40:23.561964 17589 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:40:23.564728 17689 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:23.568177 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 17589
I20260808 04:40:23.568293 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:40:23.568528 12881 external_mini_cluster.cc:1428] Setting key df14766cc6dc0648576c3634b920dec3
I20260808 04:40:23.570570 17689 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5723bd603f404c899c688803cb845329: Bootstrap starting.
I20260808 04:40:23.573266 17689 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5723bd603f404c899c688803cb845329: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:23.574152 17689 log.cc:824] T 00000000000000000000000000000000 P 5723bd603f404c899c688803cb845329: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:23.576365 17689 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5723bd603f404c899c688803cb845329: No bootstrap required, opened a new log
Aug 08 04:40:23 dist-test-slave-t7g5 krb5kdc[17574](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164023, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:40:23.580273 17689 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5723bd603f404c899c688803cb845329 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5723bd603f404c899c688803cb845329" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41895 } }
I20260808 04:40:23.580519 17689 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5723bd603f404c899c688803cb845329 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:23.580581 17689 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5723bd603f404c899c688803cb845329 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5723bd603f404c899c688803cb845329, State: Initialized, Role: FOLLOWER
I20260808 04:40:23.581035 17689 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5723bd603f404c899c688803cb845329 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5723bd603f404c899c688803cb845329" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41895 } }
I20260808 04:40:23.581167 17689 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5723bd603f404c899c688803cb845329 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:40:23.581233 17689 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5723bd603f404c899c688803cb845329 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:40:23.581331 17689 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5723bd603f404c899c688803cb845329 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:23.582197 17689 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5723bd603f404c899c688803cb845329 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5723bd603f404c899c688803cb845329" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41895 } }
I20260808 04:40:23.582526 17689 leader_election.cc:302] T 00000000000000000000000000000000 P 5723bd603f404c899c688803cb845329 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5723bd603f404c899c688803cb845329; no voters:
I20260808 04:40:23.582870 17689 leader_election.cc:288] T 00000000000000000000000000000000 P 5723bd603f404c899c688803cb845329 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:40:23.582967 17697 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5723bd603f404c899c688803cb845329 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:23.583186 17697 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5723bd603f404c899c688803cb845329 [term 1 LEADER]: Becoming Leader. State: Replica: 5723bd603f404c899c688803cb845329, State: Running, Role: LEADER
I20260808 04:40:23.583503 17697 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5723bd603f404c899c688803cb845329 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5723bd603f404c899c688803cb845329" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41895 } }
I20260808 04:40:23.584141 17689 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5723bd603f404c899c688803cb845329 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:40:23.584304 17695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:23.569949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33330 (local address 127.12.148.126:41895)
0808 04:40:23.570368 (+ 419us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:23.570392 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:23.570436 (+ 44us) server_negotiation.cc:407] Connection header received
0808 04:40:23.571241 (+ 805us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:23.571264 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:23.571671 (+ 407us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:23.572052 (+ 381us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:23.572677 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:23.574167 (+ 1490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:23.575200 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:23.575943 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:23.576105 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:23.579355 (+ 3250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:23.579359 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:23.579373 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:23.579400 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:23.581052 (+ 1652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:23.581509 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:23.581515 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:23.581521 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:23.581636 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:23.581920 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:23.581924 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:23.581925 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:23.582345 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:23.582574 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:23.582873 (+ 299us) server_negotiation.cc:299] Negotiation successful
0808 04:40:23.583353 (+ 480us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267,"thread_start_us":112,"threads_started":1}
I20260808 04:40:23.585171 17701 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5723bd603f404c899c688803cb845329 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5723bd603f404c899c688803cb845329. Latest consensus state: current_term: 1 leader_uuid: "5723bd603f404c899c688803cb845329" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5723bd603f404c899c688803cb845329" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41895 } } }
I20260808 04:40:23.585182 17698 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5723bd603f404c899c688803cb845329 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5723bd603f404c899c688803cb845329" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5723bd603f404c899c688803cb845329" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41895 } } }
I20260808 04:40:23.585386 17698 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5723bd603f404c899c688803cb845329 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:23.585414 17701 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5723bd603f404c899c688803cb845329 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:23.586619 17710 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:40:23.589252 17710 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:40:23.594298 17710 catalog_manager.cc:1347] Generated new cluster ID: 3ee6c446184f4082bf99ca75256a3192
I20260808 04:40:23.594362 17710 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:40:23.605924 17710 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:40:23.606746 17710 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:40:23.611991 17710 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5723bd603f404c899c688803cb845329: Generated new TSK 0
I20260808 04:40:23.612586 17710 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.148.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab.
Entry for principal kudu/127.12.148.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab.
I20260808 04:40:23.644145 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.65:0
--local_ip_for_outbound_sockets=127.12.148.65
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:41895
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:37691
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:23.755774 17724 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:23.756042 17724 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:23.756084 17724 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:23.760066 17724 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:23.760128 17724 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:23.760190 17724 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.65
I20260808 04:40:23.765421 17724 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:37691
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:41895
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17724
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.65
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:23.766530 17724 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:23.767550 17724 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:23.776893 17735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:23.776895 17732 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:23.776890 17733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:23.777096 17724 server_base.cc:1034] running on GCE node
I20260808 04:40:23.777505 17724 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:23.778198 17724 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:23.779357 17724 hybrid_clock.cc:648] HybridClock initialized: now 1786164023779342 us; error 27 us; skew 500 ppm
Aug 08 04:40:23 dist-test-slave-t7g5 krb5kdc[17574](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164023, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:23.782038 17724 init.cc:377] Logged in from keytab as kudu/127.12.148.65@KRBTEST.COM (short username kudu)
I20260808 04:40:23.782878 17724 webserver.cc:460] Webserver started at http://127.12.148.65:39281/ using document root <none> and password file <none>
I20260808 04:40:23.783418 17724 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:23.783488 17724 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:23.783691 17724 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:23.785811 17724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-0/data/instance:
uuid: "c136d6955e0c4ce5aa4a4ff305e8dc0e"
format_stamp: "Formatted at 2026-08-08 04:40:23 on dist-test-slave-t7g5"
server_key: "12a9c9b9b95a2614089e4303ec20b101"
server_key_iv: "42935cb05244959505bc340c37c08827"
server_key_version: "encryptionkey@0"
I20260808 04:40:23.786363 17724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance:
uuid: "c136d6955e0c4ce5aa4a4ff305e8dc0e"
format_stamp: "Formatted at 2026-08-08 04:40:23 on dist-test-slave-t7g5"
server_key: "12a9c9b9b95a2614089e4303ec20b101"
server_key_iv: "42935cb05244959505bc340c37c08827"
server_key_version: "encryptionkey@0"
I20260808 04:40:23.790648 17724 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 04:40:23.793681 17749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:23.795105 17724 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 04:40:23.795197 17724 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-0/wal
uuid: "c136d6955e0c4ce5aa4a4ff305e8dc0e"
format_stamp: "Formatted at 2026-08-08 04:40:23 on dist-test-slave-t7g5"
server_key: "12a9c9b9b95a2614089e4303ec20b101"
server_key_iv: "42935cb05244959505bc340c37c08827"
server_key_version: "encryptionkey@0"
I20260808 04:40:23.795270 17724 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:23.814355 17724 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:23.816990 17724 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:23.817166 17724 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:23.817770 17724 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:23.818593 17724 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:23.818650 17724 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:23.818703 17724 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:23.818727 17724 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:23.827414 17724 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.65:42581
I20260808 04:40:23.827440 17915 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.65:42581 every 8 connection(s)
I20260808 04:40:23.828343 17724 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
I20260808 04:40:23.830480 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 17724
I20260808 04:40:23.830586 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance
I20260808 04:40:23.830857 12881 external_mini_cluster.cc:1428] Setting key 3883e39393700c3e22b46929c60a9b2b
Aug 08 04:40:23 dist-test-slave-t7g5 krb5kdc[17574](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164023, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.148.66@KRBTEST.COM; defaulting to no policy
I20260808 04:40:23.841953 17695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:23.830153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:53267 (local address 127.12.148.126:41895)
0808 04:40:23.830299 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:23.830304 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:23.831199 (+ 895us) server_negotiation.cc:407] Connection header received
0808 04:40:23.832691 (+ 1492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:23.832694 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:23.832760 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:23.832831 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:23.834106 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:23.834631 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:23.835770 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:23.836007 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:23.836094 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:23.838498 (+ 2404us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:23.838501 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:23.838503 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:23.838527 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:23.839869 (+ 1342us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:23.840393 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:23.840397 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:23.840398 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:23.840478 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:23.840789 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:23.840792 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:23.840794 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:23.840964 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:23.841050 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:23.841624 (+ 574us) server_negotiation.cc:299] Negotiation successful
0808 04:40:23.841782 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.66@KRBTEST.COM" created.
I20260808 04:40:23.842914 17921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:23.830522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41895 (local address 127.12.148.65:53267)
0808 04:40:23.831025 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:23.831082 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:23.832478 (+ 1396us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:23.833022 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:23.833029 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:23.833421 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:23.833962 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:23.833977 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:23.834750 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:23.834754 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:23.835647 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:23.835657 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:23.836145 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:23.836149 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:23.836317 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:23.836870 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:23.836887 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:23.838342 (+ 1455us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:23.839992 (+ 1650us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:23.839998 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:23.840013 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:23.840303 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:23.840561 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:23.840564 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:23.840566 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:23.840701 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:23.841061 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:23.841068 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:23.841386 (+ 318us) client_negotiation.cc:769] Sending connection context
0808 04:40:23.841567 (+ 181us) client_negotiation.cc:240] Negotiation successful
0808 04:40:23.841902 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":123,"threads_started":1}
I20260808 04:40:23.844105 17917 heartbeater.cc:347] Connected to a master server at 127.12.148.126:41895
I20260808 04:40:23.844362 17917 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:23.844933 17917 heartbeater.cc:511] Master 127.12.148.126:41895 requested a full tablet report, sending...
I20260808 04:40:23.846608 17635 ts_manager.cc:194] Registered new tserver with Master: c136d6955e0c4ce5aa4a4ff305e8dc0e (127.12.148.65:42581)
I20260808 04:40:23.848229 17635 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.65@KRBTEST.COM'} at 127.12.148.65:53267
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab.
Entry for principal kudu/127.12.148.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab.
I20260808 04:40:23.858599 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.66:0
--local_ip_for_outbound_sockets=127.12.148.66
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:41895
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:37691
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:23.971422 17928 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:23.971705 17928 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:23.971748 17928 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:23.975814 17928 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:23.975874 17928 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:23.975932 17928 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.66
I20260808 04:40:23.981323 17928 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:37691
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:41895
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17928
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.66
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:23.982395 17928 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:23.983383 17928 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:23.993124 17942 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:23.993114 17940 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:23.993114 17938 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:23.993343 17928 server_base.cc:1034] running on GCE node
I20260808 04:40:23.993777 17928 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:23.994427 17928 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:23.995585 17928 hybrid_clock.cc:648] HybridClock initialized: now 1786164023995566 us; error 30 us; skew 500 ppm
Aug 08 04:40:23 dist-test-slave-t7g5 krb5kdc[17574](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164023, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:23.998379 17928 init.cc:377] Logged in from keytab as kudu/127.12.148.66@KRBTEST.COM (short username kudu)
I20260808 04:40:23.999306 17928 webserver.cc:460] Webserver started at http://127.12.148.66:32781/ using document root <none> and password file <none>
I20260808 04:40:23.999877 17928 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:23.999953 17928 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:24.000165 17928 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:24.002266 17928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-1/data/instance:
uuid: "2ddbff055785415eb6c651481f6872ee"
format_stamp: "Formatted at 2026-08-08 04:40:23 on dist-test-slave-t7g5"
server_key: "a8d24a97d741a7919eade5b2a3675e58"
server_key_iv: "31ebacac56b254e9c542315948192c61"
server_key_version: "encryptionkey@0"
I20260808 04:40:24.002837 17928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance:
uuid: "2ddbff055785415eb6c651481f6872ee"
format_stamp: "Formatted at 2026-08-08 04:40:23 on dist-test-slave-t7g5"
server_key: "a8d24a97d741a7919eade5b2a3675e58"
server_key_iv: "31ebacac56b254e9c542315948192c61"
server_key_version: "encryptionkey@0"
I20260808 04:40:24.006641 17928 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 04:40:24.009109 17953 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:24.010445 17928 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 04:40:24.010566 17928 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-1/wal
uuid: "2ddbff055785415eb6c651481f6872ee"
format_stamp: "Formatted at 2026-08-08 04:40:23 on dist-test-slave-t7g5"
server_key: "a8d24a97d741a7919eade5b2a3675e58"
server_key_iv: "31ebacac56b254e9c542315948192c61"
server_key_version: "encryptionkey@0"
I20260808 04:40:24.010679 17928 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:24.032112 17928 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:24.035324 17928 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:24.035526 17928 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:24.036111 17928 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:24.036960 17928 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:24.037011 17928 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:24.037065 17928 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:24.037094 17928 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:24.045621 17928 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.66:45005
I20260808 04:40:24.045709 18124 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.66:45005 every 8 connection(s)
I20260808 04:40:24.046576 17928 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
I20260808 04:40:24.055370 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 17928
I20260808 04:40:24.055505 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance
I20260808 04:40:24.055794 12881 external_mini_cluster.cc:1428] Setting key 82f860bdfd6b8dbbb487cf98894d7472
Aug 08 04:40:24 dist-test-slave-t7g5 krb5kdc[17574](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164023, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:40:24.060029 17695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:24.048344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:53747 (local address 127.12.148.126:41895)
0808 04:40:24.048480 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:24.048483 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:24.049315 (+ 832us) server_negotiation.cc:407] Connection header received
0808 04:40:24.050683 (+ 1368us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:24.050686 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:24.050742 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:24.050814 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:24.052005 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:24.052533 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:24.053688 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:24.053912 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:24.054001 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:24.056550 (+ 2549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:24.056554 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:24.056556 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:24.056584 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:24.058079 (+ 1495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:24.058569 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:24.058573 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:24.058575 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:24.058660 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:24.058980 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:24.058983 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:24.058985 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:24.059170 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:24.059257 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:24.059741 (+ 484us) server_negotiation.cc:299] Negotiation successful
0808 04:40:24.059869 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 04:40:24.060811 18127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:24.048725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41895 (local address 127.12.148.66:53747)
0808 04:40:24.049172 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:24.049215 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:24.050476 (+ 1261us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:24.051015 (+ 539us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:24.051022 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:24.051380 (+ 358us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:24.051862 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:24.051876 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:24.052649 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:24.052652 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:24.053549 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:24.053558 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:24.054050 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:24.054054 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:24.054219 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:24.054711 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:24.054726 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:24.056370 (+ 1644us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:24.058190 (+ 1820us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:24.058196 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:24.058211 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:24.058472 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:24.058743 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:24.058746 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:24.058748 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:24.058885 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:24.059270 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:24.059277 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:24.059511 (+ 234us) client_negotiation.cc:769] Sending connection context
0808 04:40:24.059676 (+ 165us) client_negotiation.cc:240] Negotiation successful
0808 04:40:24.060000 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":111,"threads_started":1}
I20260808 04:40:24.062038 18125 heartbeater.cc:347] Connected to a master server at 127.12.148.126:41895
I20260808 04:40:24.062265 18125 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:24.062723 18125 heartbeater.cc:511] Master 127.12.148.126:41895 requested a full tablet report, sending...
I20260808 04:40:24.063809 17635 ts_manager.cc:194] Registered new tserver with Master: 2ddbff055785415eb6c651481f6872ee (127.12.148.66:45005)
I20260808 04:40:24.064558 17635 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.66@KRBTEST.COM'} at 127.12.148.66:53747
WARNING: no policy specified for kudu/127.12.148.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab.
Entry for principal kudu/127.12.148.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab.
I20260808 04:40:24.082325 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.67:0
--local_ip_for_outbound_sockets=127.12.148.67
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:41895
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:37691
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:24.194363 18131 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:24.194610 18131 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:24.194651 18131 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:24.198994 18131 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:24.199049 18131 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:24.199124 18131 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.67
I20260808 04:40:24.204282 18131 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:37691
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:41895
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18131
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.67
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:24.205212 18131 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:24.206171 18131 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:24.215315 18139 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:24.215291 18142 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:24.215317 18137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:24.215471 18131 server_base.cc:1034] running on GCE node
I20260808 04:40:24.215885 18131 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:24.216468 18131 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:24.217623 18131 hybrid_clock.cc:648] HybridClock initialized: now 1786164024217600 us; error 34 us; skew 500 ppm
Aug 08 04:40:24 dist-test-slave-t7g5 krb5kdc[17574](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164024, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:24.220218 18131 init.cc:377] Logged in from keytab as kudu/127.12.148.67@KRBTEST.COM (short username kudu)
I20260808 04:40:24.221050 18131 webserver.cc:460] Webserver started at http://127.12.148.67:36699/ using document root <none> and password file <none>
I20260808 04:40:24.221558 18131 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:24.221619 18131 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:24.221860 18131 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:24.223771 18131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-2/data/instance:
uuid: "a5341a5a5b1747e4af7b2566dd1c232c"
format_stamp: "Formatted at 2026-08-08 04:40:24 on dist-test-slave-t7g5"
server_key: "6d029f0a20d6110d8211a85c0662f3ac"
server_key_iv: "03375fd05aa47ac745072fd6ec4575f2"
server_key_version: "encryptionkey@0"
I20260808 04:40:24.224298 18131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance:
uuid: "a5341a5a5b1747e4af7b2566dd1c232c"
format_stamp: "Formatted at 2026-08-08 04:40:24 on dist-test-slave-t7g5"
server_key: "6d029f0a20d6110d8211a85c0662f3ac"
server_key_iv: "03375fd05aa47ac745072fd6ec4575f2"
server_key_version: "encryptionkey@0"
I20260808 04:40:24.227736 18131 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 04:40:24.229947 18150 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:24.231092 18131 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 04:40:24.231187 18131 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-2/wal
uuid: "a5341a5a5b1747e4af7b2566dd1c232c"
format_stamp: "Formatted at 2026-08-08 04:40:24 on dist-test-slave-t7g5"
server_key: "6d029f0a20d6110d8211a85c0662f3ac"
server_key_iv: "03375fd05aa47ac745072fd6ec4575f2"
server_key_version: "encryptionkey@0"
I20260808 04:40:24.231281 18131 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:24.241307 18131 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:24.243810 18131 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:24.243981 18131 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:24.244511 18131 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:24.245282 18131 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:24.245328 18131 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:24.245373 18131 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:24.245404 18131 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:24.253647 18131 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.67:40777
I20260808 04:40:24.253707 18318 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.67:40777 every 8 connection(s)
I20260808 04:40:24.254498 18131 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
I20260808 04:40:24.258478 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 18131
I20260808 04:40:24.258587 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance
I20260808 04:40:24.258910 12881 external_mini_cluster.cc:1428] Setting key 4728b5200afc3b27a83b82762c48d986
Aug 08 04:40:24 dist-test-slave-t7g5 krb5kdc[17574](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164024, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:40:24.267525 17695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:24.256269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:55889 (local address 127.12.148.126:41895)
0808 04:40:24.256407 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:24.256411 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:24.257214 (+ 803us) server_negotiation.cc:407] Connection header received
0808 04:40:24.258570 (+ 1356us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:24.258574 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:24.258632 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:24.258728 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:24.260143 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:24.260735 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:24.261924 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:24.262142 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:24.262230 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:24.264491 (+ 2261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:24.264494 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:24.264495 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:24.264520 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:24.265581 (+ 1061us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:24.266073 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:24.266076 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:24.266077 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:24.266160 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:24.266483 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:24.266486 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:24.266487 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:24.266661 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:24.266746 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:24.267233 (+ 487us) server_negotiation.cc:299] Negotiation successful
0808 04:40:24.267355 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 04:40:24.268221 18324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:24.256623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41895 (local address 127.12.148.67:55889)
0808 04:40:24.257068 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:24.257111 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:24.258352 (+ 1241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:24.258963 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:24.258972 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:24.259419 (+ 447us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:24.259977 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:24.259997 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:24.260868 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:24.260871 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:24.261806 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:24.261816 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:24.262283 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:24.262287 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:24.262450 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:24.262937 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:24.262960 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:24.264330 (+ 1370us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:24.265706 (+ 1376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:24.265712 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:24.265726 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:24.265979 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:24.266243 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:24.266246 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:24.266248 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:24.266377 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:24.266762 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:24.266769 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:24.267002 (+ 233us) client_negotiation.cc:769] Sending connection context
0808 04:40:24.267156 (+ 154us) client_negotiation.cc:240] Negotiation successful
0808 04:40:24.267453 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":107,"threads_started":1}
I20260808 04:40:24.269219 18319 heartbeater.cc:347] Connected to a master server at 127.12.148.126:41895
I20260808 04:40:24.269439 18319 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:24.269920 18319 heartbeater.cc:511] Master 127.12.148.126:41895 requested a full tablet report, sending...
I20260808 04:40:24.270836 17635 ts_manager.cc:194] Registered new tserver with Master: a5341a5a5b1747e4af7b2566dd1c232c (127.12.148.67:40777)
I20260808 04:40:24.271471 17635 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.67@KRBTEST.COM'} at 127.12.148.67:55889
I20260808 04:40:24.272619 12881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 04:40:24 dist-test-slave-t7g5 krb5kdc[17574](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164024, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 08 04:40:24 dist-test-slave-t7g5 krb5kdc[17574](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164024, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:40:24.297847 17695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:24.289922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51600 (local address 127.12.148.126:41895)
0808 04:40:24.290101 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:24.290105 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:24.290248 (+ 143us) server_negotiation.cc:407] Connection header received
0808 04:40:24.290380 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:24.290383 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:24.290428 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:24.290494 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:24.291177 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:24.291693 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:24.292500 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:24.292712 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:24.292797 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:24.295073 (+ 2276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:24.295076 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:24.295078 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:24.295101 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:24.296228 (+ 1127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:24.296620 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:24.296624 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:24.296625 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:24.296703 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:24.296946 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:24.296949 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:24.296951 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:24.297165 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:24.297288 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:24.297542 (+ 254us) server_negotiation.cc:299] Negotiation successful
0808 04:40:24.297689 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
W20260808 04:40:24.298213 17635 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:51600
I20260808 04:40:24.299080 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 17724
I20260808 04:40:24.327265 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 17928
I20260808 04:40:24.341284 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 18131
I20260808 04:40:24.351540 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 17589
2026-08-08T04:40:24Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2234 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:40:24 dist-test-slave-t7g5 krb5kdc[18337](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:40:24 dist-test-slave-t7g5 krb5kdc[18337](info): set up 2 sockets
Aug 08 04:40:24 dist-test-slave-t7g5 krb5kdc[18337](info): commencing operation
krb5kdc: starting...
W20260808 04:40:25.495708 12881 mini_kdc.cc:121] Time spent starting KDC: real 1.115s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Aug 08 04:40:25 dist-test-slave-t7g5 krb5kdc[18337](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164025, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:40:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:40:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.148.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
I20260808 04:40:25.624035 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:45867
--webserver_interface=127.12.148.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:35913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:45867
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:25.733978 18361 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:25.734229 18361 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:25.734267 18361 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:25.738196 18361 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:40:25.738245 18361 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:25.738263 18361 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:25.738277 18361 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:40:25.738291 18361 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:40:25.743343 18361 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:35913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:45867
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:45867
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18361
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:25.744279 18361 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:25.745206 18361 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:25.753389 18373 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:25.753417 18369 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:25.753500 18368 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:25.753589 18361 server_base.cc:1034] running on GCE node
I20260808 04:40:25.754170 18361 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:25.755208 18361 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:25.756374 18361 hybrid_clock.cc:648] HybridClock initialized: now 1786164025756351 us; error 37 us; skew 500 ppm
Aug 08 04:40:25 dist-test-slave-t7g5 krb5kdc[18337](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164025, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:25.759029 18361 init.cc:377] Logged in from keytab as kudu/127.12.148.126@KRBTEST.COM (short username kudu)
I20260808 04:40:25.759956 18361 webserver.cc:460] Webserver started at http://127.12.148.126:36789/ using document root <none> and password file <none>
I20260808 04:40:25.760504 18361 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:25.760571 18361 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:25.760782 18361 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:25.762866 18361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "ae453fb922364b7ba986623c691f8aed"
format_stamp: "Formatted at 2026-08-08 04:40:25 on dist-test-slave-t7g5"
server_key: "2206725211a147fb22f52a5702827d92"
server_key_iv: "e4269c8befec3b03cd07ab4fec6929fe"
server_key_version: "encryptionkey@0"
I20260808 04:40:25.763419 18361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "ae453fb922364b7ba986623c691f8aed"
format_stamp: "Formatted at 2026-08-08 04:40:25 on dist-test-slave-t7g5"
server_key: "2206725211a147fb22f52a5702827d92"
server_key_iv: "e4269c8befec3b03cd07ab4fec6929fe"
server_key_version: "encryptionkey@0"
I20260808 04:40:25.767036 18361 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.001s
I20260808 04:40:25.769271 18392 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:25.770512 18361 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:40:25.770629 18361 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "ae453fb922364b7ba986623c691f8aed"
format_stamp: "Formatted at 2026-08-08 04:40:25 on dist-test-slave-t7g5"
server_key: "2206725211a147fb22f52a5702827d92"
server_key_iv: "e4269c8befec3b03cd07ab4fec6929fe"
server_key_version: "encryptionkey@0"
I20260808 04:40:25.770727 18361 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:25.784874 18361 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:25.787879 18361 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:25.788055 18361 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:25.794559 18361 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:45867
I20260808 04:40:25.794579 18473 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:45867 every 8 connection(s)
I20260808 04:40:25.795540 18361 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:40:25.798213 18474 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:25.800081 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 18361
I20260808 04:40:25.800189 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:40:25.800438 12881 external_mini_cluster.cc:1428] Setting key 082c58783b8b6dd108df007d28a857b8
I20260808 04:40:25.804929 18474 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae453fb922364b7ba986623c691f8aed: Bootstrap starting.
I20260808 04:40:25.807564 18474 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ae453fb922364b7ba986623c691f8aed: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:25.808323 18474 log.cc:824] T 00000000000000000000000000000000 P ae453fb922364b7ba986623c691f8aed: Log is configured to *not* fsync() on all Append() calls
Aug 08 04:40:25 dist-test-slave-t7g5 krb5kdc[18337](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164025, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:40:25.810375 18474 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae453fb922364b7ba986623c691f8aed: No bootstrap required, opened a new log
I20260808 04:40:25.814819 18474 raft_consensus.cc:348] T 00000000000000000000000000000000 P ae453fb922364b7ba986623c691f8aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae453fb922364b7ba986623c691f8aed" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45867 } }
I20260808 04:40:25.815024 18481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:25.801781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36332 (local address 127.12.148.126:45867)
0808 04:40:25.802208 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:25.802226 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:25.802268 (+ 42us) server_negotiation.cc:407] Connection header received
0808 04:40:25.803005 (+ 737us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:25.803030 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:25.803459 (+ 429us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:25.803835 (+ 376us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:25.804491 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:25.805999 (+ 1508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:25.806833 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:25.807520 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:25.807690 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:25.809998 (+ 2308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:25.810004 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:25.810020 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:25.810052 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:25.811945 (+ 1893us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:25.812351 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:25.812357 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:25.812364 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:25.812532 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:25.812753 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:25.812756 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:25.812757 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:25.813268 (+ 511us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:25.813480 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:25.813763 (+ 283us) server_negotiation.cc:299] Negotiation successful
0808 04:40:25.814067 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":106,"threads_started":1}
I20260808 04:40:25.815110 18474 raft_consensus.cc:374] T 00000000000000000000000000000000 P ae453fb922364b7ba986623c691f8aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:25.815160 18474 raft_consensus.cc:729] T 00000000000000000000000000000000 P ae453fb922364b7ba986623c691f8aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae453fb922364b7ba986623c691f8aed, State: Initialized, Role: FOLLOWER
I20260808 04:40:25.815615 18474 consensus_queue.cc:260] T 00000000000000000000000000000000 P ae453fb922364b7ba986623c691f8aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae453fb922364b7ba986623c691f8aed" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45867 } }
I20260808 04:40:25.815755 18474 raft_consensus.cc:388] T 00000000000000000000000000000000 P ae453fb922364b7ba986623c691f8aed [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:40:25.815822 18474 raft_consensus.cc:482] T 00000000000000000000000000000000 P ae453fb922364b7ba986623c691f8aed [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:40:25.815920 18474 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ae453fb922364b7ba986623c691f8aed [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:25.817003 18474 raft_consensus.cc:504] T 00000000000000000000000000000000 P ae453fb922364b7ba986623c691f8aed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae453fb922364b7ba986623c691f8aed" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45867 } }
I20260808 04:40:25.817353 18474 leader_election.cc:302] T 00000000000000000000000000000000 P ae453fb922364b7ba986623c691f8aed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ae453fb922364b7ba986623c691f8aed; no voters:
I20260808 04:40:25.817667 18474 leader_election.cc:288] T 00000000000000000000000000000000 P ae453fb922364b7ba986623c691f8aed [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:40:25.817791 18483 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ae453fb922364b7ba986623c691f8aed [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:25.817987 18483 raft_consensus.cc:686] T 00000000000000000000000000000000 P ae453fb922364b7ba986623c691f8aed [term 1 LEADER]: Becoming Leader. State: Replica: ae453fb922364b7ba986623c691f8aed, State: Running, Role: LEADER
I20260808 04:40:25.818353 18483 consensus_queue.cc:237] T 00000000000000000000000000000000 P ae453fb922364b7ba986623c691f8aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae453fb922364b7ba986623c691f8aed" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45867 } }
I20260808 04:40:25.818799 18474 sys_catalog.cc:564] T 00000000000000000000000000000000 P ae453fb922364b7ba986623c691f8aed [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:40:25.819968 18484 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae453fb922364b7ba986623c691f8aed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ae453fb922364b7ba986623c691f8aed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae453fb922364b7ba986623c691f8aed" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45867 } } }
I20260808 04:40:25.819998 18485 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae453fb922364b7ba986623c691f8aed [sys.catalog]: SysCatalogTable state changed. Reason: New leader ae453fb922364b7ba986623c691f8aed. Latest consensus state: current_term: 1 leader_uuid: "ae453fb922364b7ba986623c691f8aed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae453fb922364b7ba986623c691f8aed" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45867 } } }
I20260808 04:40:25.820116 18484 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae453fb922364b7ba986623c691f8aed [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:25.820117 18485 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae453fb922364b7ba986623c691f8aed [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:25.820469 18497 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:40:25.823596 18497 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:40:25.829041 18497 catalog_manager.cc:1347] Generated new cluster ID: cce04f88d4284135a5131f5a37eaedcd
I20260808 04:40:25.829099 18497 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:40:25.837139 18497 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:40:25.838057 18497 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:40:25.847189 18497 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ae453fb922364b7ba986623c691f8aed: Generated new TSK 0
I20260808 04:40:25.847842 18497 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.148.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab.
Entry for principal kudu/127.12.148.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab.
I20260808 04:40:25.883875 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.65:0
--local_ip_for_outbound_sockets=127.12.148.65
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:45867
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:35913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:26.003842 18523 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:26.004097 18523 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:26.004138 18523 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:26.008198 18523 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:26.008265 18523 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:26.008322 18523 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.65
I20260808 04:40:26.013370 18523 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:35913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:45867
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18523
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.65
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:26.014371 18523 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:26.015332 18523 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:26.024940 18537 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:26.025014 18523 server_base.cc:1034] running on GCE node
W20260808 04:40:26.024987 18534 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:26.025027 18535 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:26.025579 18523 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:26.026237 18523 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:26.027416 18523 hybrid_clock.cc:648] HybridClock initialized: now 1786164026027395 us; error 36 us; skew 500 ppm
Aug 08 04:40:26 dist-test-slave-t7g5 krb5kdc[18337](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164026, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:26.030090 18523 init.cc:377] Logged in from keytab as kudu/127.12.148.65@KRBTEST.COM (short username kudu)
I20260808 04:40:26.030964 18523 webserver.cc:460] Webserver started at http://127.12.148.65:45559/ using document root <none> and password file <none>
I20260808 04:40:26.031512 18523 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:26.031581 18523 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:26.031786 18523 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:26.033866 18523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-0/data/instance:
uuid: "9a04403c536d40d09fc97574cb1ed817"
format_stamp: "Formatted at 2026-08-08 04:40:26 on dist-test-slave-t7g5"
server_key: "0ea7ba924782f70a3522ae64b6588937"
server_key_iv: "53d413f27ac6e5f66f0e05fff02debb3"
server_key_version: "encryptionkey@0"
I20260808 04:40:26.034407 18523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance:
uuid: "9a04403c536d40d09fc97574cb1ed817"
format_stamp: "Formatted at 2026-08-08 04:40:26 on dist-test-slave-t7g5"
server_key: "0ea7ba924782f70a3522ae64b6588937"
server_key_iv: "53d413f27ac6e5f66f0e05fff02debb3"
server_key_version: "encryptionkey@0"
I20260808 04:40:26.038028 18523 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 04:40:26.040457 18550 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:26.041702 18523 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:40:26.041808 18523 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-0/wal
uuid: "9a04403c536d40d09fc97574cb1ed817"
format_stamp: "Formatted at 2026-08-08 04:40:26 on dist-test-slave-t7g5"
server_key: "0ea7ba924782f70a3522ae64b6588937"
server_key_iv: "53d413f27ac6e5f66f0e05fff02debb3"
server_key_version: "encryptionkey@0"
I20260808 04:40:26.041903 18523 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:26.059981 18523 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:26.062902 18523 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:26.063097 18523 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:26.063712 18523 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:26.064580 18523 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:26.064631 18523 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:26.064687 18523 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:26.064718 18523 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:26.073884 18523 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.65:33027
I20260808 04:40:26.073906 18709 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.65:33027 every 8 connection(s)
I20260808 04:40:26.074873 18523 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
I20260808 04:40:26.081279 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 18523
I20260808 04:40:26.081390 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance
I20260808 04:40:26.081642 12881 external_mini_cluster.cc:1428] Setting key 248d90b86da8dd201f08844e9c72a31d
Aug 08 04:40:26 dist-test-slave-t7g5 krb5kdc[18337](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164026, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:40:26.088996 18481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:26.076667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:53059 (local address 127.12.148.126:45867)
0808 04:40:26.076812 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:26.076816 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:26.077715 (+ 899us) server_negotiation.cc:407] Connection header received
0808 04:40:26.079234 (+ 1519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:26.079237 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:26.079285 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:26.079365 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:26.080617 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:26.081176 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:26.082398 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:26.082689 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:26.082779 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:26.085372 (+ 2593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:26.085376 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:26.085378 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:26.085408 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:26.086974 (+ 1566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:26.087464 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:26.087467 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:26.087469 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:26.087566 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:26.087844 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:26.087846 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:26.087848 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:26.088096 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:26.088210 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:26.088668 (+ 458us) server_negotiation.cc:299] Negotiation successful
0808 04:40:26.088817 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":16,"server-negotiator.queue_time_us":56}
I20260808 04:40:26.089761 18714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:26.077086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:45867 (local address 127.12.148.65:53059)
0808 04:40:26.077551 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:26.077597 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:26.078927 (+ 1330us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:26.079556 (+ 629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:26.079563 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:26.079938 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:26.080443 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:26.080457 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:26.081311 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:26.081313 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:26.082293 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:26.082304 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:26.082844 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:26.082848 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:26.083048 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:26.083656 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:26.083673 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:26.085207 (+ 1534us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:26.087095 (+ 1888us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:26.087100 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:26.087112 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:26.087363 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:26.087645 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:26.087647 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:26.087649 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:26.087771 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:26.088193 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:26.088198 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:26.088432 (+ 234us) client_negotiation.cc:769] Sending connection context
0808 04:40:26.088583 (+ 151us) client_negotiation.cc:240] Negotiation successful
0808 04:40:26.088862 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":122,"threads_started":1}
I20260808 04:40:26.090936 18710 heartbeater.cc:347] Connected to a master server at 127.12.148.126:45867
I20260808 04:40:26.091171 18710 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:26.091634 18710 heartbeater.cc:511] Master 127.12.148.126:45867 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.12.148.66@KRBTEST.COM; defaulting to no policy
I20260808 04:40:26.093091 18427 ts_manager.cc:194] Registered new tserver with Master: 9a04403c536d40d09fc97574cb1ed817 (127.12.148.65:33027)
I20260808 04:40:26.094359 18427 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.65@KRBTEST.COM'} at 127.12.148.65:53059
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab.
Entry for principal kudu/127.12.148.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab.
I20260808 04:40:26.110105 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.66:0
--local_ip_for_outbound_sockets=127.12.148.66
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:45867
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:35913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:26.224212 18717 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:26.224474 18717 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:26.224520 18717 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:26.228621 18717 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:26.228681 18717 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:26.228753 18717 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.66
I20260808 04:40:26.233981 18717 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:35913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:45867
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18717
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.66
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:26.234956 18717 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:26.236021 18717 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:26.245309 18732 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:26.245577 18717 server_base.cc:1034] running on GCE node
W20260808 04:40:26.245287 18726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:26.245321 18730 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:26.246119 18717 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:26.246722 18717 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:26.247879 18717 hybrid_clock.cc:648] HybridClock initialized: now 1786164026247855 us; error 36 us; skew 500 ppm
Aug 08 04:40:26 dist-test-slave-t7g5 krb5kdc[18337](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164026, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:26.250500 18717 init.cc:377] Logged in from keytab as kudu/127.12.148.66@KRBTEST.COM (short username kudu)
I20260808 04:40:26.251334 18717 webserver.cc:460] Webserver started at http://127.12.148.66:44435/ using document root <none> and password file <none>
I20260808 04:40:26.251858 18717 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:26.251925 18717 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:26.252141 18717 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:26.254185 18717 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-1/data/instance:
uuid: "9f48b38bc7a34e6892ed9a5bca89b98d"
format_stamp: "Formatted at 2026-08-08 04:40:26 on dist-test-slave-t7g5"
server_key: "c7473a404f8691cfc582d1dd51dc8456"
server_key_iv: "55b825a64efae26e3a968236d474a18c"
server_key_version: "encryptionkey@0"
I20260808 04:40:26.254719 18717 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance:
uuid: "9f48b38bc7a34e6892ed9a5bca89b98d"
format_stamp: "Formatted at 2026-08-08 04:40:26 on dist-test-slave-t7g5"
server_key: "c7473a404f8691cfc582d1dd51dc8456"
server_key_iv: "55b825a64efae26e3a968236d474a18c"
server_key_version: "encryptionkey@0"
I20260808 04:40:26.258304 18717 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 04:40:26.260593 18743 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:26.261802 18717 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260808 04:40:26.261909 18717 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-1/wal
uuid: "9f48b38bc7a34e6892ed9a5bca89b98d"
format_stamp: "Formatted at 2026-08-08 04:40:26 on dist-test-slave-t7g5"
server_key: "c7473a404f8691cfc582d1dd51dc8456"
server_key_iv: "55b825a64efae26e3a968236d474a18c"
server_key_version: "encryptionkey@0"
I20260808 04:40:26.262008 18717 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:26.280256 18717 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:26.282984 18717 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:26.283154 18717 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:26.283699 18717 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:26.284480 18717 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:26.284529 18717 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:26.284580 18717 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:26.284606 18717 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:26.292970 18717 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.66:44631
I20260808 04:40:26.293001 18919 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.66:44631 every 8 connection(s)
I20260808 04:40:26.293815 18717 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
I20260808 04:40:26.296794 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 18717
I20260808 04:40:26.296909 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance
I20260808 04:40:26.297158 12881 external_mini_cluster.cc:1428] Setting key ed6d106a65acbbe5efa8fbf77bf6ae7c
Aug 08 04:40:26 dist-test-slave-t7g5 krb5kdc[18337](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164026, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.148.67@KRBTEST.COM; defaulting to no policy
I20260808 04:40:26.306953 18481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:26.295421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:41503 (local address 127.12.148.126:45867)
0808 04:40:26.295564 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:26.295567 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:26.296318 (+ 751us) server_negotiation.cc:407] Connection header received
0808 04:40:26.297749 (+ 1431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:26.297752 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:26.297799 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:26.297901 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:26.299047 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:26.299740 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:26.300831 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:26.301060 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:26.301151 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:26.303645 (+ 2494us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:26.303648 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:26.303650 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:26.303674 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:26.304950 (+ 1276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:26.305430 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:26.305433 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:26.305435 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:26.305521 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:26.305884 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:26.305888 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:26.305889 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:26.306071 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:26.306160 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:26.306662 (+ 502us) server_negotiation.cc:299] Negotiation successful
0808 04:40:26.306789 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 04:40:26.307695 18922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:26.295762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:45867 (local address 127.12.148.66:41503)
0808 04:40:26.296180 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:26.296221 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:26.297511 (+ 1290us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:26.298048 (+ 537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:26.298054 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:26.298451 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:26.298907 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:26.298920 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:26.299847 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:26.299849 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:26.300709 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:26.300718 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:26.301194 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:26.301198 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:26.301353 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:26.301885 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:26.301901 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:26.303489 (+ 1588us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:26.305059 (+ 1570us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:26.305065 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:26.305080 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:26.305335 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:26.305606 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:26.305609 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:26.305611 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:26.305795 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:26.306175 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:26.306182 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:26.306422 (+ 240us) client_negotiation.cc:769] Sending connection context
0808 04:40:26.306583 (+ 161us) client_negotiation.cc:240] Negotiation successful
0808 04:40:26.306894 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":108,"threads_started":1}
I20260808 04:40:26.308743 18920 heartbeater.cc:347] Connected to a master server at 127.12.148.126:45867
I20260808 04:40:26.308991 18920 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.67@KRBTEST.COM" created.
I20260808 04:40:26.309542 18920 heartbeater.cc:511] Master 127.12.148.126:45867 requested a full tablet report, sending...
I20260808 04:40:26.310593 18427 ts_manager.cc:194] Registered new tserver with Master: 9f48b38bc7a34e6892ed9a5bca89b98d (127.12.148.66:44631)
I20260808 04:40:26.311328 18427 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.66@KRBTEST.COM'} at 127.12.148.66:41503
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab.
Entry for principal kudu/127.12.148.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab.
I20260808 04:40:26.324518 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.67:0
--local_ip_for_outbound_sockets=127.12.148.67
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:45867
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:35913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:26.433959 18925 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:26.434180 18925 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:26.434222 18925 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:26.438160 18925 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:26.438210 18925 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:26.438277 18925 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.67
I20260808 04:40:26.443423 18925 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:35913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:45867
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18925
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.67
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:26.444311 18925 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:26.445245 18925 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:26.454083 18936 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:26.454092 18934 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:26.454101 18939 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:26.454473 18925 server_base.cc:1034] running on GCE node
I20260808 04:40:26.454830 18925 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:26.455416 18925 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:26.456588 18925 hybrid_clock.cc:648] HybridClock initialized: now 1786164026456571 us; error 28 us; skew 500 ppm
Aug 08 04:40:26 dist-test-slave-t7g5 krb5kdc[18337](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164026, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:26.459193 18925 init.cc:377] Logged in from keytab as kudu/127.12.148.67@KRBTEST.COM (short username kudu)
I20260808 04:40:26.459997 18925 webserver.cc:460] Webserver started at http://127.12.148.67:39039/ using document root <none> and password file <none>
I20260808 04:40:26.460527 18925 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:26.460590 18925 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:26.460780 18925 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:26.462755 18925 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-2/data/instance:
uuid: "e49a2e6b02704d8fb9a840ba52cc8e98"
format_stamp: "Formatted at 2026-08-08 04:40:26 on dist-test-slave-t7g5"
server_key: "6df106ba4276eea296ff06beea196da9"
server_key_iv: "cfb04ae45e02c6479ef07117ae0f1746"
server_key_version: "encryptionkey@0"
I20260808 04:40:26.463291 18925 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance:
uuid: "e49a2e6b02704d8fb9a840ba52cc8e98"
format_stamp: "Formatted at 2026-08-08 04:40:26 on dist-test-slave-t7g5"
server_key: "6df106ba4276eea296ff06beea196da9"
server_key_iv: "cfb04ae45e02c6479ef07117ae0f1746"
server_key_version: "encryptionkey@0"
I20260808 04:40:26.466869 18925 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 04:40:26.469082 18952 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:26.470248 18925 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:40:26.470355 18925 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-2/wal
uuid: "e49a2e6b02704d8fb9a840ba52cc8e98"
format_stamp: "Formatted at 2026-08-08 04:40:26 on dist-test-slave-t7g5"
server_key: "6df106ba4276eea296ff06beea196da9"
server_key_iv: "cfb04ae45e02c6479ef07117ae0f1746"
server_key_version: "encryptionkey@0"
I20260808 04:40:26.470454 18925 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:26.495631 18925 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:26.498636 18925 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:26.498781 18925 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:26.499287 18925 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:26.500044 18925 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:26.500092 18925 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:26.500128 18925 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:26.500149 18925 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:26.508566 18925 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.67:37083
I20260808 04:40:26.508594 19128 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.67:37083 every 8 connection(s)
I20260808 04:40:26.509413 18925 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
I20260808 04:40:26.511082 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 18925
I20260808 04:40:26.511205 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance
I20260808 04:40:26.511526 12881 external_mini_cluster.cc:1428] Setting key 47db2c90685cc488bcd52c94c0334783
Aug 08 04:40:26 dist-test-slave-t7g5 krb5kdc[18337](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164026, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:40:26.522235 18481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:26.511124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:41497 (local address 127.12.148.126:45867)
0808 04:40:26.511244 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:26.511249 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:26.512267 (+ 1018us) server_negotiation.cc:407] Connection header received
0808 04:40:26.513956 (+ 1689us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:26.513958 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:26.514003 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:26.514058 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:26.515139 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:26.515664 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:26.516733 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:26.516937 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:26.517002 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:26.519247 (+ 2245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:26.519250 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:26.519252 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:26.519276 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:26.520479 (+ 1203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:26.520938 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:26.520941 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:26.520942 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:26.521010 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:26.521265 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:26.521267 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:26.521268 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:26.521434 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:26.521502 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:26.522018 (+ 516us) server_negotiation.cc:299] Negotiation successful
0808 04:40:26.522116 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 04:40:26.523025 19131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:26.511614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:45867 (local address 127.12.148.67:41497)
0808 04:40:26.512137 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:26.512180 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:26.513763 (+ 1583us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:26.514203 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:26.514210 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:26.514571 (+ 361us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:26.515034 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:26.515047 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:26.515756 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:26.515758 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:26.516644 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:26.516653 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:26.517038 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:26.517041 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:26.517174 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:26.517688 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:26.517709 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:26.519112 (+ 1403us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:26.520589 (+ 1477us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:26.520595 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:26.520610 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:26.520856 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:26.521069 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:26.521071 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:26.521072 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:26.521204 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:26.521551 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:26.521556 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:26.521814 (+ 258us) client_negotiation.cc:769] Sending connection context
0808 04:40:26.521978 (+ 164us) client_negotiation.cc:240] Negotiation successful
0808 04:40:26.522228 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":155,"threads_started":1}
I20260808 04:40:26.524200 19129 heartbeater.cc:347] Connected to a master server at 127.12.148.126:45867
I20260808 04:40:26.524464 19129 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:26.525053 19129 heartbeater.cc:511] Master 127.12.148.126:45867 requested a full tablet report, sending...
I20260808 04:40:26.526113 18427 ts_manager.cc:194] Registered new tserver with Master: e49a2e6b02704d8fb9a840ba52cc8e98 (127.12.148.67:37083)
I20260808 04:40:26.526648 18427 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.67@KRBTEST.COM'} at 127.12.148.67:41497
I20260808 04:40:26.536784 12881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 04:40:26 dist-test-slave-t7g5 krb5kdc[18337](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164026, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 04:40:26 dist-test-slave-t7g5 krb5kdc[18337](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164026, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.148.65@KRBTEST.COM
I20260808 04:40:26.562677 19138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:26.553819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49646 (local address 127.12.148.65:33027)
0808 04:40:26.554126 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:26.554141 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:26.554163 (+ 22us) server_negotiation.cc:407] Connection header received
0808 04:40:26.554211 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:26.554216 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:26.554411 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:26.554530 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:26.555139 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:26.555975 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:26.556768 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:26.557152 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:26.557233 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:26.559423 (+ 2190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:26.559431 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:26.559443 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:26.559466 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:26.560998 (+ 1532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:26.561356 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:26.561361 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:26.561362 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:26.561443 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:26.561635 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:26.561637 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:26.561638 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:26.561905 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:26.562067 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:26.562343 (+ 276us) server_negotiation.cc:299] Negotiation successful
0808 04:40:26.562513 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":106,"threads_started":1}
Aug 08 04:40:26 dist-test-slave-t7g5 krb5kdc[18337](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164026, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:40:26.572094 18481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:26.565277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36344 (local address 127.12.148.126:45867)
0808 04:40:26.565417 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:26.565420 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:26.565434 (+ 14us) server_negotiation.cc:407] Connection header received
0808 04:40:26.565543 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:26.565546 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:26.565594 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:26.565685 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:26.566266 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:26.566778 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:26.567454 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:26.567650 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:26.567714 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:26.569700 (+ 1986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:26.569704 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:26.569707 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:26.569736 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:26.570798 (+ 1062us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:26.571153 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:26.571155 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:26.571156 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:26.571231 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:26.571415 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:26.571417 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:26.571418 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:26.571617 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:26.571720 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:26.571850 (+ 130us) server_negotiation.cc:299] Negotiation successful
0808 04:40:26.571939 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
W20260808 04:40:26.572471 18427 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36344
I20260808 04:40:26.573041 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 18523
I20260808 04:40:26.586724 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 18717
I20260808 04:40:26.595378 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 18925
I20260808 04:40:26.614390 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 18361
2026-08-08T04:40:26Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2261 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:40:26 dist-test-slave-t7g5 krb5kdc[19145](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:40:26 dist-test-slave-t7g5 krb5kdc[19145](info): set up 2 sockets
Aug 08 04:40:26 dist-test-slave-t7g5 krb5kdc[19145](info): commencing operation
krb5kdc: starting...
W20260808 04:40:27.763357 12881 mini_kdc.cc:121] Time spent starting KDC: real 1.121s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Aug 08 04:40:27 dist-test-slave-t7g5 krb5kdc[19145](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164027, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:40:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:40:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.148.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
I20260808 04:40:27.881459 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:46865
--webserver_interface=127.12.148.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:39867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:46865
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:27.991089 19161 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:27.991343 19161 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:27.991386 19161 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:27.995306 19161 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:40:27.995349 19161 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:27.995366 19161 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:27.995381 19161 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:40:27.995394 19161 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:40:28.000346 19161 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:39867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:46865
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:46865
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19161
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:28.001242 19161 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:28.002175 19161 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:28.010087 19172 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:28.010149 19161 server_base.cc:1034] running on GCE node
W20260808 04:40:28.010069 19171 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:28.010084 19176 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:28.010910 19161 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:28.011982 19161 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:28.013145 19161 hybrid_clock.cc:648] HybridClock initialized: now 1786164028013125 us; error 30 us; skew 500 ppm
Aug 08 04:40:28 dist-test-slave-t7g5 krb5kdc[19145](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164028, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:28.015810 19161 init.cc:377] Logged in from keytab as kudu/127.12.148.126@KRBTEST.COM (short username kudu)
I20260808 04:40:28.016525 19161 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:28.016593 19161 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:28.016814 19161 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:28.018828 19161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "9c74702efa314ad6a61811eb73567f60"
format_stamp: "Formatted at 2026-08-08 04:40:28 on dist-test-slave-t7g5"
server_key: "9f1e3113b382adcd5f78d3480e25513c"
server_key_iv: "7f2ab743a0649cc8d8e3f6ffe978ba52"
server_key_version: "encryptionkey@0"
I20260808 04:40:28.019368 19161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "9c74702efa314ad6a61811eb73567f60"
format_stamp: "Formatted at 2026-08-08 04:40:28 on dist-test-slave-t7g5"
server_key: "9f1e3113b382adcd5f78d3480e25513c"
server_key_iv: "7f2ab743a0649cc8d8e3f6ffe978ba52"
server_key_version: "encryptionkey@0"
I20260808 04:40:28.022823 19161 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 04:40:28.025116 19195 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:28.026338 19161 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 04:40:28.026453 19161 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "9c74702efa314ad6a61811eb73567f60"
format_stamp: "Formatted at 2026-08-08 04:40:28 on dist-test-slave-t7g5"
server_key: "9f1e3113b382adcd5f78d3480e25513c"
server_key_iv: "7f2ab743a0649cc8d8e3f6ffe978ba52"
server_key_version: "encryptionkey@0"
I20260808 04:40:28.026544 19161 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:28.038620 19161 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:28.041301 19161 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:28.041468 19161 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:28.047983 19161 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:46865
I20260808 04:40:28.048228 19268 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:46865 every 8 connection(s)
I20260808 04:40:28.048602 19161 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:40:28.051245 19270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:28.056528 19270 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c74702efa314ad6a61811eb73567f60: Bootstrap starting.
I20260808 04:40:28.056865 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 19161
I20260808 04:40:28.056981 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:40:28.057214 12881 external_mini_cluster.cc:1428] Setting key b5341b3999a887e77552f962240f7b16
I20260808 04:40:28.058949 19270 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9c74702efa314ad6a61811eb73567f60: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:28.059648 19270 log.cc:824] T 00000000000000000000000000000000 P 9c74702efa314ad6a61811eb73567f60: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:28.061394 19270 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c74702efa314ad6a61811eb73567f60: No bootstrap required, opened a new log
I20260808 04:40:28.064626 19270 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9c74702efa314ad6a61811eb73567f60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c74702efa314ad6a61811eb73567f60" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 46865 } }
I20260808 04:40:28.064878 19270 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9c74702efa314ad6a61811eb73567f60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:28.064942 19270 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9c74702efa314ad6a61811eb73567f60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c74702efa314ad6a61811eb73567f60, State: Initialized, Role: FOLLOWER
Aug 08 04:40:28 dist-test-slave-t7g5 krb5kdc[19145](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164027, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:40:28.065431 19270 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c74702efa314ad6a61811eb73567f60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c74702efa314ad6a61811eb73567f60" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 46865 } }
I20260808 04:40:28.065580 19270 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9c74702efa314ad6a61811eb73567f60 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:40:28.065644 19270 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9c74702efa314ad6a61811eb73567f60 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:40:28.065761 19270 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9c74702efa314ad6a61811eb73567f60 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:28.066783 19270 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9c74702efa314ad6a61811eb73567f60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c74702efa314ad6a61811eb73567f60" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 46865 } }
I20260808 04:40:28.067127 19270 leader_election.cc:302] T 00000000000000000000000000000000 P 9c74702efa314ad6a61811eb73567f60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9c74702efa314ad6a61811eb73567f60; no voters:
I20260808 04:40:28.067401 19270 leader_election.cc:288] T 00000000000000000000000000000000 P 9c74702efa314ad6a61811eb73567f60 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:40:28.067488 19278 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9c74702efa314ad6a61811eb73567f60 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:28.067651 19278 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9c74702efa314ad6a61811eb73567f60 [term 1 LEADER]: Becoming Leader. State: Replica: 9c74702efa314ad6a61811eb73567f60, State: Running, Role: LEADER
I20260808 04:40:28.067998 19278 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9c74702efa314ad6a61811eb73567f60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c74702efa314ad6a61811eb73567f60" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 46865 } }
I20260808 04:40:28.068663 19270 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9c74702efa314ad6a61811eb73567f60 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:40:28.069623 19279 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c74702efa314ad6a61811eb73567f60 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9c74702efa314ad6a61811eb73567f60. Latest consensus state: current_term: 1 leader_uuid: "9c74702efa314ad6a61811eb73567f60" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c74702efa314ad6a61811eb73567f60" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 46865 } } }
I20260808 04:40:28.069763 19279 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c74702efa314ad6a61811eb73567f60 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:28.070071 19280 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c74702efa314ad6a61811eb73567f60 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9c74702efa314ad6a61811eb73567f60" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c74702efa314ad6a61811eb73567f60" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 46865 } } }
I20260808 04:40:28.070149 19280 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c74702efa314ad6a61811eb73567f60 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:28.071630 19275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:28.058420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59332 (local address 127.12.148.126:46865)
0808 04:40:28.058796 (+ 376us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:28.058813 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:28.058859 (+ 46us) server_negotiation.cc:407] Connection header received
0808 04:40:28.059509 (+ 650us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:28.059526 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:28.059874 (+ 348us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:28.060187 (+ 313us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:28.060956 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:28.062011 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:28.062831 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:28.063299 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:28.063445 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:28.066047 (+ 2602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:28.066053 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:28.066068 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:28.066098 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:28.067939 (+ 1841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:28.068389 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:28.068393 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:28.068398 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:28.068504 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:28.068802 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:28.068806 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:28.068808 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:28.069299 (+ 491us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:28.070162 (+ 863us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:28.070319 (+ 157us) server_negotiation.cc:299] Negotiation successful
0808 04:40:28.070590 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241,"thread_start_us":92,"threads_started":1}
W20260808 04:40:28.073611 19297 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9c74702efa314ad6a61811eb73567f60: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 04:40:28.073724 19297 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 04:40:28.073840 19287 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:40:28.074750 19287 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:40:28.079860 19287 catalog_manager.cc:1347] Generated new cluster ID: 764ac8e6e9a341a6be500d6f242b647c
I20260808 04:40:28.079924 19287 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:40:28.130673 19287 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:40:28.131963 19287 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:40:28.141942 19287 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9c74702efa314ad6a61811eb73567f60: Generated new TSK 0
I20260808 04:40:28.142766 19287 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.148.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab.
Entry for principal kudu/127.12.148.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab.
I20260808 04:40:28.179862 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.65:0
--local_ip_for_outbound_sockets=127.12.148.65
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:46865
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:39867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:28.294507 19306 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:28.294770 19306 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:28.294816 19306 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:28.298856 19306 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:28.298913 19306 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:28.298985 19306 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.65
I20260808 04:40:28.304220 19306 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:39867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:46865
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19306
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.65
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:28.305233 19306 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:28.306295 19306 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:28.315606 19314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:28.315727 19306 server_base.cc:1034] running on GCE node
W20260808 04:40:28.315606 19312 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:28.315608 19316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:28.316321 19306 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:28.316992 19306 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:28.318158 19306 hybrid_clock.cc:648] HybridClock initialized: now 1786164028318141 us; error 32 us; skew 500 ppm
Aug 08 04:40:28 dist-test-slave-t7g5 krb5kdc[19145](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164028, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:28.320839 19306 init.cc:377] Logged in from keytab as kudu/127.12.148.65@KRBTEST.COM (short username kudu)
I20260808 04:40:28.321555 19306 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:28.321625 19306 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:28.321847 19306 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:28.323891 19306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-0/data/instance:
uuid: "fd5efc8ae9cb464983ea6bfb6587a930"
format_stamp: "Formatted at 2026-08-08 04:40:28 on dist-test-slave-t7g5"
server_key: "05beda20665bcae93c65158464c9cdc1"
server_key_iv: "378d429003f238b932439f2d39dd7cd6"
server_key_version: "encryptionkey@0"
I20260808 04:40:28.324433 19306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance:
uuid: "fd5efc8ae9cb464983ea6bfb6587a930"
format_stamp: "Formatted at 2026-08-08 04:40:28 on dist-test-slave-t7g5"
server_key: "05beda20665bcae93c65158464c9cdc1"
server_key_iv: "378d429003f238b932439f2d39dd7cd6"
server_key_version: "encryptionkey@0"
I20260808 04:40:28.328094 19306 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 04:40:28.330469 19325 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:28.331700 19306 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:40:28.331810 19306 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-0/wal
uuid: "fd5efc8ae9cb464983ea6bfb6587a930"
format_stamp: "Formatted at 2026-08-08 04:40:28 on dist-test-slave-t7g5"
server_key: "05beda20665bcae93c65158464c9cdc1"
server_key_iv: "378d429003f238b932439f2d39dd7cd6"
server_key_version: "encryptionkey@0"
I20260808 04:40:28.331912 19306 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:28.358387 19306 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:28.361559 19306 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:28.361778 19306 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:28.362377 19306 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:28.363242 19306 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:28.363301 19306 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:28.363368 19306 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:28.363391 19306 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:28.371917 19306 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.65:35061
I20260808 04:40:28.371953 19498 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.65:35061 every 8 connection(s)
I20260808 04:40:28.372489 19306 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
I20260808 04:40:28.373934 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 19306
I20260808 04:40:28.374058 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance
I20260808 04:40:28.374362 12881 external_mini_cluster.cc:1428] Setting key 2f94f00a4c71e0c3164f3fae4ee3e7eb
Aug 08 04:40:28 dist-test-slave-t7g5 krb5kdc[19145](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164028, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.148.66@KRBTEST.COM; defaulting to no policy
I20260808 04:40:28.386144 19275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:28.374179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:39035 (local address 127.12.148.126:46865)
0808 04:40:28.374341 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:28.374346 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:28.375473 (+ 1127us) server_negotiation.cc:407] Connection header received
0808 04:40:28.376358 (+ 885us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:28.376361 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:28.376417 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:28.376490 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:28.377748 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:28.378289 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:28.379569 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:28.379895 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:28.380011 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:28.382676 (+ 2665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:28.382679 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:28.382681 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:28.382706 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:28.384048 (+ 1342us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:28.384620 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:28.384623 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:28.384624 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:28.384692 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:28.385073 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:28.385076 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:28.385077 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:28.385264 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:28.385346 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:28.385905 (+ 559us) server_negotiation.cc:299] Negotiation successful
0808 04:40:28.386017 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 04:40:28.386876 19503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:28.374603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46865 (local address 127.12.148.65:39035)
0808 04:40:28.375301 (+ 698us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:28.375370 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:28.376159 (+ 789us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:28.376654 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:28.376662 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:28.377008 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:28.377549 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:28.377571 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:28.378416 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:28.378419 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:28.379446 (+ 1027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:28.379457 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:28.380033 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:28.380035 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:28.380170 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:28.380706 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:28.380722 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:28.382500 (+ 1778us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:28.384166 (+ 1666us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:28.384173 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:28.384189 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:28.384535 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:28.384767 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:28.384770 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:28.384772 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:28.384974 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:28.385363 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:28.385368 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:28.385613 (+ 245us) client_negotiation.cc:769] Sending connection context
0808 04:40:28.385824 (+ 211us) client_negotiation.cc:240] Negotiation successful
0808 04:40:28.386098 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":110,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.66@KRBTEST.COM" created.
I20260808 04:40:28.388155 19501 heartbeater.cc:347] Connected to a master server at 127.12.148.126:46865
I20260808 04:40:28.388388 19501 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:28.388828 19501 heartbeater.cc:511] Master 127.12.148.126:46865 requested a full tablet report, sending...
I20260808 04:40:28.390295 19219 ts_manager.cc:194] Registered new tserver with Master: fd5efc8ae9cb464983ea6bfb6587a930 (127.12.148.65:35061)
I20260808 04:40:28.391399 19219 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.65@KRBTEST.COM'} at 127.12.148.65:39035
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab.
Entry for principal kudu/127.12.148.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab.
I20260808 04:40:28.401801 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.66:0
--local_ip_for_outbound_sockets=127.12.148.66
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:46865
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:39867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:28.510424 19507 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:28.510679 19507 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:28.510742 19507 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:28.514708 19507 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:28.514766 19507 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:28.514851 19507 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.66
I20260808 04:40:28.520028 19507 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:39867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:46865
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19507
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.66
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:28.521044 19507 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:28.522074 19507 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:28.531193 19514 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:28.531247 19513 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:28.531193 19516 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:28.531476 19507 server_base.cc:1034] running on GCE node
I20260808 04:40:28.531885 19507 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:28.532493 19507 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:28.533641 19507 hybrid_clock.cc:648] HybridClock initialized: now 1786164028533611 us; error 42 us; skew 500 ppm
Aug 08 04:40:28 dist-test-slave-t7g5 krb5kdc[19145](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164028, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:28.536437 19507 init.cc:377] Logged in from keytab as kudu/127.12.148.66@KRBTEST.COM (short username kudu)
I20260808 04:40:28.537125 19507 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:28.537189 19507 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:28.537360 19507 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:28.539327 19507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-1/data/instance:
uuid: "888eb8d32bad49feb6b843c94206d716"
format_stamp: "Formatted at 2026-08-08 04:40:28 on dist-test-slave-t7g5"
server_key: "aec6a887348f1e2cbe03c5720300ee2a"
server_key_iv: "931afc4e183772655b11419707006d59"
server_key_version: "encryptionkey@0"
I20260808 04:40:28.539836 19507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance:
uuid: "888eb8d32bad49feb6b843c94206d716"
format_stamp: "Formatted at 2026-08-08 04:40:28 on dist-test-slave-t7g5"
server_key: "aec6a887348f1e2cbe03c5720300ee2a"
server_key_iv: "931afc4e183772655b11419707006d59"
server_key_version: "encryptionkey@0"
I20260808 04:40:28.543315 19507 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260808 04:40:28.545509 19524 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:28.546710 19507 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:40:28.546826 19507 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-1/wal
uuid: "888eb8d32bad49feb6b843c94206d716"
format_stamp: "Formatted at 2026-08-08 04:40:28 on dist-test-slave-t7g5"
server_key: "aec6a887348f1e2cbe03c5720300ee2a"
server_key_iv: "931afc4e183772655b11419707006d59"
server_key_version: "encryptionkey@0"
I20260808 04:40:28.546921 19507 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:28.579137 19507 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:28.582379 19507 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:28.582566 19507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:28.583148 19507 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:28.583983 19507 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:28.584033 19507 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:28.584080 19507 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:28.584110 19507 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:28.593202 19507 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.66:40905
I20260808 04:40:28.593243 19691 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.66:40905 every 8 connection(s)
I20260808 04:40:28.593998 19507 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
I20260808 04:40:28.597540 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 19507
I20260808 04:40:28.597690 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance
I20260808 04:40:28.598012 12881 external_mini_cluster.cc:1428] Setting key 84ec82ad1ea534069429ef58292ac400
Aug 08 04:40:28 dist-test-slave-t7g5 krb5kdc[19145](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164028, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:40:28.608009 19275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:28.595633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:38345 (local address 127.12.148.126:46865)
0808 04:40:28.595757 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:28.595760 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:28.596880 (+ 1120us) server_negotiation.cc:407] Connection header received
0808 04:40:28.597941 (+ 1061us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:28.597944 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:28.597994 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:28.598068 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:28.599430 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:28.599961 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:28.601458 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:28.601791 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:28.601904 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:28.604385 (+ 2481us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:28.604389 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:28.604392 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:28.604422 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:28.605827 (+ 1405us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:28.606430 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:28.606433 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:28.606434 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:28.606513 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:28.606878 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:28.606880 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:28.606881 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:28.607045 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:28.607115 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:28.607779 (+ 664us) server_negotiation.cc:299] Negotiation successful
0808 04:40:28.607888 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
WARNING: no policy specified for kudu/127.12.148.67@KRBTEST.COM; defaulting to no policy
I20260808 04:40:28.609179 19695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:28.595967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46865 (local address 127.12.148.66:38345)
0808 04:40:28.596731 (+ 764us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:28.596772 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:28.597692 (+ 920us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:28.598252 (+ 560us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:28.598261 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:28.598656 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:28.599296 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:28.599313 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:28.600087 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:28.600091 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:28.601333 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:28.601345 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:28.601931 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:28.601934 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:28.602080 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:28.602611 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:28.602626 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:28.604203 (+ 1577us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:28.605950 (+ 1747us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:28.605957 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:28.605974 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:28.606331 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:28.606594 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:28.606597 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:28.606600 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:28.606784 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:28.607141 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:28.607148 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:28.607513 (+ 365us) client_negotiation.cc:769] Sending connection context
0808 04:40:28.607734 (+ 221us) client_negotiation.cc:240] Negotiation successful
0808 04:40:28.608096 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":112,"threads_started":1}
I20260808 04:40:28.610330 19693 heartbeater.cc:347] Connected to a master server at 127.12.148.126:46865
I20260808 04:40:28.610548 19693 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:28.610970 19693 heartbeater.cc:511] Master 127.12.148.126:46865 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.67@KRBTEST.COM" created.
I20260808 04:40:28.612021 19219 ts_manager.cc:194] Registered new tserver with Master: 888eb8d32bad49feb6b843c94206d716 (127.12.148.66:40905)
I20260808 04:40:28.612591 19219 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.66@KRBTEST.COM'} at 127.12.148.66:38345
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab.
Entry for principal kudu/127.12.148.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab.
I20260808 04:40:28.626704 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.67:0
--local_ip_for_outbound_sockets=127.12.148.67
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:46865
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:39867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:28.736413 19707 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:28.736647 19707 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:28.736697 19707 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:28.740631 19707 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:28.740684 19707 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:28.740757 19707 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.67
I20260808 04:40:28.745800 19707 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:39867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:46865
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19707
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.67
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:28.746701 19707 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:28.747632 19707 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:28.756738 19718 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:28.756937 19707 server_base.cc:1034] running on GCE node
W20260808 04:40:28.756827 19714 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:28.756747 19715 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:28.757412 19707 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:28.758028 19707 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:28.759191 19707 hybrid_clock.cc:648] HybridClock initialized: now 1786164028759170 us; error 34 us; skew 500 ppm
Aug 08 04:40:28 dist-test-slave-t7g5 krb5kdc[19145](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164028, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:28.761801 19707 init.cc:377] Logged in from keytab as kudu/127.12.148.67@KRBTEST.COM (short username kudu)
I20260808 04:40:28.762513 19707 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:28.762583 19707 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:28.762781 19707 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:28.764719 19707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-2/data/instance:
uuid: "766bad19ff6c49bc98a0eb558198aac8"
format_stamp: "Formatted at 2026-08-08 04:40:28 on dist-test-slave-t7g5"
server_key: "2204c0cc7e96b60f9b8903df2ccb2967"
server_key_iv: "93fcba6d2e5764caa6002e90aabdecbe"
server_key_version: "encryptionkey@0"
I20260808 04:40:28.765244 19707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance:
uuid: "766bad19ff6c49bc98a0eb558198aac8"
format_stamp: "Formatted at 2026-08-08 04:40:28 on dist-test-slave-t7g5"
server_key: "2204c0cc7e96b60f9b8903df2ccb2967"
server_key_iv: "93fcba6d2e5764caa6002e90aabdecbe"
server_key_version: "encryptionkey@0"
I20260808 04:40:28.768796 19707 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 04:40:28.771214 19728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:28.772452 19707 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 04:40:28.772565 19707 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-2/wal
uuid: "766bad19ff6c49bc98a0eb558198aac8"
format_stamp: "Formatted at 2026-08-08 04:40:28 on dist-test-slave-t7g5"
server_key: "2204c0cc7e96b60f9b8903df2ccb2967"
server_key_iv: "93fcba6d2e5764caa6002e90aabdecbe"
server_key_version: "encryptionkey@0"
I20260808 04:40:28.772657 19707 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:28.788725 19707 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:28.791467 19707 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:28.791648 19707 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:28.792196 19707 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:28.793027 19707 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:28.793076 19707 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:28.793128 19707 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:28.793165 19707 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:28.801810 19707 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.67:32937
I20260808 04:40:28.801827 19896 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.67:32937 every 8 connection(s)
I20260808 04:40:28.802409 19707 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
I20260808 04:40:28.802897 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 19707
I20260808 04:40:28.803033 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance
I20260808 04:40:28.803375 12881 external_mini_cluster.cc:1428] Setting key 082eeae654bc9c25b1a329f506e1034d
Aug 08 04:40:28 dist-test-slave-t7g5 krb5kdc[19145](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164028, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:40:28.818635 19275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:28.808762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:47791 (local address 127.12.148.126:46865)
0808 04:40:28.808918 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:28.808923 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:28.808941 (+ 18us) server_negotiation.cc:407] Connection header received
0808 04:40:28.808985 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:28.808988 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:28.809042 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:28.809137 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:28.810547 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:28.811301 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:28.812729 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:28.812961 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:28.813037 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:28.815298 (+ 2261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:28.815301 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:28.815303 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:28.815327 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:28.816446 (+ 1119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:28.817150 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:28.817153 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:28.817155 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:28.817254 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:28.817602 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:28.817606 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:28.817607 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:28.817858 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:28.817936 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:28.818422 (+ 486us) server_negotiation.cc:299] Negotiation successful
0808 04:40:28.818519 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 04:40:28.819495 19900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:28.804901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46865 (local address 127.12.148.67:47791)
0808 04:40:28.806028 (+ 1127us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:28.806080 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:28.806951 (+ 871us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:28.809326 (+ 2375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:28.809334 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:28.809777 (+ 443us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:28.810384 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:28.810403 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:28.811417 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:28.811419 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:28.812607 (+ 1188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:28.812618 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:28.813071 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:28.813073 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:28.813213 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:28.813789 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:28.813805 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:28.815149 (+ 1344us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:28.816675 (+ 1526us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:28.816680 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:28.816692 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:28.817038 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:28.817335 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:28.817338 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:28.817340 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:28.817499 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:28.817952 (+ 453us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:28.817957 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:28.818194 (+ 237us) client_negotiation.cc:769] Sending connection context
0808 04:40:28.818344 (+ 150us) client_negotiation.cc:240] Negotiation successful
0808 04:40:28.818602 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":125,"threads_started":1}
I20260808 04:40:28.820549 19898 heartbeater.cc:347] Connected to a master server at 127.12.148.126:46865
I20260808 04:40:28.820772 19898 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:28.821192 19898 heartbeater.cc:511] Master 127.12.148.126:46865 requested a full tablet report, sending...
I20260808 04:40:28.822162 19219 ts_manager.cc:194] Registered new tserver with Master: 766bad19ff6c49bc98a0eb558198aac8 (127.12.148.67:32937)
I20260808 04:40:28.822667 19219 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.67@KRBTEST.COM'} at 127.12.148.67:47791
I20260808 04:40:28.829209 12881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 04:40:28.837361 19275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:28.831170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59344 (local address 127.12.148.126:46865)
0808 04:40:28.831263 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:28.831266 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:28.831454 (+ 188us) server_negotiation.cc:407] Connection header received
0808 04:40:28.831552 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:28.831554 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:28.831588 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:28.831647 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:28.832234 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:28.832709 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:28.833466 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:28.833707 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:28.833777 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:28.834919 (+ 1142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:28.834922 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:28.834924 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:28.834945 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:28.836076 (+ 1131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:28.836464 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:28.836467 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:28.836468 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:28.836541 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:28.836726 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:28.836727 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:28.836729 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:28.836926 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:28.837020 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:28.837168 (+ 148us) server_negotiation.cc:299] Negotiation successful
0808 04:40:28.837251 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 04:40:28.839722 19219 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59344:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:40:28.842653 19219 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:40:28.856172 19911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:28.850371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:35061 (local address 127.0.0.1:59802)
0808 04:40:28.850786 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:28.850832 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:28.850963 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:28.851768 (+ 805us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:28.851774 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:28.851796 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:28.851925 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:28.851932 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:28.853371 (+ 1439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:28.853374 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:28.854692 (+ 1318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:28.854702 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:28.855616 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:28.855620 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:28.855730 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:28.855773 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 04:40:28.855889 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 04:40:28.856024 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"mutex_wait_us":64,"thread_start_us":83,"threads_started":1}
I20260808 04:40:28.856182 19914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:28.850488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59802 (local address 127.12.148.65:35061)
0808 04:40:28.850914 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:28.850921 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:28.850946 (+ 25us) server_negotiation.cc:407] Connection header received
0808 04:40:28.851176 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:28.851182 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:28.851395 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:28.851565 (+ 170us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:28.852069 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:28.853228 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:28.854814 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:28.855488 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:28.855592 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:28.855731 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:28.855929 (+ 198us) server_negotiation.cc:299] Negotiation successful
0808 04:40:28.856027 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":97,"threads_started":1}
I20260808 04:40:28.856331 19916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:28.851157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.67:32937 (local address 127.0.0.1:51912)
0808 04:40:28.851654 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:28.851666 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:28.851747 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:28.852520 (+ 773us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:28.852523 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:28.852538 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:28.852614 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:28.852620 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:28.853803 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:28.853806 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:28.855072 (+ 1266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:28.855084 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:28.855993 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:28.855997 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:28.856092 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:28.856115 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 04:40:28.856162 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 04:40:28.856222 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":431,"mutex_wait_us":51,"thread_start_us":83,"threads_started":1}
I20260808 04:40:28.856480 19915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:28.850482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:40905 (local address 127.0.0.1:42166)
0808 04:40:28.851236 (+ 754us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:28.851250 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:28.851349 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:28.852393 (+ 1044us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:28.852396 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:28.852413 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:28.852514 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:28.852521 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:28.853713 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:28.853716 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:28.855077 (+ 1361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:28.855084 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:28.856111 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:28.856115 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:28.856202 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:28.856226 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 04:40:28.856276 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 04:40:28.856348 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":695,"mutex_wait_us":102,"thread_start_us":107,"threads_started":1}
I20260808 04:40:28.857072 19917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:28.851156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42166 (local address 127.12.148.66:40905)
0808 04:40:28.851945 (+ 789us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:28.851960 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:28.851982 (+ 22us) server_negotiation.cc:407] Connection header received
0808 04:40:28.852056 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:28.852061 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:28.852250 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:28.852400 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:28.852613 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:28.853584 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:28.855200 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:28.855976 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:28.856660 (+ 684us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:28.856798 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:28.856854 (+ 56us) server_negotiation.cc:299] Negotiation successful
0808 04:40:28.856934 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":121,"threads_started":1}
I20260808 04:40:28.857132 19922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:28.851549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51912 (local address 127.12.148.67:32937)
0808 04:40:28.852135 (+ 586us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:28.852143 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:28.852160 (+ 17us) server_negotiation.cc:407] Connection header received
0808 04:40:28.852217 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:28.852221 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:28.852376 (+ 155us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:28.852724 (+ 348us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:28.852837 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:28.853649 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:28.855219 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:28.855873 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:28.856798 (+ 925us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:28.856914 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:28.856954 (+ 40us) server_negotiation.cc:299] Negotiation successful
0808 04:40:28.857016 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":498,"thread_start_us":103,"threads_started":1}
I20260808 04:40:28.859342 19403 tablet_service.cc:1467] Processing CreateTablet for tablet 61a4ea0c31d443be835b6192e9c1eb4f (DEFAULT_TABLE table=test-table [id=2afb1490bae845efba2f9f0795f4c66a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:28.859709 19606 tablet_service.cc:1467] Processing CreateTablet for tablet 61a4ea0c31d443be835b6192e9c1eb4f (DEFAULT_TABLE table=test-table [id=2afb1490bae845efba2f9f0795f4c66a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:28.860324 19403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61a4ea0c31d443be835b6192e9c1eb4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:28.860744 19606 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61a4ea0c31d443be835b6192e9c1eb4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:28.860584 19801 tablet_service.cc:1467] Processing CreateTablet for tablet 61a4ea0c31d443be835b6192e9c1eb4f (DEFAULT_TABLE table=test-table [id=2afb1490bae845efba2f9f0795f4c66a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:28.861536 19801 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61a4ea0c31d443be835b6192e9c1eb4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:28.866788 19923 tablet_bootstrap.cc:492] T 61a4ea0c31d443be835b6192e9c1eb4f P fd5efc8ae9cb464983ea6bfb6587a930: Bootstrap starting.
I20260808 04:40:28.867597 19924 tablet_bootstrap.cc:492] T 61a4ea0c31d443be835b6192e9c1eb4f P 888eb8d32bad49feb6b843c94206d716: Bootstrap starting.
I20260808 04:40:28.869488 19923 tablet_bootstrap.cc:654] T 61a4ea0c31d443be835b6192e9c1eb4f P fd5efc8ae9cb464983ea6bfb6587a930: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:28.869616 19924 tablet_bootstrap.cc:654] T 61a4ea0c31d443be835b6192e9c1eb4f P 888eb8d32bad49feb6b843c94206d716: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:28.869932 19925 tablet_bootstrap.cc:492] T 61a4ea0c31d443be835b6192e9c1eb4f P 766bad19ff6c49bc98a0eb558198aac8: Bootstrap starting.
I20260808 04:40:28.870805 19923 log.cc:824] T 61a4ea0c31d443be835b6192e9c1eb4f P fd5efc8ae9cb464983ea6bfb6587a930: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:28.870805 19924 log.cc:824] T 61a4ea0c31d443be835b6192e9c1eb4f P 888eb8d32bad49feb6b843c94206d716: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:28.871747 19925 tablet_bootstrap.cc:654] T 61a4ea0c31d443be835b6192e9c1eb4f P 766bad19ff6c49bc98a0eb558198aac8: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:28.872803 19924 tablet_bootstrap.cc:492] T 61a4ea0c31d443be835b6192e9c1eb4f P 888eb8d32bad49feb6b843c94206d716: No bootstrap required, opened a new log
I20260808 04:40:28.872833 19925 log.cc:824] T 61a4ea0c31d443be835b6192e9c1eb4f P 766bad19ff6c49bc98a0eb558198aac8: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:28.872896 19923 tablet_bootstrap.cc:492] T 61a4ea0c31d443be835b6192e9c1eb4f P fd5efc8ae9cb464983ea6bfb6587a930: No bootstrap required, opened a new log
I20260808 04:40:28.872989 19924 ts_tablet_manager.cc:1397] T 61a4ea0c31d443be835b6192e9c1eb4f P 888eb8d32bad49feb6b843c94206d716: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 04:40:28.873065 19923 ts_tablet_manager.cc:1397] T 61a4ea0c31d443be835b6192e9c1eb4f P fd5efc8ae9cb464983ea6bfb6587a930: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 04:40:28.874665 19925 tablet_bootstrap.cc:492] T 61a4ea0c31d443be835b6192e9c1eb4f P 766bad19ff6c49bc98a0eb558198aac8: No bootstrap required, opened a new log
I20260808 04:40:28.874840 19925 ts_tablet_manager.cc:1397] T 61a4ea0c31d443be835b6192e9c1eb4f P 766bad19ff6c49bc98a0eb558198aac8: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 04:40:28.876087 19924 raft_consensus.cc:348] T 61a4ea0c31d443be835b6192e9c1eb4f P 888eb8d32bad49feb6b843c94206d716 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd5efc8ae9cb464983ea6bfb6587a930" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 35061 } } peers { permanent_uuid: "888eb8d32bad49feb6b843c94206d716" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40905 } } peers { permanent_uuid: "766bad19ff6c49bc98a0eb558198aac8" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 32937 } }
I20260808 04:40:28.876328 19924 raft_consensus.cc:374] T 61a4ea0c31d443be835b6192e9c1eb4f P 888eb8d32bad49feb6b843c94206d716 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:28.876384 19924 raft_consensus.cc:729] T 61a4ea0c31d443be835b6192e9c1eb4f P 888eb8d32bad49feb6b843c94206d716 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 888eb8d32bad49feb6b843c94206d716, State: Initialized, Role: FOLLOWER
I20260808 04:40:28.876801 19924 consensus_queue.cc:260] T 61a4ea0c31d443be835b6192e9c1eb4f P 888eb8d32bad49feb6b843c94206d716 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd5efc8ae9cb464983ea6bfb6587a930" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 35061 } } peers { permanent_uuid: "888eb8d32bad49feb6b843c94206d716" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40905 } } peers { permanent_uuid: "766bad19ff6c49bc98a0eb558198aac8" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 32937 } }
I20260808 04:40:28.876767 19923 raft_consensus.cc:348] T 61a4ea0c31d443be835b6192e9c1eb4f P fd5efc8ae9cb464983ea6bfb6587a930 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd5efc8ae9cb464983ea6bfb6587a930" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 35061 } } peers { permanent_uuid: "888eb8d32bad49feb6b843c94206d716" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40905 } } peers { permanent_uuid: "766bad19ff6c49bc98a0eb558198aac8" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 32937 } }
I20260808 04:40:28.877017 19923 raft_consensus.cc:374] T 61a4ea0c31d443be835b6192e9c1eb4f P fd5efc8ae9cb464983ea6bfb6587a930 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:28.877074 19923 raft_consensus.cc:729] T 61a4ea0c31d443be835b6192e9c1eb4f P fd5efc8ae9cb464983ea6bfb6587a930 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd5efc8ae9cb464983ea6bfb6587a930, State: Initialized, Role: FOLLOWER
I20260808 04:40:28.877473 19923 consensus_queue.cc:260] T 61a4ea0c31d443be835b6192e9c1eb4f P fd5efc8ae9cb464983ea6bfb6587a930 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd5efc8ae9cb464983ea6bfb6587a930" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 35061 } } peers { permanent_uuid: "888eb8d32bad49feb6b843c94206d716" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40905 } } peers { permanent_uuid: "766bad19ff6c49bc98a0eb558198aac8" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 32937 } }
I20260808 04:40:28.877744 19924 ts_tablet_manager.cc:1428] T 61a4ea0c31d443be835b6192e9c1eb4f P 888eb8d32bad49feb6b843c94206d716: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260808 04:40:28.878088 19693 heartbeater.cc:503] Master 127.12.148.126:46865 was elected leader, sending a full tablet report...
I20260808 04:40:28.878418 19923 ts_tablet_manager.cc:1428] T 61a4ea0c31d443be835b6192e9c1eb4f P fd5efc8ae9cb464983ea6bfb6587a930: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260808 04:40:28.878420 19925 raft_consensus.cc:348] T 61a4ea0c31d443be835b6192e9c1eb4f P 766bad19ff6c49bc98a0eb558198aac8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd5efc8ae9cb464983ea6bfb6587a930" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 35061 } } peers { permanent_uuid: "888eb8d32bad49feb6b843c94206d716" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40905 } } peers { permanent_uuid: "766bad19ff6c49bc98a0eb558198aac8" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 32937 } }
I20260808 04:40:28.878655 19925 raft_consensus.cc:374] T 61a4ea0c31d443be835b6192e9c1eb4f P 766bad19ff6c49bc98a0eb558198aac8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:28.878728 19925 raft_consensus.cc:729] T 61a4ea0c31d443be835b6192e9c1eb4f P 766bad19ff6c49bc98a0eb558198aac8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 766bad19ff6c49bc98a0eb558198aac8, State: Initialized, Role: FOLLOWER
I20260808 04:40:28.879132 19501 heartbeater.cc:503] Master 127.12.148.126:46865 was elected leader, sending a full tablet report...
I20260808 04:40:28.879092 19925 consensus_queue.cc:260] T 61a4ea0c31d443be835b6192e9c1eb4f P 766bad19ff6c49bc98a0eb558198aac8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd5efc8ae9cb464983ea6bfb6587a930" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 35061 } } peers { permanent_uuid: "888eb8d32bad49feb6b843c94206d716" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40905 } } peers { permanent_uuid: "766bad19ff6c49bc98a0eb558198aac8" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 32937 } }
I20260808 04:40:28.879933 19925 ts_tablet_manager.cc:1428] T 61a4ea0c31d443be835b6192e9c1eb4f P 766bad19ff6c49bc98a0eb558198aac8: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260808 04:40:28.880234 19898 heartbeater.cc:503] Master 127.12.148.126:46865 was elected leader, sending a full tablet report...
I20260808 04:40:28.962445 19938 raft_consensus.cc:482] T 61a4ea0c31d443be835b6192e9c1eb4f P 766bad19ff6c49bc98a0eb558198aac8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:40:28.962648 19938 raft_consensus.cc:504] T 61a4ea0c31d443be835b6192e9c1eb4f P 766bad19ff6c49bc98a0eb558198aac8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd5efc8ae9cb464983ea6bfb6587a930" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 35061 } } peers { permanent_uuid: "888eb8d32bad49feb6b843c94206d716" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40905 } } peers { permanent_uuid: "766bad19ff6c49bc98a0eb558198aac8" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 32937 } }
I20260808 04:40:28.963785 19938 leader_election.cc:288] T 61a4ea0c31d443be835b6192e9c1eb4f P 766bad19ff6c49bc98a0eb558198aac8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd5efc8ae9cb464983ea6bfb6587a930 (127.12.148.65:35061), 888eb8d32bad49feb6b843c94206d716 (127.12.148.66:40905)
I20260808 04:40:28.967523 19917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:28.964153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:44873 (local address 127.12.148.66:40905)
0808 04:40:28.964271 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:28.964275 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:28.964290 (+ 15us) server_negotiation.cc:407] Connection header received
0808 04:40:28.964357 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:28.964360 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:28.964400 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:28.964462 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:28.964751 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:28.965373 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:28.966517 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:28.966968 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:28.967060 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:28.967101 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:28.967322 (+ 221us) server_negotiation.cc:299] Negotiation successful
0808 04:40:28.967406 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 04:40:28.967523 19900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:28.964025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:40905 (local address 127.12.148.67:44873)
0808 04:40:28.964153 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:28.964169 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:28.964265 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:28.964484 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:28.964487 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:28.964505 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:28.964617 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:28.964623 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:28.965475 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:28.965478 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:28.966395 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:28.966405 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:28.967077 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:28.967081 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:28.967184 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:28.967210 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 04:40:28.967278 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 04:40:28.967389 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":28}
I20260808 04:40:28.967715 19914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:28.964129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:36405 (local address 127.12.148.65:35061)
0808 04:40:28.964245 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:28.964250 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:28.964617 (+ 367us) server_negotiation.cc:407] Connection header received
0808 04:40:28.964721 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:28.964724 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:28.964769 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:28.964822 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:28.965074 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:28.965634 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:28.966689 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:28.967100 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:28.967209 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:28.967253 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:28.967521 (+ 268us) server_negotiation.cc:299] Negotiation successful
0808 04:40:28.967597 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 04:40:28.968065 19939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:28.964025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:35061 (local address 127.12.148.67:36405)
0808 04:40:28.964529 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:28.964541 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:28.964632 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:28.964848 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:28.964851 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:28.964869 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:28.964984 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:28.964990 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:28.965756 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:28.965759 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:28.966562 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:28.966572 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:28.967220 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:28.967224 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:28.967352 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:28.967377 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 04:40:28.967858 (+ 481us) client_negotiation.cc:240] Negotiation successful
0808 04:40:28.967929 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":445,"mutex_wait_us":153,"thread_start_us":114,"threads_started":1}
I20260808 04:40:28.968236 19635 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61a4ea0c31d443be835b6192e9c1eb4f" candidate_uuid: "766bad19ff6c49bc98a0eb558198aac8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "888eb8d32bad49feb6b843c94206d716" is_pre_election: true
I20260808 04:40:28.968555 19635 raft_consensus.cc:2454] T 61a4ea0c31d443be835b6192e9c1eb4f P 888eb8d32bad49feb6b843c94206d716 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 766bad19ff6c49bc98a0eb558198aac8 in term 0.
I20260808 04:40:28.968609 19436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61a4ea0c31d443be835b6192e9c1eb4f" candidate_uuid: "766bad19ff6c49bc98a0eb558198aac8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd5efc8ae9cb464983ea6bfb6587a930" is_pre_election: true
I20260808 04:40:28.968875 19436 raft_consensus.cc:2454] T 61a4ea0c31d443be835b6192e9c1eb4f P fd5efc8ae9cb464983ea6bfb6587a930 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 766bad19ff6c49bc98a0eb558198aac8 in term 0.
I20260808 04:40:28.969043 19733 leader_election.cc:302] T 61a4ea0c31d443be835b6192e9c1eb4f P 766bad19ff6c49bc98a0eb558198aac8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 766bad19ff6c49bc98a0eb558198aac8, 888eb8d32bad49feb6b843c94206d716; no voters:
I20260808 04:40:28.969285 19938 raft_consensus.cc:2781] T 61a4ea0c31d443be835b6192e9c1eb4f P 766bad19ff6c49bc98a0eb558198aac8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:40:28.969381 19938 raft_consensus.cc:482] T 61a4ea0c31d443be835b6192e9c1eb4f P 766bad19ff6c49bc98a0eb558198aac8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:40:28.969435 19938 raft_consensus.cc:3037] T 61a4ea0c31d443be835b6192e9c1eb4f P 766bad19ff6c49bc98a0eb558198aac8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:28.970496 19938 raft_consensus.cc:504] T 61a4ea0c31d443be835b6192e9c1eb4f P 766bad19ff6c49bc98a0eb558198aac8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd5efc8ae9cb464983ea6bfb6587a930" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 35061 } } peers { permanent_uuid: "888eb8d32bad49feb6b843c94206d716" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40905 } } peers { permanent_uuid: "766bad19ff6c49bc98a0eb558198aac8" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 32937 } }
I20260808 04:40:28.970799 19938 leader_election.cc:288] T 61a4ea0c31d443be835b6192e9c1eb4f P 766bad19ff6c49bc98a0eb558198aac8 [CANDIDATE]: Term 1 election: Requested vote from peers fd5efc8ae9cb464983ea6bfb6587a930 (127.12.148.65:35061), 888eb8d32bad49feb6b843c94206d716 (127.12.148.66:40905)
I20260808 04:40:28.971081 19436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61a4ea0c31d443be835b6192e9c1eb4f" candidate_uuid: "766bad19ff6c49bc98a0eb558198aac8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd5efc8ae9cb464983ea6bfb6587a930"
I20260808 04:40:28.971146 19635 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61a4ea0c31d443be835b6192e9c1eb4f" candidate_uuid: "766bad19ff6c49bc98a0eb558198aac8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "888eb8d32bad49feb6b843c94206d716"
I20260808 04:40:28.971187 19436 raft_consensus.cc:3037] T 61a4ea0c31d443be835b6192e9c1eb4f P fd5efc8ae9cb464983ea6bfb6587a930 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:28.971258 19635 raft_consensus.cc:3037] T 61a4ea0c31d443be835b6192e9c1eb4f P 888eb8d32bad49feb6b843c94206d716 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:28.972169 19436 raft_consensus.cc:2454] T 61a4ea0c31d443be835b6192e9c1eb4f P fd5efc8ae9cb464983ea6bfb6587a930 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 766bad19ff6c49bc98a0eb558198aac8 in term 1.
I20260808 04:40:28.972231 19635 raft_consensus.cc:2454] T 61a4ea0c31d443be835b6192e9c1eb4f P 888eb8d32bad49feb6b843c94206d716 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 766bad19ff6c49bc98a0eb558198aac8 in term 1.
I20260808 04:40:28.972457 19734 leader_election.cc:302] T 61a4ea0c31d443be835b6192e9c1eb4f P 766bad19ff6c49bc98a0eb558198aac8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 766bad19ff6c49bc98a0eb558198aac8, fd5efc8ae9cb464983ea6bfb6587a930; no voters:
I20260808 04:40:28.972618 19938 raft_consensus.cc:2781] T 61a4ea0c31d443be835b6192e9c1eb4f P 766bad19ff6c49bc98a0eb558198aac8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:28.972817 19938 raft_consensus.cc:686] T 61a4ea0c31d443be835b6192e9c1eb4f P 766bad19ff6c49bc98a0eb558198aac8 [term 1 LEADER]: Becoming Leader. State: Replica: 766bad19ff6c49bc98a0eb558198aac8, State: Running, Role: LEADER
I20260808 04:40:28.973145 19938 consensus_queue.cc:237] T 61a4ea0c31d443be835b6192e9c1eb4f P 766bad19ff6c49bc98a0eb558198aac8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd5efc8ae9cb464983ea6bfb6587a930" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 35061 } } peers { permanent_uuid: "888eb8d32bad49feb6b843c94206d716" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40905 } } peers { permanent_uuid: "766bad19ff6c49bc98a0eb558198aac8" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 32937 } }
I20260808 04:40:28.976157 19219 catalog_manager.cc:5495] T 61a4ea0c31d443be835b6192e9c1eb4f P 766bad19ff6c49bc98a0eb558198aac8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 766bad19ff6c49bc98a0eb558198aac8 (127.12.148.67). New cstate: current_term: 1 leader_uuid: "766bad19ff6c49bc98a0eb558198aac8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd5efc8ae9cb464983ea6bfb6587a930" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 35061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "888eb8d32bad49feb6b843c94206d716" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "766bad19ff6c49bc98a0eb558198aac8" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 32937 } health_report { overall_health: HEALTHY } } }
I20260808 04:40:29.005203 19922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:29.002158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51914 (local address 127.12.148.67:32937)
0808 04:40:29.002272 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:29.002275 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:29.002288 (+ 13us) server_negotiation.cc:407] Connection header received
0808 04:40:29.002400 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:29.002402 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:29.002454 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:29.002541 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:29.002731 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:29.003235 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:29.003980 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:29.004181 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:29.004243 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:29.004470 (+ 227us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:29.004895 (+ 425us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:29.004984 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:29.005027 (+ 43us) server_negotiation.cc:299] Negotiation successful
0808 04:40:29.005076 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 04:40:29.011184 19635 raft_consensus.cc:1261] T 61a4ea0c31d443be835b6192e9c1eb4f P 888eb8d32bad49feb6b843c94206d716 [term 1 FOLLOWER]: Refusing update from remote peer 766bad19ff6c49bc98a0eb558198aac8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:29.011202 19436 raft_consensus.cc:1261] T 61a4ea0c31d443be835b6192e9c1eb4f P fd5efc8ae9cb464983ea6bfb6587a930 [term 1 FOLLOWER]: Refusing update from remote peer 766bad19ff6c49bc98a0eb558198aac8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:29.011883 19940 consensus_queue.cc:1035] T 61a4ea0c31d443be835b6192e9c1eb4f P 766bad19ff6c49bc98a0eb558198aac8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "888eb8d32bad49feb6b843c94206d716" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:29.012075 19938 consensus_queue.cc:1035] T 61a4ea0c31d443be835b6192e9c1eb4f P 766bad19ff6c49bc98a0eb558198aac8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd5efc8ae9cb464983ea6bfb6587a930" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 35061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:29.020381 19944 mvcc.cc:205] Tried to move back new op lower bound from 7316127862821720064 to 7316127862676811776. Current Snapshot: MvccSnapshot[applied={T|T < 7316127862821720064 or (T in {7316127862821720064})}]
I20260808 04:40:29.020601 19946 mvcc.cc:205] Tried to move back new op lower bound from 7316127862821720064 to 7316127862676811776. Current Snapshot: MvccSnapshot[applied={T|T < 7316127862821720064}]
I20260808 04:40:29.028574 19219 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59344:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:29.028735 19219 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59344:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:29.031085 19219 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c74702efa314ad6a61811eb73567f60: Sending DeleteTablet for 3 replicas of tablet 61a4ea0c31d443be835b6192e9c1eb4f
I20260808 04:40:29.032050 19801 tablet_service.cc:1514] Processing DeleteTablet for tablet 61a4ea0c31d443be835b6192e9c1eb4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:29 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:51912
I20260808 04:40:29.032321 19606 tablet_service.cc:1514] Processing DeleteTablet for tablet 61a4ea0c31d443be835b6192e9c1eb4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:29 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:42166
I20260808 04:40:29.032795 19960 tablet_replica.cc:330] T 61a4ea0c31d443be835b6192e9c1eb4f P 766bad19ff6c49bc98a0eb558198aac8: stopping tablet replica
I20260808 04:40:29.033004 19961 tablet_replica.cc:330] T 61a4ea0c31d443be835b6192e9c1eb4f P 888eb8d32bad49feb6b843c94206d716: stopping tablet replica
I20260808 04:40:29.033032 19403 tablet_service.cc:1514] Processing DeleteTablet for tablet 61a4ea0c31d443be835b6192e9c1eb4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:29 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:59802
I20260808 04:40:29.033099 19960 raft_consensus.cc:2229] T 61a4ea0c31d443be835b6192e9c1eb4f P 766bad19ff6c49bc98a0eb558198aac8 [term 1 LEADER]: Raft consensus shutting down.
I20260808 04:40:29.033294 19961 raft_consensus.cc:2229] T 61a4ea0c31d443be835b6192e9c1eb4f P 888eb8d32bad49feb6b843c94206d716 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:29.033453 19960 raft_consensus.cc:2258] T 61a4ea0c31d443be835b6192e9c1eb4f P 766bad19ff6c49bc98a0eb558198aac8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:29.033589 19961 raft_consensus.cc:2258] T 61a4ea0c31d443be835b6192e9c1eb4f P 888eb8d32bad49feb6b843c94206d716 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:29.034183 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 19306
I20260808 04:40:29.034991 19961 ts_tablet_manager.cc:1905] T 61a4ea0c31d443be835b6192e9c1eb4f P 888eb8d32bad49feb6b843c94206d716: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:29.037437 19961 ts_tablet_manager.cc:1918] T 61a4ea0c31d443be835b6192e9c1eb4f P 888eb8d32bad49feb6b843c94206d716: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:40:29.037540 19961 log.cc:1196] T 61a4ea0c31d443be835b6192e9c1eb4f P 888eb8d32bad49feb6b843c94206d716: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-1/wal/wals/61a4ea0c31d443be835b6192e9c1eb4f
I20260808 04:40:29.037943 19961 ts_tablet_manager.cc:1939] T 61a4ea0c31d443be835b6192e9c1eb4f P 888eb8d32bad49feb6b843c94206d716: Deleting consensus metadata
I20260808 04:40:29.038523 19960 ts_tablet_manager.cc:1905] T 61a4ea0c31d443be835b6192e9c1eb4f P 766bad19ff6c49bc98a0eb558198aac8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:29.041052 19198 catalog_manager.cc:4841] TS 888eb8d32bad49feb6b843c94206d716 (127.12.148.66:40905): tablet 61a4ea0c31d443be835b6192e9c1eb4f (table test-table [id=2afb1490bae845efba2f9f0795f4c66a]) successfully deleted
I20260808 04:40:29.041453 19960 ts_tablet_manager.cc:1918] T 61a4ea0c31d443be835b6192e9c1eb4f P 766bad19ff6c49bc98a0eb558198aac8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:40:29.041553 19960 log.cc:1196] T 61a4ea0c31d443be835b6192e9c1eb4f P 766bad19ff6c49bc98a0eb558198aac8: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786164004017495-12881-0/minicluster-data/ts-2/wal/wals/61a4ea0c31d443be835b6192e9c1eb4f
I20260808 04:40:29.041909 19960 ts_tablet_manager.cc:1939] T 61a4ea0c31d443be835b6192e9c1eb4f P 766bad19ff6c49bc98a0eb558198aac8: Deleting consensus metadata
I20260808 04:40:29.043224 19199 catalog_manager.cc:4841] TS 766bad19ff6c49bc98a0eb558198aac8 (127.12.148.67:32937): tablet 61a4ea0c31d443be835b6192e9c1eb4f (table test-table [id=2afb1490bae845efba2f9f0795f4c66a]) successfully deleted
W20260808 04:40:29.049139 19199 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.148.65:35061 (error 108)
I20260808 04:40:29.049348 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 19507
I20260808 04:40:29.051976 19915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:29.051648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:35061 (local address 127.0.0.1:59812)
0808 04:40:29.051824 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:29.051888 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.65:35061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
W20260808 04:40:29.052132 19199 catalog_manager.cc:4584] TS fd5efc8ae9cb464983ea6bfb6587a930 (127.12.148.65:35061): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 61a4ea0c31d443be835b6192e9c1eb4f: Network error: Client connection negotiation failed: client connection to 127.12.148.65:35061: connect: Connection refused (error 111)
I20260808 04:40:29.057821 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 19707
I20260808 04:40:29.071193 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 19161
2026-08-08T04:40:29Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2457 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-08T04:40:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:40:29Z Disabled control of system clock
I20260808 04:40:29.108683 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:40619
--webserver_interface=127.12.148.126
--webserver_port=0
--builtin_ntp_servers=127.12.148.84:41895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:40619
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 04:40:29.217602 19975 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:29.217885 19975 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:29.217921 19975 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:29.221786 19975 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:40:29.221845 19975 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:29.221859 19975 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:29.221875 19975 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:40:29.221896 19975 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:40:29.226596 19975 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:41895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:40619
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:40619
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19975
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:29.227607 19975 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:29.229000 19975 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:29.237133 19985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:29.237139 19986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:29.237139 19988 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:29.237435 19975 server_base.cc:1034] running on GCE node
I20260808 04:40:29.238080 19975 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:29.239166 19975 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:29.240324 19975 hybrid_clock.cc:648] HybridClock initialized: now 1786164029240311 us; error 35 us; skew 500 ppm
I20260808 04:40:29.242298 19975 webserver.cc:460] Webserver started at http://127.12.148.126:35411/ using document root <none> and password file <none>
I20260808 04:40:29.242851 19975 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:29.242915 19975 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:29.243122 19975 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:29.245184 19975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "0b788a75528b4159b9f019949ea511be"
format_stamp: "Formatted at 2026-08-08 04:40:29 on dist-test-slave-t7g5"
server_key: "2f461add1d86095dedfcdd6bddbb7009"
server_key_iv: "b77c651f05a9b3b1ab55be6b1592c341"
server_key_version: "encryptionkey@0"
I20260808 04:40:29.245780 19975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "0b788a75528b4159b9f019949ea511be"
format_stamp: "Formatted at 2026-08-08 04:40:29 on dist-test-slave-t7g5"
server_key: "2f461add1d86095dedfcdd6bddbb7009"
server_key_iv: "b77c651f05a9b3b1ab55be6b1592c341"
server_key_version: "encryptionkey@0"
I20260808 04:40:29.249356 19975 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:40:29.251850 19997 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:29.253044 19975 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:40:29.253166 19975 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "0b788a75528b4159b9f019949ea511be"
format_stamp: "Formatted at 2026-08-08 04:40:29 on dist-test-slave-t7g5"
server_key: "2f461add1d86095dedfcdd6bddbb7009"
server_key_iv: "b77c651f05a9b3b1ab55be6b1592c341"
server_key_version: "encryptionkey@0"
I20260808 04:40:29.253269 19975 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:29.257877 19975 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:29.258494 19975 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:29.258659 19975 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:29.265413 19975 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:40619
I20260808 04:40:29.265475 20078 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:40619 every 8 connection(s)
I20260808 04:40:29.266430 19975 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:40:29.269614 20079 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:29.274255 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 19975
I20260808 04:40:29.274396 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:40:29.274698 12881 external_mini_cluster.cc:1428] Setting key 056c30f737ac2377c7d6f741f7915a23
I20260808 04:40:29.275517 20079 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b788a75528b4159b9f019949ea511be: Bootstrap starting.
I20260808 04:40:29.277887 20079 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0b788a75528b4159b9f019949ea511be: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:29.278733 20079 log.cc:824] T 00000000000000000000000000000000 P 0b788a75528b4159b9f019949ea511be: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:29.280344 20082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:29.276143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48834 (local address 127.12.148.126:40619)
0808 04:40:29.276769 (+ 626us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:29.276786 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:29.276823 (+ 37us) server_negotiation.cc:407] Connection header received
0808 04:40:29.277475 (+ 652us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:29.277493 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:29.277915 (+ 422us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:29.278239 (+ 324us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:29.279049 (+ 810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:29.279054 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:29.279065 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:40:29.279076 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:29.279139 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:40:29.279156 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:29.279246 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:29.279377 (+ 131us) server_negotiation.cc:299] Negotiation successful
0808 04:40:29.279637 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":109,"threads_started":1}
I20260808 04:40:29.280751 20079 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b788a75528b4159b9f019949ea511be: No bootstrap required, opened a new log
I20260808 04:40:29.284178 20079 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0b788a75528b4159b9f019949ea511be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b788a75528b4159b9f019949ea511be" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40619 } }
I20260808 04:40:29.284399 20079 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0b788a75528b4159b9f019949ea511be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:29.284458 20079 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0b788a75528b4159b9f019949ea511be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b788a75528b4159b9f019949ea511be, State: Initialized, Role: FOLLOWER
I20260808 04:40:29.284857 20079 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0b788a75528b4159b9f019949ea511be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b788a75528b4159b9f019949ea511be" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40619 } }
I20260808 04:40:29.284986 20079 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0b788a75528b4159b9f019949ea511be [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:40:29.285049 20079 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0b788a75528b4159b9f019949ea511be [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:40:29.285147 20079 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0b788a75528b4159b9f019949ea511be [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:29.286056 20079 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0b788a75528b4159b9f019949ea511be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b788a75528b4159b9f019949ea511be" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40619 } }
I20260808 04:40:29.286405 20079 leader_election.cc:302] T 00000000000000000000000000000000 P 0b788a75528b4159b9f019949ea511be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0b788a75528b4159b9f019949ea511be; no voters:
I20260808 04:40:29.286733 20079 leader_election.cc:288] T 00000000000000000000000000000000 P 0b788a75528b4159b9f019949ea511be [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:40:29.286829 20088 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0b788a75528b4159b9f019949ea511be [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:29.287037 20088 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0b788a75528b4159b9f019949ea511be [term 1 LEADER]: Becoming Leader. State: Replica: 0b788a75528b4159b9f019949ea511be, State: Running, Role: LEADER
I20260808 04:40:29.287328 20088 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0b788a75528b4159b9f019949ea511be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b788a75528b4159b9f019949ea511be" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40619 } }
I20260808 04:40:29.287869 20079 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0b788a75528b4159b9f019949ea511be [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:40:29.289186 20090 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b788a75528b4159b9f019949ea511be [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0b788a75528b4159b9f019949ea511be. Latest consensus state: current_term: 1 leader_uuid: "0b788a75528b4159b9f019949ea511be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b788a75528b4159b9f019949ea511be" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40619 } } }
I20260808 04:40:29.289314 20090 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b788a75528b4159b9f019949ea511be [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:29.289718 20097 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:40:29.289592 20089 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b788a75528b4159b9f019949ea511be [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0b788a75528b4159b9f019949ea511be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b788a75528b4159b9f019949ea511be" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40619 } } }
I20260808 04:40:29.289855 20089 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b788a75528b4159b9f019949ea511be [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:29.292825 20097 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:40:29.298698 20097 catalog_manager.cc:1347] Generated new cluster ID: 80d7ec7ec31047da98217402ff282893
I20260808 04:40:29.298763 20097 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:40:29.309825 20097 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:40:29.310170 20097 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:40:29.322278 20097 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0b788a75528b4159b9f019949ea511be: Generated new TSK 0
I20260808 04:40:29.323089 20097 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:40:29.326785 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.65:0
--local_ip_for_outbound_sockets=127.12.148.65
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:40619
--builtin_ntp_servers=127.12.148.84:41895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 04:40:29.438365 20111 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:29.438611 20111 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:29.438650 20111 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:29.442562 20111 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:29.442608 20111 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:29.442664 20111 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.65
I20260808 04:40:29.447207 20111 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:41895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:40619
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20111
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.65
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:29.448148 20111 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:29.449421 20111 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:29.458794 20117 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:29.458801 20121 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:29.458801 20125 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:29.458990 20111 server_base.cc:1034] running on GCE node
I20260808 04:40:29.459371 20111 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:29.459973 20111 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:29.461126 20111 hybrid_clock.cc:648] HybridClock initialized: now 1786164029461111 us; error 26 us; skew 500 ppm
I20260808 04:40:29.462884 20111 webserver.cc:460] Webserver started at http://127.12.148.65:36141/ using document root <none> and password file <none>
I20260808 04:40:29.463433 20111 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:29.463497 20111 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:29.463681 20111 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:29.465708 20111 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-0/data/instance:
uuid: "788dab83c61e4bc5bb76e2d5aee65a4d"
format_stamp: "Formatted at 2026-08-08 04:40:29 on dist-test-slave-t7g5"
server_key: "6d5b42cc5cc86cd65493402e0cb4bd7f"
server_key_iv: "8bae9dd33c99cbcaa30be3b7353e5d61"
server_key_version: "encryptionkey@0"
I20260808 04:40:29.466271 20111 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance:
uuid: "788dab83c61e4bc5bb76e2d5aee65a4d"
format_stamp: "Formatted at 2026-08-08 04:40:29 on dist-test-slave-t7g5"
server_key: "6d5b42cc5cc86cd65493402e0cb4bd7f"
server_key_iv: "8bae9dd33c99cbcaa30be3b7353e5d61"
server_key_version: "encryptionkey@0"
I20260808 04:40:29.469782 20111 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 04:40:29.472196 20135 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:29.473366 20111 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:40:29.473476 20111 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-0/wal
uuid: "788dab83c61e4bc5bb76e2d5aee65a4d"
format_stamp: "Formatted at 2026-08-08 04:40:29 on dist-test-slave-t7g5"
server_key: "6d5b42cc5cc86cd65493402e0cb4bd7f"
server_key_iv: "8bae9dd33c99cbcaa30be3b7353e5d61"
server_key_version: "encryptionkey@0"
I20260808 04:40:29.473577 20111 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:29.478027 20111 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:29.478613 20111 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:29.478770 20111 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:29.479290 20111 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:29.480173 20111 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:29.480221 20111 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:29.480273 20111 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:29.480299 20111 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:29.488713 20111 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.65:39413
I20260808 04:40:29.488823 20296 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.65:39413 every 8 connection(s)
I20260808 04:40:29.489598 20111 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
I20260808 04:40:29.493858 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 20111
I20260808 04:40:29.493963 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance
I20260808 04:40:29.494227 12881 external_mini_cluster.cc:1428] Setting key 477168e676e246fc7eb96a04269e9755
I20260808 04:40:29.495661 20082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:29.491331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:41131 (local address 127.12.148.126:40619)
0808 04:40:29.491476 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:29.491480 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:29.492501 (+ 1021us) server_negotiation.cc:407] Connection header received
0808 04:40:29.493970 (+ 1469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:29.493974 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:29.494019 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:29.494098 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:29.495217 (+ 1119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:29.495220 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:29.495223 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:40:29.495233 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:29.495254 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:40:29.495262 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:29.495346 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:29.495488 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 04:40:29.495531 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 04:40:29.496124 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.66:0
--local_ip_for_outbound_sockets=127.12.148.66
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:40619
--builtin_ntp_servers=127.12.148.84:41895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260808 04:40:29.496567 20299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:29.491703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40619 (local address 127.12.148.65:41131)
0808 04:40:29.492355 (+ 652us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:29.492395 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:29.493763 (+ 1368us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:29.494272 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:29.494279 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:29.494386 (+ 107us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:29.494952 (+ 566us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:40:29.494954 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:29.494995 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:40:29.495064 (+ 69us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:29.495342 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:29.495351 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:29.495357 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 04:40:29.495534 (+ 177us) client_negotiation.cc:240] Negotiation successful
0808 04:40:29.495772 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":119,"threads_started":1}
I20260808 04:40:29.497786 20297 heartbeater.cc:347] Connected to a master server at 127.12.148.126:40619
I20260808 04:40:29.498021 20297 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:29.498466 20297 heartbeater.cc:511] Master 127.12.148.126:40619 requested a full tablet report, sending...
I20260808 04:40:29.500022 20021 ts_manager.cc:194] Registered new tserver with Master: 788dab83c61e4bc5bb76e2d5aee65a4d (127.12.148.65:39413)
W20260808 04:40:29.608656 20300 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:29.608922 20300 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:29.608978 20300 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:29.612950 20300 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:29.613000 20300 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:29.613071 20300 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.66
I20260808 04:40:29.617733 20300 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:41895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:40619
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20300
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.66
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:29.618752 20300 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:29.620110 20300 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:29.629294 20308 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:29.629311 20307 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:29.629304 20313 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:29.629383 20300 server_base.cc:1034] running on GCE node
I20260808 04:40:29.629953 20300 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:29.630542 20300 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:29.631698 20300 hybrid_clock.cc:648] HybridClock initialized: now 1786164029631680 us; error 35 us; skew 500 ppm
I20260808 04:40:29.633410 20300 webserver.cc:460] Webserver started at http://127.12.148.66:34591/ using document root <none> and password file <none>
I20260808 04:40:29.634016 20300 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:29.634085 20300 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:29.634279 20300 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:29.636229 20300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-1/data/instance:
uuid: "195577bf99184fcd94c1eadf25a6fb9c"
format_stamp: "Formatted at 2026-08-08 04:40:29 on dist-test-slave-t7g5"
server_key: "68d2bf1f41974126759a163a00e8ca61"
server_key_iv: "b58d18a053c4a4ede714e73bd035dcf5"
server_key_version: "encryptionkey@0"
I20260808 04:40:29.636758 20300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance:
uuid: "195577bf99184fcd94c1eadf25a6fb9c"
format_stamp: "Formatted at 2026-08-08 04:40:29 on dist-test-slave-t7g5"
server_key: "68d2bf1f41974126759a163a00e8ca61"
server_key_iv: "b58d18a053c4a4ede714e73bd035dcf5"
server_key_version: "encryptionkey@0"
I20260808 04:40:29.640312 20300 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260808 04:40:29.642773 20323 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:29.643967 20300 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 04:40:29.644074 20300 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-1/wal
uuid: "195577bf99184fcd94c1eadf25a6fb9c"
format_stamp: "Formatted at 2026-08-08 04:40:29 on dist-test-slave-t7g5"
server_key: "68d2bf1f41974126759a163a00e8ca61"
server_key_iv: "b58d18a053c4a4ede714e73bd035dcf5"
server_key_version: "encryptionkey@0"
I20260808 04:40:29.644166 20300 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:29.648476 20300 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:29.649035 20300 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:29.649187 20300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:29.649710 20300 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:29.650560 20300 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:29.650609 20300 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:29.650656 20300 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:29.650683 20300 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:29.660054 20300 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.66:45893
I20260808 04:40:29.660072 20477 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.66:45893 every 8 connection(s)
I20260808 04:40:29.660962 20300 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
I20260808 04:40:29.663429 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 20300
I20260808 04:40:29.663559 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance
I20260808 04:40:29.663867 12881 external_mini_cluster.cc:1428] Setting key 42f895356bbd6b0c5fb03c102ac2e04b
I20260808 04:40:29.665793 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.67:0
--local_ip_for_outbound_sockets=127.12.148.67
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:40619
--builtin_ntp_servers=127.12.148.84:41895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260808 04:40:29.667084 20082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:29.662731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:50109 (local address 127.12.148.126:40619)
0808 04:40:29.662870 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:29.662874 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:29.663976 (+ 1102us) server_negotiation.cc:407] Connection header received
0808 04:40:29.665394 (+ 1418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:29.665398 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:29.665440 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:29.665514 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:29.666643 (+ 1129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:29.666647 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:29.666649 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:40:29.666663 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:29.666683 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:40:29.666691 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:29.666765 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:29.666907 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 04:40:29.666953 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 04:40:29.667891 20480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:29.663123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40619 (local address 127.12.148.66:50109)
0808 04:40:29.663839 (+ 716us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:29.663881 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:29.665180 (+ 1299us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:29.665711 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:29.665720 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:29.665818 (+ 98us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:29.666387 (+ 569us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:40:29.666389 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:29.666428 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:40:29.666497 (+ 69us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:29.666758 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:29.666767 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:29.666772 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 04:40:29.666940 (+ 168us) client_negotiation.cc:240] Negotiation successful
0808 04:40:29.667180 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":145,"threads_started":1}
I20260808 04:40:29.668975 20478 heartbeater.cc:347] Connected to a master server at 127.12.148.126:40619
I20260808 04:40:29.669183 20478 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:29.669556 20478 heartbeater.cc:511] Master 127.12.148.126:40619 requested a full tablet report, sending...
I20260808 04:40:29.670580 20021 ts_manager.cc:194] Registered new tserver with Master: 195577bf99184fcd94c1eadf25a6fb9c (127.12.148.66:45893)
W20260808 04:40:29.777689 20482 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:29.777985 20482 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:29.778055 20482 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:29.782015 20482 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:29.782063 20482 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:29.782138 20482 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.67
I20260808 04:40:29.787075 20482 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:41895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:40619
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20482
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.67
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:29.788174 20482 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:29.789693 20482 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:29.799142 20492 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:29.799142 20489 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:29.799259 20482 server_base.cc:1034] running on GCE node
W20260808 04:40:29.799151 20494 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:29.799796 20482 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:29.800383 20482 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:29.801537 20482 hybrid_clock.cc:648] HybridClock initialized: now 1786164029801509 us; error 40 us; skew 500 ppm
I20260808 04:40:29.803483 20482 webserver.cc:460] Webserver started at http://127.12.148.67:42067/ using document root <none> and password file <none>
I20260808 04:40:29.804044 20482 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:29.804111 20482 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:29.804306 20482 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:29.806353 20482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-2/data/instance:
uuid: "0901ba1c1bb84f5488c7af92d65a3fb9"
format_stamp: "Formatted at 2026-08-08 04:40:29 on dist-test-slave-t7g5"
server_key: "eb3adb7b38317f85f2daf8a466dd246c"
server_key_iv: "9f5014fea1b1c7fa349293ae2e53aeb4"
server_key_version: "encryptionkey@0"
I20260808 04:40:29.806885 20482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance:
uuid: "0901ba1c1bb84f5488c7af92d65a3fb9"
format_stamp: "Formatted at 2026-08-08 04:40:29 on dist-test-slave-t7g5"
server_key: "eb3adb7b38317f85f2daf8a466dd246c"
server_key_iv: "9f5014fea1b1c7fa349293ae2e53aeb4"
server_key_version: "encryptionkey@0"
I20260808 04:40:29.810348 20482 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 04:40:29.812641 20501 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:29.813750 20482 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:40:29.813881 20482 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-2/wal
uuid: "0901ba1c1bb84f5488c7af92d65a3fb9"
format_stamp: "Formatted at 2026-08-08 04:40:29 on dist-test-slave-t7g5"
server_key: "eb3adb7b38317f85f2daf8a466dd246c"
server_key_iv: "9f5014fea1b1c7fa349293ae2e53aeb4"
server_key_version: "encryptionkey@0"
I20260808 04:40:29.813974 20482 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:29.818204 20482 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:29.818735 20482 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:29.818893 20482 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:29.819373 20482 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:29.820190 20482 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:29.820237 20482 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:29.820286 20482 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:29.820314 20482 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:29.828402 20482 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.67:35443
I20260808 04:40:29.828426 20658 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.67:35443 every 8 connection(s)
I20260808 04:40:29.829191 20482 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
I20260808 04:40:29.832774 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 20482
I20260808 04:40:29.832890 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance
I20260808 04:40:29.833196 12881 external_mini_cluster.cc:1428] Setting key c110f151121b55afd8f0d28e4cf70e46
I20260808 04:40:29.835191 20082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:29.830844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:56623 (local address 127.12.148.126:40619)
0808 04:40:29.830982 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:29.830985 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:29.831957 (+ 972us) server_negotiation.cc:407] Connection header received
0808 04:40:29.833415 (+ 1458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:29.833418 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:29.833457 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:29.833541 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:29.834798 (+ 1257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:29.834802 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:29.834804 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:40:29.834816 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:29.834840 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:40:29.834850 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:29.834937 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:29.835027 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 04:40:29.835068 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 04:40:29.835996 20661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:29.831212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40619 (local address 127.12.148.67:56623)
0808 04:40:29.831817 (+ 605us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:29.831856 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:29.833181 (+ 1325us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:29.833773 (+ 592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:29.833781 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:29.833916 (+ 135us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:29.834534 (+ 618us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:40:29.834536 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:29.834589 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:40:29.834661 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:29.834925 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:29.834929 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:29.834932 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 04:40:29.835062 (+ 130us) client_negotiation.cc:240] Negotiation successful
0808 04:40:29.835285 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":110,"threads_started":1}
I20260808 04:40:29.836932 20659 heartbeater.cc:347] Connected to a master server at 127.12.148.126:40619
I20260808 04:40:29.837129 20659 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:29.837467 20659 heartbeater.cc:511] Master 127.12.148.126:40619 requested a full tablet report, sending...
I20260808 04:40:29.838402 20021 ts_manager.cc:194] Registered new tserver with Master: 0901ba1c1bb84f5488c7af92d65a3fb9 (127.12.148.67:35443)
I20260808 04:40:29.847039 12881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 04:40:29.850409 20082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:29.848903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48836 (local address 127.12.148.126:40619)
0808 04:40:29.849015 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:29.849020 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:29.849193 (+ 173us) server_negotiation.cc:407] Connection header received
0808 04:40:29.849305 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:29.849308 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:29.849341 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:29.849404 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:29.850052 (+ 648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:29.850056 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:29.850059 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:40:29.850071 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:29.850091 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:40:29.850098 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:29.850169 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:29.850241 (+ 72us) server_negotiation.cc:299] Negotiation successful
0808 04:40:29.850280 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 04:40:29.852939 20021 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48836:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:40:29.856055 20021 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:40:29.867435 20671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:29.864233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:45893 (local address 127.0.0.1:60476)
0808 04:40:29.865032 (+ 799us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:29.865082 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:29.865260 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:29.866307 (+ 1047us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:29.866309 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:29.866325 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:29.866807 (+ 482us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:40:29.866809 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:29.866818 (+ 9us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:40:29.866844 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:29.867200 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:29.867203 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:29.867206 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 04:40:29.867264 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 04:40:29.867287 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":631,"thread_start_us":74,"threads_started":1}
I20260808 04:40:29.867534 20674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:29.864377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60476 (local address 127.12.148.66:45893)
0808 04:40:29.864777 (+ 400us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:29.864789 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:29.865173 (+ 384us) server_negotiation.cc:407] Connection header received
0808 04:40:29.865409 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:29.865415 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:29.865617 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:29.865758 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:29.866965 (+ 1207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:29.866972 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:29.866983 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:40:29.866996 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:29.867043 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:40:29.867091 (+ 48us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:29.867231 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:29.867289 (+ 58us) server_negotiation.cc:299] Negotiation successful
0808 04:40:29.867367 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":309,"thread_start_us":106,"threads_started":1}
I20260808 04:40:29.867569 20676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:29.865012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35142 (local address 127.12.148.67:35443)
0808 04:40:29.865364 (+ 352us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:29.865376 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:29.865682 (+ 306us) server_negotiation.cc:407] Connection header received
0808 04:40:29.865739 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:29.865745 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:29.865877 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:29.866004 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:29.866891 (+ 887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:29.866898 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:29.866911 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:40:29.866923 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:29.866967 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:40:29.866993 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:29.867086 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:29.867360 (+ 274us) server_negotiation.cc:299] Negotiation successful
0808 04:40:29.867429 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":248,"thread_start_us":148,"threads_started":1}
I20260808 04:40:29.867811 20675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:29.864336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.67:35443 (local address 127.0.0.1:35142)
0808 04:40:29.865474 (+ 1138us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:29.865488 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:29.865563 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:29.866017 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:29.866023 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:29.866098 (+ 75us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:29.866650 (+ 552us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:40:29.866651 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:29.866672 (+ 21us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:40:29.866745 (+ 73us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:29.867072 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:29.867081 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:29.867087 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 04:40:29.867213 (+ 126us) client_negotiation.cc:240] Negotiation successful
0808 04:40:29.867283 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1077,"thread_start_us":138,"threads_started":1}
I20260808 04:40:29.869102 20673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:29.864549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:39413 (local address 127.0.0.1:47296)
0808 04:40:29.866601 (+ 2052us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:29.866614 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:29.866694 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:29.868053 (+ 1359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:29.868056 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:29.868070 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:29.868504 (+ 434us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:40:29.868506 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:29.868516 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:40:29.868541 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:29.868864 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:29.868867 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:29.868870 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 04:40:29.868950 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 04:40:29.868985 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1991,"thread_start_us":77,"threads_started":1}
I20260808 04:40:29.869387 20677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:29.865012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47296 (local address 127.12.148.65:39413)
0808 04:40:29.865552 (+ 540us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:29.865563 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:29.866706 (+ 1143us) server_negotiation.cc:407] Connection header received
0808 04:40:29.866770 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:29.866775 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:29.866965 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:29.867093 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:29.868670 (+ 1577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:29.868676 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:29.868688 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:40:29.868701 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:29.868741 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:40:29.868769 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:29.868871 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:29.869013 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 04:40:29.869081 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":446,"thread_start_us":146,"threads_started":1}
I20260808 04:40:29.870631 20387 tablet_service.cc:1467] Processing CreateTablet for tablet 1c9c2c7b95db4eac96c5b6b62980bac4 (DEFAULT_TABLE table=test-table [id=e2a1c907b0e34407ae0d2f0f52d005f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:29.870658 20566 tablet_service.cc:1467] Processing CreateTablet for tablet 1c9c2c7b95db4eac96c5b6b62980bac4 (DEFAULT_TABLE table=test-table [id=e2a1c907b0e34407ae0d2f0f52d005f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:29.871701 20566 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c9c2c7b95db4eac96c5b6b62980bac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:29.871701 20387 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c9c2c7b95db4eac96c5b6b62980bac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:29.871968 20202 tablet_service.cc:1467] Processing CreateTablet for tablet 1c9c2c7b95db4eac96c5b6b62980bac4 (DEFAULT_TABLE table=test-table [id=e2a1c907b0e34407ae0d2f0f52d005f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:29.872887 20202 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c9c2c7b95db4eac96c5b6b62980bac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:29.877807 20678 tablet_bootstrap.cc:492] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 195577bf99184fcd94c1eadf25a6fb9c: Bootstrap starting.
I20260808 04:40:29.879328 20681 tablet_bootstrap.cc:492] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 0901ba1c1bb84f5488c7af92d65a3fb9: Bootstrap starting.
I20260808 04:40:29.879352 20682 tablet_bootstrap.cc:492] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 788dab83c61e4bc5bb76e2d5aee65a4d: Bootstrap starting.
I20260808 04:40:29.880524 20678 tablet_bootstrap.cc:654] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 195577bf99184fcd94c1eadf25a6fb9c: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:29.881213 20681 tablet_bootstrap.cc:654] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 0901ba1c1bb84f5488c7af92d65a3fb9: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:29.881405 20678 log.cc:824] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 195577bf99184fcd94c1eadf25a6fb9c: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:29.881548 20682 tablet_bootstrap.cc:654] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 788dab83c61e4bc5bb76e2d5aee65a4d: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:29.881975 20681 log.cc:824] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 0901ba1c1bb84f5488c7af92d65a3fb9: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:29.882310 20682 log.cc:824] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 788dab83c61e4bc5bb76e2d5aee65a4d: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:29.883411 20678 tablet_bootstrap.cc:492] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 195577bf99184fcd94c1eadf25a6fb9c: No bootstrap required, opened a new log
I20260808 04:40:29.883594 20678 ts_tablet_manager.cc:1397] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 195577bf99184fcd94c1eadf25a6fb9c: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260808 04:40:29.883684 20681 tablet_bootstrap.cc:492] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 0901ba1c1bb84f5488c7af92d65a3fb9: No bootstrap required, opened a new log
I20260808 04:40:29.883865 20681 ts_tablet_manager.cc:1397] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 0901ba1c1bb84f5488c7af92d65a3fb9: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260808 04:40:29.884078 20682 tablet_bootstrap.cc:492] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 788dab83c61e4bc5bb76e2d5aee65a4d: No bootstrap required, opened a new log
I20260808 04:40:29.884243 20682 ts_tablet_manager.cc:1397] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 788dab83c61e4bc5bb76e2d5aee65a4d: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260808 04:40:29.887161 20678 raft_consensus.cc:348] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 195577bf99184fcd94c1eadf25a6fb9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "195577bf99184fcd94c1eadf25a6fb9c" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 45893 } } peers { permanent_uuid: "0901ba1c1bb84f5488c7af92d65a3fb9" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 35443 } } peers { permanent_uuid: "788dab83c61e4bc5bb76e2d5aee65a4d" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39413 } }
I20260808 04:40:29.887490 20678 raft_consensus.cc:374] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 195577bf99184fcd94c1eadf25a6fb9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:29.887549 20678 raft_consensus.cc:729] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 195577bf99184fcd94c1eadf25a6fb9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 195577bf99184fcd94c1eadf25a6fb9c, State: Initialized, Role: FOLLOWER
I20260808 04:40:29.887964 20678 consensus_queue.cc:260] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 195577bf99184fcd94c1eadf25a6fb9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "195577bf99184fcd94c1eadf25a6fb9c" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 45893 } } peers { permanent_uuid: "0901ba1c1bb84f5488c7af92d65a3fb9" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 35443 } } peers { permanent_uuid: "788dab83c61e4bc5bb76e2d5aee65a4d" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39413 } }
I20260808 04:40:29.888312 20682 raft_consensus.cc:348] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 788dab83c61e4bc5bb76e2d5aee65a4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "195577bf99184fcd94c1eadf25a6fb9c" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 45893 } } peers { permanent_uuid: "0901ba1c1bb84f5488c7af92d65a3fb9" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 35443 } } peers { permanent_uuid: "788dab83c61e4bc5bb76e2d5aee65a4d" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39413 } }
I20260808 04:40:29.888566 20682 raft_consensus.cc:374] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 788dab83c61e4bc5bb76e2d5aee65a4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:29.888564 20478 heartbeater.cc:503] Master 127.12.148.126:40619 was elected leader, sending a full tablet report...
I20260808 04:40:29.888629 20682 raft_consensus.cc:729] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 788dab83c61e4bc5bb76e2d5aee65a4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 788dab83c61e4bc5bb76e2d5aee65a4d, State: Initialized, Role: FOLLOWER
I20260808 04:40:29.888916 20678 ts_tablet_manager.cc:1428] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 195577bf99184fcd94c1eadf25a6fb9c: Time spent starting tablet: real 0.005s user 0.005s sys 0.001s
I20260808 04:40:29.889132 20682 consensus_queue.cc:260] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 788dab83c61e4bc5bb76e2d5aee65a4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "195577bf99184fcd94c1eadf25a6fb9c" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 45893 } } peers { permanent_uuid: "0901ba1c1bb84f5488c7af92d65a3fb9" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 35443 } } peers { permanent_uuid: "788dab83c61e4bc5bb76e2d5aee65a4d" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39413 } }
I20260808 04:40:29.888316 20681 raft_consensus.cc:348] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 0901ba1c1bb84f5488c7af92d65a3fb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "195577bf99184fcd94c1eadf25a6fb9c" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 45893 } } peers { permanent_uuid: "0901ba1c1bb84f5488c7af92d65a3fb9" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 35443 } } peers { permanent_uuid: "788dab83c61e4bc5bb76e2d5aee65a4d" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39413 } }
I20260808 04:40:29.889807 20297 heartbeater.cc:503] Master 127.12.148.126:40619 was elected leader, sending a full tablet report...
I20260808 04:40:29.890121 20682 ts_tablet_manager.cc:1428] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 788dab83c61e4bc5bb76e2d5aee65a4d: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260808 04:40:29.890664 20681 raft_consensus.cc:374] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 0901ba1c1bb84f5488c7af92d65a3fb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:29.890748 20681 raft_consensus.cc:729] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 0901ba1c1bb84f5488c7af92d65a3fb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0901ba1c1bb84f5488c7af92d65a3fb9, State: Initialized, Role: FOLLOWER
I20260808 04:40:29.891103 20681 consensus_queue.cc:260] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 0901ba1c1bb84f5488c7af92d65a3fb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "195577bf99184fcd94c1eadf25a6fb9c" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 45893 } } peers { permanent_uuid: "0901ba1c1bb84f5488c7af92d65a3fb9" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 35443 } } peers { permanent_uuid: "788dab83c61e4bc5bb76e2d5aee65a4d" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39413 } }
I20260808 04:40:29.891853 20659 heartbeater.cc:503] Master 127.12.148.126:40619 was elected leader, sending a full tablet report...
I20260808 04:40:29.891952 20681 ts_tablet_manager.cc:1428] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 0901ba1c1bb84f5488c7af92d65a3fb9: Time spent starting tablet: real 0.008s user 0.003s sys 0.003s
W20260808 04:40:29.911829 20479 tablet.cc:2369] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 195577bf99184fcd94c1eadf25a6fb9c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 04:40:29.990705 20298 tablet.cc:2369] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 788dab83c61e4bc5bb76e2d5aee65a4d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:40:30.023891 20690 raft_consensus.cc:482] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 0901ba1c1bb84f5488c7af92d65a3fb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:40:30.024113 20690 raft_consensus.cc:504] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 0901ba1c1bb84f5488c7af92d65a3fb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "195577bf99184fcd94c1eadf25a6fb9c" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 45893 } } peers { permanent_uuid: "0901ba1c1bb84f5488c7af92d65a3fb9" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 35443 } } peers { permanent_uuid: "788dab83c61e4bc5bb76e2d5aee65a4d" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39413 } }
I20260808 04:40:30.025252 20690 leader_election.cc:288] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 0901ba1c1bb84f5488c7af92d65a3fb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 195577bf99184fcd94c1eadf25a6fb9c (127.12.148.66:45893), 788dab83c61e4bc5bb76e2d5aee65a4d (127.12.148.65:39413)
I20260808 04:40:30.027221 20674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:30.025617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:36343 (local address 127.12.148.66:45893)
0808 04:40:30.025768 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:30.025772 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:30.025786 (+ 14us) server_negotiation.cc:407] Connection header received
0808 04:40:30.025880 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:30.025882 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:30.025914 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:30.025980 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:30.026799 (+ 819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:30.026803 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:30.026806 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:40:30.026822 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:30.026845 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:40:30.026855 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:30.026944 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:30.027043 (+ 99us) server_negotiation.cc:299] Negotiation successful
0808 04:40:30.027083 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 04:40:30.027220 20661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:30.025537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:45893 (local address 127.12.148.67:36343)
0808 04:40:30.025689 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:30.025705 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:30.025789 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:30.026021 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:30.026024 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:30.026040 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:30.026568 (+ 528us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:40:30.026570 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:30.026581 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:40:30.026608 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:30.026951 (+ 343us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:30.026954 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:30.026958 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 04:40:30.027047 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 04:40:30.027085 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260808 04:40:30.027333 20677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:30.025647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:59345 (local address 127.12.148.65:39413)
0808 04:40:30.025783 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:30.025788 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:30.026236 (+ 448us) server_negotiation.cc:407] Connection header received
0808 04:40:30.026325 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:30.026328 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:30.026369 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:30.026448 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:30.026974 (+ 526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:30.026978 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:30.026981 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:40:30.026994 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:30.027018 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:40:30.027029 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:30.027107 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:30.027187 (+ 80us) server_negotiation.cc:299] Negotiation successful
0808 04:40:30.027225 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 04:40:30.027375 20692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:30.025541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:39413 (local address 127.12.148.67:59345)
0808 04:40:30.026148 (+ 607us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:30.026162 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:30.026249 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:30.026477 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:30.026479 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:30.026490 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:30.026819 (+ 329us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:40:30.026821 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:30.026831 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:40:30.026854 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:30.027102 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:30.027105 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:30.027108 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 04:40:30.027183 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 04:40:30.027214 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":541,"mutex_wait_us":255,"thread_start_us":148,"threads_started":1}
I20260808 04:40:30.027984 20415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c9c2c7b95db4eac96c5b6b62980bac4" candidate_uuid: "0901ba1c1bb84f5488c7af92d65a3fb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "195577bf99184fcd94c1eadf25a6fb9c" is_pre_election: true
I20260808 04:40:30.027985 20230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c9c2c7b95db4eac96c5b6b62980bac4" candidate_uuid: "0901ba1c1bb84f5488c7af92d65a3fb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "788dab83c61e4bc5bb76e2d5aee65a4d" is_pre_election: true
I20260808 04:40:30.028266 20230 raft_consensus.cc:2454] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 788dab83c61e4bc5bb76e2d5aee65a4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0901ba1c1bb84f5488c7af92d65a3fb9 in term 0.
I20260808 04:40:30.028276 20415 raft_consensus.cc:2454] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 195577bf99184fcd94c1eadf25a6fb9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0901ba1c1bb84f5488c7af92d65a3fb9 in term 0.
I20260808 04:40:30.028710 20503 leader_election.cc:302] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 0901ba1c1bb84f5488c7af92d65a3fb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0901ba1c1bb84f5488c7af92d65a3fb9, 788dab83c61e4bc5bb76e2d5aee65a4d; no voters:
I20260808 04:40:30.028967 20690 raft_consensus.cc:2781] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 0901ba1c1bb84f5488c7af92d65a3fb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:40:30.029057 20690 raft_consensus.cc:482] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 0901ba1c1bb84f5488c7af92d65a3fb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:40:30.029106 20690 raft_consensus.cc:3037] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 0901ba1c1bb84f5488c7af92d65a3fb9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:30.030208 20690 raft_consensus.cc:504] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 0901ba1c1bb84f5488c7af92d65a3fb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "195577bf99184fcd94c1eadf25a6fb9c" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 45893 } } peers { permanent_uuid: "0901ba1c1bb84f5488c7af92d65a3fb9" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 35443 } } peers { permanent_uuid: "788dab83c61e4bc5bb76e2d5aee65a4d" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39413 } }
I20260808 04:40:30.030511 20690 leader_election.cc:288] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 0901ba1c1bb84f5488c7af92d65a3fb9 [CANDIDATE]: Term 1 election: Requested vote from peers 195577bf99184fcd94c1eadf25a6fb9c (127.12.148.66:45893), 788dab83c61e4bc5bb76e2d5aee65a4d (127.12.148.65:39413)
I20260808 04:40:30.030869 20230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c9c2c7b95db4eac96c5b6b62980bac4" candidate_uuid: "0901ba1c1bb84f5488c7af92d65a3fb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "788dab83c61e4bc5bb76e2d5aee65a4d"
I20260808 04:40:30.030980 20230 raft_consensus.cc:3037] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 788dab83c61e4bc5bb76e2d5aee65a4d [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:30.031951 20230 raft_consensus.cc:2454] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 788dab83c61e4bc5bb76e2d5aee65a4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0901ba1c1bb84f5488c7af92d65a3fb9 in term 1.
I20260808 04:40:30.032212 20503 leader_election.cc:302] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 0901ba1c1bb84f5488c7af92d65a3fb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0901ba1c1bb84f5488c7af92d65a3fb9, 788dab83c61e4bc5bb76e2d5aee65a4d; no voters:
I20260808 04:40:30.032191 20415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c9c2c7b95db4eac96c5b6b62980bac4" candidate_uuid: "0901ba1c1bb84f5488c7af92d65a3fb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "195577bf99184fcd94c1eadf25a6fb9c"
I20260808 04:40:30.032316 20415 raft_consensus.cc:3037] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 195577bf99184fcd94c1eadf25a6fb9c [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:30.032380 20690 raft_consensus.cc:2781] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 0901ba1c1bb84f5488c7af92d65a3fb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:30.032599 20690 raft_consensus.cc:686] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 0901ba1c1bb84f5488c7af92d65a3fb9 [term 1 LEADER]: Becoming Leader. State: Replica: 0901ba1c1bb84f5488c7af92d65a3fb9, State: Running, Role: LEADER
I20260808 04:40:30.032936 20690 consensus_queue.cc:237] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 0901ba1c1bb84f5488c7af92d65a3fb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "195577bf99184fcd94c1eadf25a6fb9c" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 45893 } } peers { permanent_uuid: "0901ba1c1bb84f5488c7af92d65a3fb9" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 35443 } } peers { permanent_uuid: "788dab83c61e4bc5bb76e2d5aee65a4d" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39413 } }
I20260808 04:40:30.033409 20415 raft_consensus.cc:2454] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 195577bf99184fcd94c1eadf25a6fb9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0901ba1c1bb84f5488c7af92d65a3fb9 in term 1.
I20260808 04:40:30.036173 20018 catalog_manager.cc:5495] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 0901ba1c1bb84f5488c7af92d65a3fb9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0901ba1c1bb84f5488c7af92d65a3fb9 (127.12.148.67). New cstate: current_term: 1 leader_uuid: "0901ba1c1bb84f5488c7af92d65a3fb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "195577bf99184fcd94c1eadf25a6fb9c" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 45893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0901ba1c1bb84f5488c7af92d65a3fb9" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 35443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "788dab83c61e4bc5bb76e2d5aee65a4d" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39413 } health_report { overall_health: UNKNOWN } } }
I20260808 04:40:30.054936 20676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:30.053544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35154 (local address 127.12.148.67:35443)
0808 04:40:30.053691 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:30.053695 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:30.053709 (+ 14us) server_negotiation.cc:407] Connection header received
0808 04:40:30.053858 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:30.053861 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:30.053921 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:30.053990 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:30.054573 (+ 583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:30.054577 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:30.054580 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:40:30.054591 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:30.054611 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:40:30.054618 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:30.054690 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:30.054769 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 04:40:30.054807 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 04:40:30.060534 20415 raft_consensus.cc:1261] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 195577bf99184fcd94c1eadf25a6fb9c [term 1 FOLLOWER]: Refusing update from remote peer 0901ba1c1bb84f5488c7af92d65a3fb9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:30.060535 20230 raft_consensus.cc:1261] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 788dab83c61e4bc5bb76e2d5aee65a4d [term 1 FOLLOWER]: Refusing update from remote peer 0901ba1c1bb84f5488c7af92d65a3fb9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:30.061158 20693 consensus_queue.cc:1035] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 0901ba1c1bb84f5488c7af92d65a3fb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "195577bf99184fcd94c1eadf25a6fb9c" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 45893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:30.061317 20690 consensus_queue.cc:1035] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 0901ba1c1bb84f5488c7af92d65a3fb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "788dab83c61e4bc5bb76e2d5aee65a4d" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:30.067478 20696 mvcc.cc:205] Tried to move back new op lower bound from 7316127867121176576 to 7316127867017838592. Current Snapshot: MvccSnapshot[applied={T|T < 7316127867121176576}]
I20260808 04:40:30.068929 20699 mvcc.cc:205] Tried to move back new op lower bound from 7316127867121176576 to 7316127867017838592. Current Snapshot: MvccSnapshot[applied={T|T < 7316127867121176576}]
I20260808 04:40:30.070775 20698 mvcc.cc:205] Tried to move back new op lower bound from 7316127867121176576 to 7316127867017838592. Current Snapshot: MvccSnapshot[applied={T|T < 7316127867121176576}]
I20260808 04:40:30.075620 20018 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48836:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:30.075757 20018 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48836:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:30.077972 20018 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0b788a75528b4159b9f019949ea511be: Sending DeleteTablet for 3 replicas of tablet 1c9c2c7b95db4eac96c5b6b62980bac4
I20260808 04:40:30.078668 20387 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c9c2c7b95db4eac96c5b6b62980bac4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:30 UTC) from {username='slave'} at 127.0.0.1:60476
I20260808 04:40:30.078768 20202 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c9c2c7b95db4eac96c5b6b62980bac4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:30 UTC) from {username='slave'} at 127.0.0.1:47296
I20260808 04:40:30.078794 20566 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c9c2c7b95db4eac96c5b6b62980bac4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:30 UTC) from {username='slave'} at 127.0.0.1:35142
I20260808 04:40:30.079252 20709 tablet_replica.cc:330] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 195577bf99184fcd94c1eadf25a6fb9c: stopping tablet replica
I20260808 04:40:30.079558 20709 raft_consensus.cc:2229] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 195577bf99184fcd94c1eadf25a6fb9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:30.079766 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 20111
I20260808 04:40:30.087212 20713 tablet_replica.cc:330] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 0901ba1c1bb84f5488c7af92d65a3fb9: stopping tablet replica
I20260808 04:40:30.087682 20713 raft_consensus.cc:2229] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 0901ba1c1bb84f5488c7af92d65a3fb9 [term 1 LEADER]: Raft consensus shutting down.
I20260808 04:40:30.088035 20709 raft_consensus.cc:2258] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 195577bf99184fcd94c1eadf25a6fb9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:30.088370 20713 raft_consensus.cc:2258] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 0901ba1c1bb84f5488c7af92d65a3fb9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:30.092100 20713 ts_tablet_manager.cc:1905] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 0901ba1c1bb84f5488c7af92d65a3fb9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:30.093514 20709 ts_tablet_manager.cc:1905] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 195577bf99184fcd94c1eadf25a6fb9c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:30.095005 20713 ts_tablet_manager.cc:1918] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 0901ba1c1bb84f5488c7af92d65a3fb9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:40:30.095094 20713 log.cc:1196] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 0901ba1c1bb84f5488c7af92d65a3fb9: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-2/wal/wals/1c9c2c7b95db4eac96c5b6b62980bac4
I20260808 04:40:30.095384 20713 ts_tablet_manager.cc:1939] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 0901ba1c1bb84f5488c7af92d65a3fb9: Deleting consensus metadata
I20260808 04:40:30.096546 20709 ts_tablet_manager.cc:1918] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 195577bf99184fcd94c1eadf25a6fb9c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:40:30.096561 20002 catalog_manager.cc:4841] TS 0901ba1c1bb84f5488c7af92d65a3fb9 (127.12.148.67:35443): tablet 1c9c2c7b95db4eac96c5b6b62980bac4 (table test-table [id=e2a1c907b0e34407ae0d2f0f52d005f3]) successfully deleted
I20260808 04:40:30.096691 20709 log.cc:1196] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 195577bf99184fcd94c1eadf25a6fb9c: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786164004017495-12881-0/minicluster-data/ts-1/wal/wals/1c9c2c7b95db4eac96c5b6b62980bac4
I20260808 04:40:30.097048 20709 ts_tablet_manager.cc:1939] T 1c9c2c7b95db4eac96c5b6b62980bac4 P 195577bf99184fcd94c1eadf25a6fb9c: Deleting consensus metadata
I20260808 04:40:30.098299 19998 catalog_manager.cc:4841] TS 195577bf99184fcd94c1eadf25a6fb9c (127.12.148.66:45893): tablet 1c9c2c7b95db4eac96c5b6b62980bac4 (table test-table [id=e2a1c907b0e34407ae0d2f0f52d005f3]) successfully deleted
W20260808 04:40:30.101945 20000 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.148.65:39413 (error 108)
I20260808 04:40:30.102068 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 20300
I20260808 04:40:30.107896 20673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:30.107604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:39413 (local address 127.0.0.1:47310)
0808 04:40:30.107739 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:30.107810 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.65:39413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260808 04:40:30.108153 20000 catalog_manager.cc:4584] TS 788dab83c61e4bc5bb76e2d5aee65a4d (127.12.148.65:39413): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1c9c2c7b95db4eac96c5b6b62980bac4: Network error: Client connection negotiation failed: client connection to 127.12.148.65:39413: connect: Connection refused (error 111)
I20260808 04:40:30.113255 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 20482
I20260808 04:40:30.120837 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 19975
2026-08-08T04:40:30Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (1049 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260808 04:40:30.149950 12881 mini_oidc.cc:152] Starting JWKS server
I20260808 04:40:30.151569 12881 webserver.cc:460] Webserver started at https://127.0.0.1:41179/ using document root <none> and password file <none>
I20260808 04:40:30.151711 12881 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 04:40:30.151932 12881 webserver.cc:460] Webserver started at http://127.0.0.1:39243/ using document root <none> and password file <none>
2026-08-08T04:40:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:40:30Z Disabled control of system clock
I20260808 04:40:30.162122 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:35841
--webserver_interface=127.12.148.126
--webserver_port=0
--builtin_ntp_servers=127.12.148.84:33443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:35841
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41179/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786164004017495-12881-0/testchainca.cert with env {}
W20260808 04:40:30.273522 20723 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:30.273815 20723 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:30.273857 20723 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:30.277825 20723 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:40:30.277887 20723 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:30.277901 20723 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:30.277916 20723 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:40:30.277930 20723 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 04:40:30.277952 20723 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 04:40:30.277964 20723 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:41179/jwks.json
I20260808 04:40:30.283231 20723 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:33443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:35841
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:35841
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41179/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786164004017495-12881-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20723
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:30.284224 20723 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:30.285183 20723 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:30.293542 20731 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:30.293601 20735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:30.293542 20732 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:30.293843 20723 server_base.cc:1034] running on GCE node
I20260808 04:40:30.294392 20723 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:30.295480 20723 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:30.296638 20723 hybrid_clock.cc:648] HybridClock initialized: now 1786164030296623 us; error 27 us; skew 500 ppm
I20260808 04:40:30.298537 20723 webserver.cc:460] Webserver started at http://127.12.148.126:41725/ using document root <none> and password file <none>
I20260808 04:40:30.299098 20723 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:30.299163 20723 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:30.299362 20723 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:30.301479 20723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "2203f9bcfb524d0fa1427695fce00bf2"
format_stamp: "Formatted at 2026-08-08 04:40:30 on dist-test-slave-t7g5"
server_key: "5ed194e22d0b2d6f79a55a2ed58714b9"
server_key_iv: "eca69126d48a4a9a8ffda14c30354759"
server_key_version: "encryptionkey@0"
I20260808 04:40:30.302067 20723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "2203f9bcfb524d0fa1427695fce00bf2"
format_stamp: "Formatted at 2026-08-08 04:40:30 on dist-test-slave-t7g5"
server_key: "5ed194e22d0b2d6f79a55a2ed58714b9"
server_key_iv: "eca69126d48a4a9a8ffda14c30354759"
server_key_version: "encryptionkey@0"
I20260808 04:40:30.305613 20723 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:40:30.308048 20745 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:30.309217 20723 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:40:30.309330 20723 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "2203f9bcfb524d0fa1427695fce00bf2"
format_stamp: "Formatted at 2026-08-08 04:40:30 on dist-test-slave-t7g5"
server_key: "5ed194e22d0b2d6f79a55a2ed58714b9"
server_key_iv: "eca69126d48a4a9a8ffda14c30354759"
server_key_version: "encryptionkey@0"
I20260808 04:40:30.309424 20723 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:30.325044 20723 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:30.325646 20723 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:30.325842 20723 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:30.332309 20723 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:35841
I20260808 04:40:30.332330 20824 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:35841 every 8 connection(s)
I20260808 04:40:30.333185 20723 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:40:30.336417 20825 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:30.337854 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 20723
I20260808 04:40:30.337973 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:40:30.338266 12881 external_mini_cluster.cc:1428] Setting key 74fbbec807210745538f7004ffad3e93
I20260808 04:40:30.342428 20825 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2203f9bcfb524d0fa1427695fce00bf2: Bootstrap starting.
I20260808 04:40:30.344579 20825 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2203f9bcfb524d0fa1427695fce00bf2: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:30.345284 20825 log.cc:824] T 00000000000000000000000000000000 P 2203f9bcfb524d0fa1427695fce00bf2: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:30.347093 20829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:30.339508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60480 (local address 127.12.148.126:35841)
0808 04:40:30.340183 (+ 675us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:30.340205 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:30.340250 (+ 45us) server_negotiation.cc:407] Connection header received
0808 04:40:30.340917 (+ 667us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:30.340934 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:30.341316 (+ 382us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:30.341627 (+ 311us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:30.342078 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:30.343087 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:30.343978 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:30.344453 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:30.344610 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:30.345375 (+ 765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:30.345380 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:30.345395 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:40:30.345836 (+ 441us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:30.345895 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:40:30.345916 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:30.346005 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:30.346143 (+ 138us) server_negotiation.cc:299] Negotiation successful
0808 04:40:30.346393 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":245,"thread_start_us":102,"threads_started":1}
I20260808 04:40:30.347149 20825 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2203f9bcfb524d0fa1427695fce00bf2: No bootstrap required, opened a new log
I20260808 04:40:30.349838 12881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:40:30.351008 20825 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2203f9bcfb524d0fa1427695fce00bf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2203f9bcfb524d0fa1427695fce00bf2" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 35841 } }
I20260808 04:40:30.351226 20825 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2203f9bcfb524d0fa1427695fce00bf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:30.351291 20825 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2203f9bcfb524d0fa1427695fce00bf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2203f9bcfb524d0fa1427695fce00bf2, State: Initialized, Role: FOLLOWER
I20260808 04:40:30.351732 20825 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2203f9bcfb524d0fa1427695fce00bf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2203f9bcfb524d0fa1427695fce00bf2" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 35841 } }
I20260808 04:40:30.351862 20825 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2203f9bcfb524d0fa1427695fce00bf2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:40:30.351908 20825 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2203f9bcfb524d0fa1427695fce00bf2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:40:30.351977 20825 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2203f9bcfb524d0fa1427695fce00bf2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:30.352814 20825 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2203f9bcfb524d0fa1427695fce00bf2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2203f9bcfb524d0fa1427695fce00bf2" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 35841 } }
I20260808 04:40:30.353106 20825 leader_election.cc:302] T 00000000000000000000000000000000 P 2203f9bcfb524d0fa1427695fce00bf2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2203f9bcfb524d0fa1427695fce00bf2; no voters:
I20260808 04:40:30.353367 20825 leader_election.cc:288] T 00000000000000000000000000000000 P 2203f9bcfb524d0fa1427695fce00bf2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:40:30.353472 20832 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2203f9bcfb524d0fa1427695fce00bf2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:30.353703 20832 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2203f9bcfb524d0fa1427695fce00bf2 [term 1 LEADER]: Becoming Leader. State: Replica: 2203f9bcfb524d0fa1427695fce00bf2, State: Running, Role: LEADER
I20260808 04:40:30.354004 20832 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2203f9bcfb524d0fa1427695fce00bf2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2203f9bcfb524d0fa1427695fce00bf2" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 35841 } }
I20260808 04:40:30.354463 20825 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2203f9bcfb524d0fa1427695fce00bf2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:40:30.355543 20836 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2203f9bcfb524d0fa1427695fce00bf2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2203f9bcfb524d0fa1427695fce00bf2. Latest consensus state: current_term: 1 leader_uuid: "2203f9bcfb524d0fa1427695fce00bf2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2203f9bcfb524d0fa1427695fce00bf2" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 35841 } } }
I20260808 04:40:30.355594 20833 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2203f9bcfb524d0fa1427695fce00bf2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2203f9bcfb524d0fa1427695fce00bf2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2203f9bcfb524d0fa1427695fce00bf2" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 35841 } } }
I20260808 04:40:30.355664 20836 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2203f9bcfb524d0fa1427695fce00bf2 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:30.355717 20833 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2203f9bcfb524d0fa1427695fce00bf2 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:30.356038 20850 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:40:30.359450 20850 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:40:30.364665 20850 catalog_manager.cc:1347] Generated new cluster ID: b71757daac084b3e91b4abf194f2bdbe
I20260808 04:40:30.364732 20850 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:40:30.373322 20850 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:40:30.374223 20850 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:40:30.382783 20850 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2203f9bcfb524d0fa1427695fce00bf2: Generated new TSK 0
I20260808 04:40:30.383387 20850 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 04:40:30.413460 20870 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260808 04:40:30.413743 20870 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 04:40:30.414176 20829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:30.396701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60484 (local address 127.12.148.126:35841)
0808 04:40:30.396824 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:30.396828 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:30.397034 (+ 206us) server_negotiation.cc:407] Connection header received
0808 04:40:30.397236 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:30.397239 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:30.397288 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:30.397407 (+ 119us) server_negotiation.cc:226] Negotiated authn=JWT
0808 04:40:30.397641 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:30.398199 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:30.399040 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:30.399267 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:30.399359 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:30.399670 (+ 311us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 04:40:30.413829 (+ 14159us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41179/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 04:40:30.414068 (+ 239us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:60484: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41179/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":38}
W20260808 04:40:30.414227 20829 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:60484: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41179/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260808 04:40:30.415727 20869 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:30.396628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:35841 (local address 127.0.0.1:60484)
0808 04:40:30.396956 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:30.396968 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:30.397089 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:30.397423 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:30.397427 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:30.397434 (+ 7us) client_negotiation.cc:189] Negotiated authn=JWT
0808 04:40:30.397541 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:30.397546 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:30.398305 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:30.398309 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:30.398932 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:30.398939 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:30.399368 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:30.399371 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:30.399457 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:30.399498 (+ 41us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 04:40:30.414056 (+ 14558us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41179/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 04:40:30.414273 (+ 217us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.148.126:35841: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41179/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":113,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.12.148.126:35841: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41179/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260808 04:40:30.416352 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 20723
2026-08-08T04:40:30Z chronyd exiting
I20260808 04:40:30.461771 12881 test_util.cc:175] -----------------------------------------------
I20260808 04:40:30.461863 12881 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786164004017495-12881-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (313 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260808 04:40:30.462984 12881 mini_oidc.cc:152] Starting JWKS server
I20260808 04:40:30.463840 12881 webserver.cc:460] Webserver started at https://127.0.0.1:43801/ using document root <none> and password file <none>
I20260808 04:40:30.463930 12881 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 04:40:30.464185 12881 webserver.cc:460] Webserver started at http://127.0.0.1:39031/ using document root <none> and password file <none>
2026-08-08T04:40:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:40:30Z Disabled control of system clock
I20260808 04:40:30.473531 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:40707
--webserver_interface=127.12.148.126
--webserver_port=0
--builtin_ntp_servers=127.12.148.84:33193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:40707
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43801/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786164004017495-12881-0/testchainca.cert with env {}
W20260808 04:40:30.582198 20878 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:30.582463 20878 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:30.582504 20878 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:30.586366 20878 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:40:30.586411 20878 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:30.586426 20878 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:30.586447 20878 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:40:30.586467 20878 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 04:40:30.586483 20878 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 04:40:30.586499 20878 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:43801/jwks.json
I20260808 04:40:30.591683 20878 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:33193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:40707
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:40707
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43801/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786164004017495-12881-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20878
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:30.592595 20878 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:30.593499 20878 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:30.602206 20892 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:30.602267 20887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:30.602221 20884 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:30.602382 20878 server_base.cc:1034] running on GCE node
I20260808 04:40:30.602999 20878 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:30.604053 20878 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:30.605216 20878 hybrid_clock.cc:648] HybridClock initialized: now 1786164030605200 us; error 30 us; skew 500 ppm
I20260808 04:40:30.606984 20878 webserver.cc:460] Webserver started at http://127.12.148.126:42413/ using document root <none> and password file <none>
I20260808 04:40:30.607512 20878 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:30.607580 20878 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:30.607759 20878 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:30.609743 20878 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "9cdf37ffdf9e488b9ab788d252fd1248"
format_stamp: "Formatted at 2026-08-08 04:40:30 on dist-test-slave-t7g5"
server_key: "035e7190d787804001eb444af536dd5f"
server_key_iv: "5749df3e54e97bf1373232945a8252d5"
server_key_version: "encryptionkey@0"
I20260808 04:40:30.610287 20878 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "9cdf37ffdf9e488b9ab788d252fd1248"
format_stamp: "Formatted at 2026-08-08 04:40:30 on dist-test-slave-t7g5"
server_key: "035e7190d787804001eb444af536dd5f"
server_key_iv: "5749df3e54e97bf1373232945a8252d5"
server_key_version: "encryptionkey@0"
I20260808 04:40:30.613683 20878 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.003s
I20260808 04:40:30.616003 20902 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:30.617133 20878 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:40:30.617247 20878 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "9cdf37ffdf9e488b9ab788d252fd1248"
format_stamp: "Formatted at 2026-08-08 04:40:30 on dist-test-slave-t7g5"
server_key: "035e7190d787804001eb444af536dd5f"
server_key_iv: "5749df3e54e97bf1373232945a8252d5"
server_key_version: "encryptionkey@0"
I20260808 04:40:30.617340 20878 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:30.633496 20878 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:30.634197 20878 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:30.634371 20878 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:30.641080 20878 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:40707
I20260808 04:40:30.641098 20977 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:40707 every 8 connection(s)
I20260808 04:40:30.642006 20878 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:40:30.645187 20978 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:30.648974 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 20878
I20260808 04:40:30.649101 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:40:30.649492 12881 external_mini_cluster.cc:1428] Setting key 29745bbafdadaa6a2bc16e60df1cf775
I20260808 04:40:30.651237 20978 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9cdf37ffdf9e488b9ab788d252fd1248: Bootstrap starting.
I20260808 04:40:30.653450 20978 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9cdf37ffdf9e488b9ab788d252fd1248: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:30.654223 20978 log.cc:824] T 00000000000000000000000000000000 P 9cdf37ffdf9e488b9ab788d252fd1248: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:30.656070 20978 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9cdf37ffdf9e488b9ab788d252fd1248: No bootstrap required, opened a new log
I20260808 04:40:30.658586 20982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:30.650913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45784 (local address 127.12.148.126:40707)
0808 04:40:30.651562 (+ 649us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:30.651578 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:30.651614 (+ 36us) server_negotiation.cc:407] Connection header received
0808 04:40:30.652241 (+ 627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:30.652257 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:30.652648 (+ 391us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:30.652968 (+ 320us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:30.653402 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:30.654476 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:30.655372 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:30.655855 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:30.656014 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:30.656773 (+ 759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:30.656778 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:30.656789 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:40:30.657162 (+ 373us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:30.657215 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:40:30.657235 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:30.657321 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:30.657460 (+ 139us) server_negotiation.cc:299] Negotiation successful
0808 04:40:30.657738 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":287,"thread_start_us":131,"threads_started":1}
I20260808 04:40:30.659109 20978 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9cdf37ffdf9e488b9ab788d252fd1248 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cdf37ffdf9e488b9ab788d252fd1248" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40707 } }
I20260808 04:40:30.659332 20978 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9cdf37ffdf9e488b9ab788d252fd1248 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:30.660055 20978 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9cdf37ffdf9e488b9ab788d252fd1248 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cdf37ffdf9e488b9ab788d252fd1248, State: Initialized, Role: FOLLOWER
I20260808 04:40:30.660543 20978 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9cdf37ffdf9e488b9ab788d252fd1248 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cdf37ffdf9e488b9ab788d252fd1248" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40707 } }
I20260808 04:40:30.660714 20978 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9cdf37ffdf9e488b9ab788d252fd1248 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:40:30.660790 20978 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9cdf37ffdf9e488b9ab788d252fd1248 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:40:30.660895 20978 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9cdf37ffdf9e488b9ab788d252fd1248 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:30.661155 12881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:40:30.661972 20978 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9cdf37ffdf9e488b9ab788d252fd1248 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cdf37ffdf9e488b9ab788d252fd1248" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40707 } }
I20260808 04:40:30.662341 20978 leader_election.cc:302] T 00000000000000000000000000000000 P 9cdf37ffdf9e488b9ab788d252fd1248 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9cdf37ffdf9e488b9ab788d252fd1248; no voters:
I20260808 04:40:30.662681 20978 leader_election.cc:288] T 00000000000000000000000000000000 P 9cdf37ffdf9e488b9ab788d252fd1248 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:40:30.662779 20984 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9cdf37ffdf9e488b9ab788d252fd1248 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:30.662992 20984 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9cdf37ffdf9e488b9ab788d252fd1248 [term 1 LEADER]: Becoming Leader. State: Replica: 9cdf37ffdf9e488b9ab788d252fd1248, State: Running, Role: LEADER
I20260808 04:40:30.663296 20984 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9cdf37ffdf9e488b9ab788d252fd1248 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cdf37ffdf9e488b9ab788d252fd1248" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40707 } }
I20260808 04:40:30.663837 20978 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9cdf37ffdf9e488b9ab788d252fd1248 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:40:30.664825 20987 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9cdf37ffdf9e488b9ab788d252fd1248 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9cdf37ffdf9e488b9ab788d252fd1248. Latest consensus state: current_term: 1 leader_uuid: "9cdf37ffdf9e488b9ab788d252fd1248" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cdf37ffdf9e488b9ab788d252fd1248" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40707 } } }
I20260808 04:40:30.664965 20987 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9cdf37ffdf9e488b9ab788d252fd1248 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:30.665310 20985 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9cdf37ffdf9e488b9ab788d252fd1248 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9cdf37ffdf9e488b9ab788d252fd1248" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cdf37ffdf9e488b9ab788d252fd1248" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40707 } } }
I20260808 04:40:30.665401 20985 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9cdf37ffdf9e488b9ab788d252fd1248 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:30.666194 20997 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:40:30.669154 20997 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:40:30.674999 20997 catalog_manager.cc:1347] Generated new cluster ID: 4d7ba92425674270b3ef010e87c7ffdb
I20260808 04:40:30.675068 20997 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:40:30.686650 20997 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:40:30.687831 20997 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:40:30.696830 20997 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9cdf37ffdf9e488b9ab788d252fd1248: Generated new TSK 0
I20260808 04:40:30.697566 20997 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 04:40:30.723711 21019 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260808 04:40:30.723794 21019 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 04:40:30.724403 20982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:30.709386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45798 (local address 127.12.148.126:40707)
0808 04:40:30.709500 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:30.709504 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:30.709708 (+ 204us) server_negotiation.cc:407] Connection header received
0808 04:40:30.709876 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:30.709879 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:30.709925 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:30.710014 (+ 89us) server_negotiation.cc:226] Negotiated authn=JWT
0808 04:40:30.710242 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:30.710764 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:30.711598 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:30.711812 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:30.711896 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:30.712177 (+ 281us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 04:40:30.724019 (+ 11842us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43801/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 04:40:30.724253 (+ 234us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:45798: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43801/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":36}
W20260808 04:40:30.724463 21016 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:30.709320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40707 (local address 127.0.0.1:45798)
0808 04:40:30.709606 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:30.709618 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:30.709752 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:30.710027 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:30.710031 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:30.710038 (+ 7us) client_negotiation.cc:189] Negotiated authn=JWT
0808 04:40:30.710146 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:30.710151 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:30.710876 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:30.710880 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:30.711491 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:30.711499 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:30.711914 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:30.711918 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:30.712005 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:30.712028 (+ 23us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 04:40:30.724177 (+ 12149us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43801/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 04:40:30.724313 (+ 136us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.148.126:40707: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43801/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":115,"threads_started":1}
W20260808 04:40:30.724470 20982 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:45798: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43801/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
I20260808 04:40:30.724788 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 20878
2026-08-08T04:40:30Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (307 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260808 04:40:30.770385 12881 mini_oidc.cc:152] Starting JWKS server
I20260808 04:40:30.771235 12881 webserver.cc:460] Webserver started at https://127.0.0.1:44957/ using document root <none> and password file <none>
I20260808 04:40:30.771329 12881 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 04:40:30.771589 12881 webserver.cc:460] Webserver started at http://127.0.0.1:44537/ using document root <none> and password file <none>
2026-08-08T04:40:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:40:30Z Disabled control of system clock
I20260808 04:40:30.781258 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:34483
--webserver_interface=127.12.148.126
--webserver_port=0
--builtin_ntp_servers=127.12.148.84:34823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:34483
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44957/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 04:40:30.891954 21030 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:30.892211 21030 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:30.892247 21030 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:30.896142 21030 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:40:30.896203 21030 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:30.896217 21030 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:30.896235 21030 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:40:30.896265 21030 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 04:40:30.896291 21030 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 04:40:30.896317 21030 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:44957/jwks.json
I20260808 04:40:30.901011 21030 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:34823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:34483
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:34483
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44957/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21030
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:30.902074 21030 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:30.903436 21030 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:30.911600 21044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:30.911593 21038 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:30.911660 21030 server_base.cc:1034] running on GCE node
W20260808 04:40:30.911741 21039 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:30.912371 21030 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:30.913421 21030 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:30.914592 21030 hybrid_clock.cc:648] HybridClock initialized: now 1786164030914575 us; error 31 us; skew 500 ppm
I20260808 04:40:30.916488 21030 webserver.cc:460] Webserver started at http://127.12.148.126:43941/ using document root <none> and password file <none>
I20260808 04:40:30.917043 21030 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:30.917114 21030 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:30.917318 21030 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:30.919396 21030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "039ea58d4b124083b2601c7152aad627"
format_stamp: "Formatted at 2026-08-08 04:40:30 on dist-test-slave-t7g5"
server_key: "10211ea6f2cd4a9e8157f167dfd467ba"
server_key_iv: "4ee775db1bbe722d1fb690029adbe275"
server_key_version: "encryptionkey@0"
I20260808 04:40:30.919955 21030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "039ea58d4b124083b2601c7152aad627"
format_stamp: "Formatted at 2026-08-08 04:40:30 on dist-test-slave-t7g5"
server_key: "10211ea6f2cd4a9e8157f167dfd467ba"
server_key_iv: "4ee775db1bbe722d1fb690029adbe275"
server_key_version: "encryptionkey@0"
I20260808 04:40:30.923605 21030 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260808 04:40:30.926029 21053 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:30.927220 21030 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:40:30.927338 21030 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "039ea58d4b124083b2601c7152aad627"
format_stamp: "Formatted at 2026-08-08 04:40:30 on dist-test-slave-t7g5"
server_key: "10211ea6f2cd4a9e8157f167dfd467ba"
server_key_iv: "4ee775db1bbe722d1fb690029adbe275"
server_key_version: "encryptionkey@0"
I20260808 04:40:30.927435 21030 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:30.938045 21030 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:30.938651 21030 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:30.938813 21030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:30.945220 21030 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:34483
I20260808 04:40:30.945227 21125 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:34483 every 8 connection(s)
I20260808 04:40:30.946146 21030 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:40:30.948815 21126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:30.954038 21126 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 039ea58d4b124083b2601c7152aad627: Bootstrap starting.
I20260808 04:40:30.956292 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 21030
I20260808 04:40:30.956382 21126 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 039ea58d4b124083b2601c7152aad627: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:30.956437 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:40:30.956741 12881 external_mini_cluster.cc:1428] Setting key 3a0b348cd8e760b4ab7ddb4df5fe4d90
I20260808 04:40:30.957222 21126 log.cc:824] T 00000000000000000000000000000000 P 039ea58d4b124083b2601c7152aad627: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:30.959473 21126 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 039ea58d4b124083b2601c7152aad627: No bootstrap required, opened a new log
I20260808 04:40:30.963768 21126 raft_consensus.cc:348] T 00000000000000000000000000000000 P 039ea58d4b124083b2601c7152aad627 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "039ea58d4b124083b2601c7152aad627" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 34483 } }
I20260808 04:40:30.964061 21126 raft_consensus.cc:374] T 00000000000000000000000000000000 P 039ea58d4b124083b2601c7152aad627 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:30.964126 21126 raft_consensus.cc:729] T 00000000000000000000000000000000 P 039ea58d4b124083b2601c7152aad627 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 039ea58d4b124083b2601c7152aad627, State: Initialized, Role: FOLLOWER
I20260808 04:40:30.964591 21126 consensus_queue.cc:260] T 00000000000000000000000000000000 P 039ea58d4b124083b2601c7152aad627 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "039ea58d4b124083b2601c7152aad627" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 34483 } }
I20260808 04:40:30.964753 21126 raft_consensus.cc:388] T 00000000000000000000000000000000 P 039ea58d4b124083b2601c7152aad627 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:40:30.964820 21126 raft_consensus.cc:482] T 00000000000000000000000000000000 P 039ea58d4b124083b2601c7152aad627 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:40:30.964917 21126 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 039ea58d4b124083b2601c7152aad627 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:30.966049 21126 raft_consensus.cc:504] T 00000000000000000000000000000000 P 039ea58d4b124083b2601c7152aad627 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "039ea58d4b124083b2601c7152aad627" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 34483 } }
I20260808 04:40:30.966493 21126 leader_election.cc:302] T 00000000000000000000000000000000 P 039ea58d4b124083b2601c7152aad627 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 039ea58d4b124083b2601c7152aad627; no voters:
I20260808 04:40:30.966739 21131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:30.957776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39874 (local address 127.12.148.126:34483)
0808 04:40:30.958460 (+ 684us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:30.958480 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:30.958523 (+ 43us) server_negotiation.cc:407] Connection header received
0808 04:40:30.959327 (+ 804us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:30.959349 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:30.959760 (+ 411us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:30.960129 (+ 369us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:30.960554 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:30.962071 (+ 1517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:30.962914 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:30.963611 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:30.963771 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:30.964585 (+ 814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:30.964591 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:30.964607 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:40:30.965121 (+ 514us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:30.965193 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:40:30.965221 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:30.965315 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:30.965425 (+ 110us) server_negotiation.cc:299] Negotiation successful
0808 04:40:30.965732 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":133,"threads_started":1}
I20260808 04:40:30.966840 21126 leader_election.cc:288] T 00000000000000000000000000000000 P 039ea58d4b124083b2601c7152aad627 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:40:30.966956 21132 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 039ea58d4b124083b2601c7152aad627 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:30.967162 21132 raft_consensus.cc:686] T 00000000000000000000000000000000 P 039ea58d4b124083b2601c7152aad627 [term 1 LEADER]: Becoming Leader. State: Replica: 039ea58d4b124083b2601c7152aad627, State: Running, Role: LEADER
I20260808 04:40:30.967509 21132 consensus_queue.cc:237] T 00000000000000000000000000000000 P 039ea58d4b124083b2601c7152aad627 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "039ea58d4b124083b2601c7152aad627" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 34483 } }
I20260808 04:40:30.968096 21126 sys_catalog.cc:564] T 00000000000000000000000000000000 P 039ea58d4b124083b2601c7152aad627 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:40:30.969122 21133 sys_catalog.cc:455] T 00000000000000000000000000000000 P 039ea58d4b124083b2601c7152aad627 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "039ea58d4b124083b2601c7152aad627" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "039ea58d4b124083b2601c7152aad627" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 34483 } } }
I20260808 04:40:30.969245 21133 sys_catalog.cc:458] T 00000000000000000000000000000000 P 039ea58d4b124083b2601c7152aad627 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:30.969674 21144 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:40:30.970502 12881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:40:30.970482 21134 sys_catalog.cc:455] T 00000000000000000000000000000000 P 039ea58d4b124083b2601c7152aad627 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 039ea58d4b124083b2601c7152aad627. Latest consensus state: current_term: 1 leader_uuid: "039ea58d4b124083b2601c7152aad627" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "039ea58d4b124083b2601c7152aad627" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 34483 } } }
I20260808 04:40:30.970582 21134 sys_catalog.cc:458] T 00000000000000000000000000000000 P 039ea58d4b124083b2601c7152aad627 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:30.973903 21144 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:40:30.979415 21144 catalog_manager.cc:1347] Generated new cluster ID: 3c8ea7a93456483688f35f9006bbd4a0
I20260808 04:40:30.979480 21144 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:40:30.996542 21144 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:40:30.997570 21144 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:40:31.001820 21144 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 039ea58d4b124083b2601c7152aad627: Generated new TSK 0
I20260808 04:40:31.002496 21144 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:40:31.017268 21131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:31.012139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39890 (local address 127.12.148.126:34483)
0808 04:40:31.012263 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:31.012267 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:31.012432 (+ 165us) server_negotiation.cc:407] Connection header received
0808 04:40:31.012560 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:31.012563 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:31.012619 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:31.012726 (+ 107us) server_negotiation.cc:226] Negotiated authn=JWT
0808 04:40:31.012937 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:31.013783 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:31.014655 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:31.015039 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:31.015144 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:31.015400 (+ 256us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 04:40:31.016898 (+ 1498us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44957/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 04:40:31.017134 (+ 236us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:39890: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44957/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":46}
W20260808 04:40:31.017344 21131 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:39890: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44957/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260808 04:40:31.018890 21161 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:31.012041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:34483 (local address 127.0.0.1:39890)
0808 04:40:31.012350 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:31.012362 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:31.012461 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:31.012723 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:31.012726 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:31.012733 (+ 7us) client_negotiation.cc:189] Negotiated authn=JWT
0808 04:40:31.012844 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:31.012848 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:31.013902 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:31.013906 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:31.014546 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:31.014555 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:31.015153 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:31.015156 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:31.015219 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:31.015241 (+ 22us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 04:40:31.017065 (+ 1824us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44957/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 04:40:31.018708 (+ 1643us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.148.126:34483: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44957/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":233,"mutex_wait_us":1459,"thread_start_us":106,"threads_started":1}
I20260808 04:40:31.019222 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 21030
E20260808 04:40:31.031613 21162 webserver.cc:533] Webserver: sslize failed:
E20260808 04:40:31.031695 21162 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-08T04:40:31Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (295 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-08T04:40:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:40:31Z Disabled control of system clock
I20260808 04:40:31.075543 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:45981
--webserver_interface=127.12.148.126
--webserver_port=0
--builtin_ntp_servers=127.12.148.84:34029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:45981
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786164004017495-12881-0/testchainca.cert with env {}
W20260808 04:40:31.185335 21169 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:31.185606 21169 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:31.185644 21169 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:31.189698 21169 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:40:31.189755 21169 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:31.189769 21169 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:31.189785 21169 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:40:31.189802 21169 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 04:40:31.189831 21169 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 04:40:31.189853 21169 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260808 04:40:31.195163 21169 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:34029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:45981
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:45981
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786164004017495-12881-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21169
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:31.196213 21169 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:31.197223 21169 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:31.205581 21178 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:31.205595 21179 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:31.205706 21169 server_base.cc:1034] running on GCE node
W20260808 04:40:31.205951 21181 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:31.206509 21169 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:31.207661 21169 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:31.208827 21169 hybrid_clock.cc:648] HybridClock initialized: now 1786164031208806 us; error 32 us; skew 500 ppm
I20260808 04:40:31.210753 21169 webserver.cc:460] Webserver started at http://127.12.148.126:41581/ using document root <none> and password file <none>
I20260808 04:40:31.211333 21169 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:31.211403 21169 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:31.211591 21169 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:31.213629 21169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "657c0e6a0ae24d469702cc3b854dd159"
format_stamp: "Formatted at 2026-08-08 04:40:31 on dist-test-slave-t7g5"
server_key: "67ffcc9bfb0d7b0556e35483a9f435e7"
server_key_iv: "9996ba42a9ab15d732531c33296a8366"
server_key_version: "encryptionkey@0"
I20260808 04:40:31.214219 21169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "657c0e6a0ae24d469702cc3b854dd159"
format_stamp: "Formatted at 2026-08-08 04:40:31 on dist-test-slave-t7g5"
server_key: "67ffcc9bfb0d7b0556e35483a9f435e7"
server_key_iv: "9996ba42a9ab15d732531c33296a8366"
server_key_version: "encryptionkey@0"
I20260808 04:40:31.217916 21169 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:40:31.220402 21191 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:31.221634 21169 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:40:31.221805 21169 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "657c0e6a0ae24d469702cc3b854dd159"
format_stamp: "Formatted at 2026-08-08 04:40:31 on dist-test-slave-t7g5"
server_key: "67ffcc9bfb0d7b0556e35483a9f435e7"
server_key_iv: "9996ba42a9ab15d732531c33296a8366"
server_key_version: "encryptionkey@0"
I20260808 04:40:31.221908 21169 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:31.241174 21169 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:31.241930 21169 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:31.242115 21169 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:31.248754 21169 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:45981
I20260808 04:40:31.248773 21264 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:45981 every 8 connection(s)
I20260808 04:40:31.249792 21169 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:40:31.251183 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 21169
I20260808 04:40:31.251310 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:40:31.251633 12881 external_mini_cluster.cc:1428] Setting key 4dd5e6b1d127512f7cc97ea983de1fcd
I20260808 04:40:31.253366 21268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:31.259414 21268 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 657c0e6a0ae24d469702cc3b854dd159: Bootstrap starting.
I20260808 04:40:31.260620 21274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:31.252977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37108 (local address 127.12.148.126:45981)
0808 04:40:31.253604 (+ 627us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:31.253620 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:31.253693 (+ 73us) server_negotiation.cc:407] Connection header received
0808 04:40:31.254344 (+ 651us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:31.254361 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:31.254753 (+ 392us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:31.255042 (+ 289us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:31.255371 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:31.256342 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:31.257466 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:31.257968 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:31.258081 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:31.258925 (+ 844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:31.258930 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:31.258951 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:40:31.259320 (+ 369us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:31.259376 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:40:31.259395 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:31.259470 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:31.259647 (+ 177us) server_negotiation.cc:299] Negotiation successful
0808 04:40:31.259918 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":111,"threads_started":1}
I20260808 04:40:31.261637 21268 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 657c0e6a0ae24d469702cc3b854dd159: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:31.262382 21268 log.cc:824] T 00000000000000000000000000000000 P 657c0e6a0ae24d469702cc3b854dd159: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:31.263415 12881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:40:31.264560 21268 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 657c0e6a0ae24d469702cc3b854dd159: No bootstrap required, opened a new log
I20260808 04:40:31.267869 21268 raft_consensus.cc:348] T 00000000000000000000000000000000 P 657c0e6a0ae24d469702cc3b854dd159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "657c0e6a0ae24d469702cc3b854dd159" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45981 } }
I20260808 04:40:31.268082 21268 raft_consensus.cc:374] T 00000000000000000000000000000000 P 657c0e6a0ae24d469702cc3b854dd159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:31.268141 21268 raft_consensus.cc:729] T 00000000000000000000000000000000 P 657c0e6a0ae24d469702cc3b854dd159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 657c0e6a0ae24d469702cc3b854dd159, State: Initialized, Role: FOLLOWER
I20260808 04:40:31.268523 21268 consensus_queue.cc:260] T 00000000000000000000000000000000 P 657c0e6a0ae24d469702cc3b854dd159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "657c0e6a0ae24d469702cc3b854dd159" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45981 } }
I20260808 04:40:31.268647 21268 raft_consensus.cc:388] T 00000000000000000000000000000000 P 657c0e6a0ae24d469702cc3b854dd159 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:40:31.268709 21268 raft_consensus.cc:482] T 00000000000000000000000000000000 P 657c0e6a0ae24d469702cc3b854dd159 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:40:31.268806 21268 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 657c0e6a0ae24d469702cc3b854dd159 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:31.269675 21268 raft_consensus.cc:504] T 00000000000000000000000000000000 P 657c0e6a0ae24d469702cc3b854dd159 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "657c0e6a0ae24d469702cc3b854dd159" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45981 } }
I20260808 04:40:31.270004 21268 leader_election.cc:302] T 00000000000000000000000000000000 P 657c0e6a0ae24d469702cc3b854dd159 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 657c0e6a0ae24d469702cc3b854dd159; no voters:
I20260808 04:40:31.270288 21268 leader_election.cc:288] T 00000000000000000000000000000000 P 657c0e6a0ae24d469702cc3b854dd159 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:40:31.270373 21278 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 657c0e6a0ae24d469702cc3b854dd159 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:31.270597 21278 raft_consensus.cc:686] T 00000000000000000000000000000000 P 657c0e6a0ae24d469702cc3b854dd159 [term 1 LEADER]: Becoming Leader. State: Replica: 657c0e6a0ae24d469702cc3b854dd159, State: Running, Role: LEADER
I20260808 04:40:31.270891 21278 consensus_queue.cc:237] T 00000000000000000000000000000000 P 657c0e6a0ae24d469702cc3b854dd159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "657c0e6a0ae24d469702cc3b854dd159" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45981 } }
I20260808 04:40:31.271373 21268 sys_catalog.cc:564] T 00000000000000000000000000000000 P 657c0e6a0ae24d469702cc3b854dd159 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:40:31.272423 21281 sys_catalog.cc:455] T 00000000000000000000000000000000 P 657c0e6a0ae24d469702cc3b854dd159 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 657c0e6a0ae24d469702cc3b854dd159. Latest consensus state: current_term: 1 leader_uuid: "657c0e6a0ae24d469702cc3b854dd159" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "657c0e6a0ae24d469702cc3b854dd159" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45981 } } }
I20260808 04:40:31.272569 21281 sys_catalog.cc:458] T 00000000000000000000000000000000 P 657c0e6a0ae24d469702cc3b854dd159 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:31.272832 21279 sys_catalog.cc:455] T 00000000000000000000000000000000 P 657c0e6a0ae24d469702cc3b854dd159 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "657c0e6a0ae24d469702cc3b854dd159" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "657c0e6a0ae24d469702cc3b854dd159" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45981 } } }
I20260808 04:40:31.272926 21279 sys_catalog.cc:458] T 00000000000000000000000000000000 P 657c0e6a0ae24d469702cc3b854dd159 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:31.273109 21292 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:40:31.275795 21292 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:40:31.280843 21292 catalog_manager.cc:1347] Generated new cluster ID: 86338c135b544c368ed0e5b96b0e276e
I20260808 04:40:31.280930 21292 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:40:31.293672 21292 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:40:31.294520 21292 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:40:31.298127 21292 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 657c0e6a0ae24d469702cc3b854dd159: Generated new TSK 0
I20260808 04:40:31.298731 21292 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:40:31.379814 21274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:31.313905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37122 (local address 127.12.148.126:45981)
0808 04:40:31.314037 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:31.314042 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:31.314187 (+ 145us) server_negotiation.cc:407] Connection header received
0808 04:40:31.314329 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:31.314332 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:31.314386 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:31.314503 (+ 117us) server_negotiation.cc:226] Negotiated authn=JWT
0808 04:40:31.314675 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:31.315498 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:31.316321 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:31.316666 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:31.316757 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:31.317000 (+ 243us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 04:40:31.379292 (+ 62292us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 04:40:31.379658 (+ 366us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:37122: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":59}
W20260808 04:40:31.379886 21310 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:31.313818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:45981 (local address 127.0.0.1:37122)
0808 04:40:31.314113 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:31.314126 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:31.314218 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:31.314497 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:31.314499 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:31.314505 (+ 6us) client_negotiation.cc:189] Negotiated authn=JWT
0808 04:40:31.314592 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:31.314597 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:31.315601 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:31.315603 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:31.316220 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:31.316228 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:31.316774 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:31.316776 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:31.316843 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:31.316865 (+ 22us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 04:40:31.379551 (+ 62686us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 04:40:31.379733 (+ 182us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.148.126:45981: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":113,"threads_started":1}
W20260808 04:40:31.379905 21274 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:37122: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
I20260808 04:40:31.380673 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 21169
2026-08-08T04:40:31Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (343 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (122 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (124 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:40:31 dist-test-slave-t7g5 krb5kdc[21328](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:40:31 dist-test-slave-t7g5 krb5kdc[21328](info): set up 2 sockets
Aug 08 04:40:31 dist-test-slave-t7g5 krb5kdc[21328](info): commencing operation
krb5kdc: starting...
W20260808 04:40:32.767666 12881 mini_kdc.cc:121] Time spent starting KDC: real 1.111s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Aug 08 04:40:32 dist-test-slave-t7g5 krb5kdc[21328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164032, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:40:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:40:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.148.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
I20260808 04:40:32.885982 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:41519
--webserver_interface=127.12.148.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:43351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:41519
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:32.994258 21346 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:32.994508 21346 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:32.994547 21346 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:32.998431 21346 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:40:32.998498 21346 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:32.998517 21346 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:32.998531 21346 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:40:32.998550 21346 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:40:33.003553 21346 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:43351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:41519
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:41519
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21346
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:33.004477 21346 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:33.005409 21346 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:33.013476 21359 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:33.013517 21352 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:33.013517 21351 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:33.013796 21346 server_base.cc:1034] running on GCE node
I20260808 04:40:33.014372 21346 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:33.015465 21346 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:33.016638 21346 hybrid_clock.cc:648] HybridClock initialized: now 1786164033016621 us; error 26 us; skew 500 ppm
Aug 08 04:40:33 dist-test-slave-t7g5 krb5kdc[21328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164033, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:33.019272 21346 init.cc:377] Logged in from keytab as kudu/127.12.148.126@KRBTEST.COM (short username kudu)
I20260808 04:40:33.020104 21346 webserver.cc:460] Webserver started at http://127.12.148.126:42415/ using document root <none> and password file <none>
I20260808 04:40:33.020627 21346 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:33.020694 21346 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:33.020912 21346 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:33.022936 21346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "4b2e4753478e42528d21875738d78b47"
format_stamp: "Formatted at 2026-08-08 04:40:33 on dist-test-slave-t7g5"
server_key: "557212aac58e0f4156a27dadb2170907"
server_key_iv: "b45ed857dbd2cce53dfa9927f7488154"
server_key_version: "encryptionkey@0"
I20260808 04:40:33.023564 21346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "4b2e4753478e42528d21875738d78b47"
format_stamp: "Formatted at 2026-08-08 04:40:33 on dist-test-slave-t7g5"
server_key: "557212aac58e0f4156a27dadb2170907"
server_key_iv: "b45ed857dbd2cce53dfa9927f7488154"
server_key_version: "encryptionkey@0"
I20260808 04:40:33.027114 21346 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 04:40:33.029402 21370 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:33.030612 21346 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:40:33.030726 21346 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "4b2e4753478e42528d21875738d78b47"
format_stamp: "Formatted at 2026-08-08 04:40:33 on dist-test-slave-t7g5"
server_key: "557212aac58e0f4156a27dadb2170907"
server_key_iv: "b45ed857dbd2cce53dfa9927f7488154"
server_key_version: "encryptionkey@0"
I20260808 04:40:33.030815 21346 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:33.048272 21346 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:33.050999 21346 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:33.051172 21346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:33.057578 21346 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:41519
I20260808 04:40:33.057631 21448 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:41519 every 8 connection(s)
I20260808 04:40:33.058498 21346 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:40:33.061091 21449 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:33.061378 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 21346
I20260808 04:40:33.061487 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:40:33.061786 12881 external_mini_cluster.cc:1428] Setting key 7f583880efa4256b7c885787983d232d
I20260808 04:40:33.067929 21449 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b2e4753478e42528d21875738d78b47: Bootstrap starting.
I20260808 04:40:33.070492 21449 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4b2e4753478e42528d21875738d78b47: Neither blocks nor log segments found. Creating new log.
Aug 08 04:40:33 dist-test-slave-t7g5 krb5kdc[21328](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164032, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:40:33.071306 21449 log.cc:824] T 00000000000000000000000000000000 P 4b2e4753478e42528d21875738d78b47: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:33.073591 21449 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b2e4753478e42528d21875738d78b47: No bootstrap required, opened a new log
I20260808 04:40:33.076355 21452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:33.063013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34148 (local address 127.12.148.126:41519)
0808 04:40:33.063403 (+ 390us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:33.063426 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:33.063470 (+ 44us) server_negotiation.cc:407] Connection header received
0808 04:40:33.064215 (+ 745us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:33.064238 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:33.064648 (+ 410us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:33.065017 (+ 369us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:33.065686 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:33.067155 (+ 1469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:33.068033 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:33.068692 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:33.068847 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:33.071377 (+ 2530us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:33.071384 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:33.071401 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:33.071432 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:33.073319 (+ 1887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:33.073741 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:33.073748 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:33.073753 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:33.073897 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:33.074163 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:33.074165 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:33.074167 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:33.074670 (+ 503us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:33.074856 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:33.075072 (+ 216us) server_negotiation.cc:299] Negotiation successful
0808 04:40:33.075365 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":252,"thread_start_us":108,"threads_started":1}
I20260808 04:40:33.078063 21449 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4b2e4753478e42528d21875738d78b47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b2e4753478e42528d21875738d78b47" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41519 } }
I20260808 04:40:33.078280 21449 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4b2e4753478e42528d21875738d78b47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:33.078342 21449 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4b2e4753478e42528d21875738d78b47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b2e4753478e42528d21875738d78b47, State: Initialized, Role: FOLLOWER
I20260808 04:40:33.078790 21449 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4b2e4753478e42528d21875738d78b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b2e4753478e42528d21875738d78b47" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41519 } }
I20260808 04:40:33.078922 21449 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4b2e4753478e42528d21875738d78b47 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:40:33.078970 21449 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4b2e4753478e42528d21875738d78b47 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:40:33.079043 21449 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4b2e4753478e42528d21875738d78b47 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:33.079864 21449 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4b2e4753478e42528d21875738d78b47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b2e4753478e42528d21875738d78b47" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41519 } }
I20260808 04:40:33.080160 21449 leader_election.cc:302] T 00000000000000000000000000000000 P 4b2e4753478e42528d21875738d78b47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4b2e4753478e42528d21875738d78b47; no voters:
I20260808 04:40:33.080418 21449 leader_election.cc:288] T 00000000000000000000000000000000 P 4b2e4753478e42528d21875738d78b47 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:40:33.080506 21454 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4b2e4753478e42528d21875738d78b47 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:33.080700 21454 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4b2e4753478e42528d21875738d78b47 [term 1 LEADER]: Becoming Leader. State: Replica: 4b2e4753478e42528d21875738d78b47, State: Running, Role: LEADER
I20260808 04:40:33.081000 21454 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4b2e4753478e42528d21875738d78b47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b2e4753478e42528d21875738d78b47" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41519 } }
I20260808 04:40:33.081547 21449 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4b2e4753478e42528d21875738d78b47 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:40:33.082638 21456 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b2e4753478e42528d21875738d78b47 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4b2e4753478e42528d21875738d78b47. Latest consensus state: current_term: 1 leader_uuid: "4b2e4753478e42528d21875738d78b47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b2e4753478e42528d21875738d78b47" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41519 } } }
I20260808 04:40:33.082643 21455 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b2e4753478e42528d21875738d78b47 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4b2e4753478e42528d21875738d78b47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b2e4753478e42528d21875738d78b47" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41519 } } }
I20260808 04:40:33.082798 21455 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b2e4753478e42528d21875738d78b47 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:33.083017 21456 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b2e4753478e42528d21875738d78b47 [sys.catalog]: This master's current role is: LEADER
W20260808 04:40:33.086328 21475 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4b2e4753478e42528d21875738d78b47: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 04:40:33.086402 21475 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 04:40:33.086526 21465 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:40:33.087419 21465 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:40:33.092808 21465 catalog_manager.cc:1347] Generated new cluster ID: 8d82431188eb4f85b7ca19a7f0c7a4af
I20260808 04:40:33.092860 21465 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:40:33.101416 21465 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:40:33.102298 21465 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:40:33.112238 21465 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4b2e4753478e42528d21875738d78b47: Generated new TSK 0
I20260808 04:40:33.113039 21465 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.148.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab.
Entry for principal kudu/127.12.148.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab.
I20260808 04:40:33.146267 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.65:0
--local_ip_for_outbound_sockets=127.12.148.65
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:41519
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:43351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:33.253592 21485 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:33.253854 21485 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:33.253911 21485 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:33.257854 21485 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:33.257908 21485 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:33.257983 21485 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.65
I20260808 04:40:33.262990 21485 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:43351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:41519
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21485
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.65
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:33.263906 21485 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:33.264827 21485 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:33.273727 21492 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:33.273732 21498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:33.273896 21485 server_base.cc:1034] running on GCE node
W20260808 04:40:33.273734 21495 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:33.274401 21485 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:33.275022 21485 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:33.276194 21485 hybrid_clock.cc:648] HybridClock initialized: now 1786164033276179 us; error 25 us; skew 500 ppm
Aug 08 04:40:33 dist-test-slave-t7g5 krb5kdc[21328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164033, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:33.278942 21485 init.cc:377] Logged in from keytab as kudu/127.12.148.65@KRBTEST.COM (short username kudu)
I20260808 04:40:33.279793 21485 webserver.cc:460] Webserver started at http://127.12.148.65:32957/ using document root <none> and password file <none>
I20260808 04:40:33.280311 21485 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:33.280377 21485 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:33.280577 21485 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:33.282630 21485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-0/data/instance:
uuid: "89fd5f3802c24720a4953a0b5e75431c"
format_stamp: "Formatted at 2026-08-08 04:40:33 on dist-test-slave-t7g5"
server_key: "3282d107384a328c7f5edd57b493a98b"
server_key_iv: "3e4decaad241b4b088251c62517fd558"
server_key_version: "encryptionkey@0"
I20260808 04:40:33.283160 21485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance:
uuid: "89fd5f3802c24720a4953a0b5e75431c"
format_stamp: "Formatted at 2026-08-08 04:40:33 on dist-test-slave-t7g5"
server_key: "3282d107384a328c7f5edd57b493a98b"
server_key_iv: "3e4decaad241b4b088251c62517fd558"
server_key_version: "encryptionkey@0"
I20260808 04:40:33.286656 21485 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 04:40:33.288905 21508 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:33.290124 21485 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:40:33.290239 21485 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-0/wal
uuid: "89fd5f3802c24720a4953a0b5e75431c"
format_stamp: "Formatted at 2026-08-08 04:40:33 on dist-test-slave-t7g5"
server_key: "3282d107384a328c7f5edd57b493a98b"
server_key_iv: "3e4decaad241b4b088251c62517fd558"
server_key_version: "encryptionkey@0"
I20260808 04:40:33.290329 21485 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:33.302225 21485 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:33.305059 21485 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:33.305226 21485 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:33.305794 21485 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:33.306589 21485 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:33.306635 21485 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:33.306671 21485 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:33.306691 21485 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:33.314790 21485 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.65:44157
I20260808 04:40:33.314795 21698 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.65:44157 every 8 connection(s)
I20260808 04:40:33.315624 21485 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
I20260808 04:40:33.322216 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 21485
I20260808 04:40:33.322328 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance
I20260808 04:40:33.322602 12881 external_mini_cluster.cc:1428] Setting key 18a8fb2d126018a65574f77d9eb983a1
Aug 08 04:40:33 dist-test-slave-t7g5 krb5kdc[21328](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164033, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:40:33.329276 21452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:33.317436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:44467 (local address 127.12.148.126:41519)
0808 04:40:33.317592 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:33.317597 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:33.318438 (+ 841us) server_negotiation.cc:407] Connection header received
0808 04:40:33.319702 (+ 1264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:33.319705 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:33.319753 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:33.319857 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:33.320959 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:33.321499 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:33.322644 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:33.323003 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:33.323090 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:33.325560 (+ 2470us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:33.325564 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:33.325566 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:33.325594 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:33.327049 (+ 1455us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:33.327600 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:33.327602 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:33.327603 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:33.327676 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:33.328037 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:33.328039 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:33.328040 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:33.328209 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:33.328288 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:33.329034 (+ 746us) server_negotiation.cc:299] Negotiation successful
0808 04:40:33.329150 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 04:40:33.330318 21702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:33.317850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41519 (local address 127.12.148.65:44467)
0808 04:40:33.318292 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:33.318334 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:33.319502 (+ 1168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:33.320011 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:33.320018 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:33.320361 (+ 343us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:33.320822 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:33.320835 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:33.321587 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:33.321589 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:33.322530 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:33.322539 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:33.323169 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:33.323174 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:33.323329 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:33.323957 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:33.323977 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:33.325390 (+ 1413us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:33.327166 (+ 1776us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:33.327172 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:33.327186 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:33.327515 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:33.327774 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:33.327777 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:33.327779 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:33.327954 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:33.328308 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:33.328314 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:33.328731 (+ 417us) client_negotiation.cc:769] Sending connection context
0808 04:40:33.328959 (+ 228us) client_negotiation.cc:240] Negotiation successful
0808 04:40:33.329293 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":113,"threads_started":1}
I20260808 04:40:33.331513 21700 heartbeater.cc:347] Connected to a master server at 127.12.148.126:41519
I20260808 04:40:33.331765 21700 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:33.332317 21700 heartbeater.cc:511] Master 127.12.148.126:41519 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.12.148.66@KRBTEST.COM; defaulting to no policy
I20260808 04:40:33.334056 21393 ts_manager.cc:194] Registered new tserver with Master: 89fd5f3802c24720a4953a0b5e75431c (127.12.148.65:44157)
I20260808 04:40:33.335292 21393 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.65@KRBTEST.COM'} at 127.12.148.65:44467
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab.
Entry for principal kudu/127.12.148.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab.
I20260808 04:40:33.350266 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.66:0
--local_ip_for_outbound_sockets=127.12.148.66
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:41519
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:43351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:33.458801 21706 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:33.459070 21706 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:33.459113 21706 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:33.463074 21706 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:33.463140 21706 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:33.463201 21706 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.66
I20260808 04:40:33.468418 21706 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:43351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:41519
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21706
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.66
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:33.469481 21706 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:33.470672 21706 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:33.480324 21718 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:33.480366 21715 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:33.480317 21714 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:33.480551 21706 server_base.cc:1034] running on GCE node
I20260808 04:40:33.481012 21706 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:33.481688 21706 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:33.482856 21706 hybrid_clock.cc:648] HybridClock initialized: now 1786164033482839 us; error 34 us; skew 500 ppm
Aug 08 04:40:33 dist-test-slave-t7g5 krb5kdc[21328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164033, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:33.485471 21706 init.cc:377] Logged in from keytab as kudu/127.12.148.66@KRBTEST.COM (short username kudu)
I20260808 04:40:33.486311 21706 webserver.cc:460] Webserver started at http://127.12.148.66:38905/ using document root <none> and password file <none>
I20260808 04:40:33.486804 21706 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:33.486874 21706 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:33.487041 21706 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:33.488950 21706 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-1/data/instance:
uuid: "21edcd9e527a42f0be2e80c4d0d3772c"
format_stamp: "Formatted at 2026-08-08 04:40:33 on dist-test-slave-t7g5"
server_key: "cb3dcfc55c32b7747766505e95c5d101"
server_key_iv: "cfe935943a2ab28cf9dd2ac06e26f692"
server_key_version: "encryptionkey@0"
I20260808 04:40:33.489445 21706 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance:
uuid: "21edcd9e527a42f0be2e80c4d0d3772c"
format_stamp: "Formatted at 2026-08-08 04:40:33 on dist-test-slave-t7g5"
server_key: "cb3dcfc55c32b7747766505e95c5d101"
server_key_iv: "cfe935943a2ab28cf9dd2ac06e26f692"
server_key_version: "encryptionkey@0"
I20260808 04:40:33.492946 21706 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260808 04:40:33.495430 21729 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:33.496634 21706 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 04:40:33.496744 21706 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-1/wal
uuid: "21edcd9e527a42f0be2e80c4d0d3772c"
format_stamp: "Formatted at 2026-08-08 04:40:33 on dist-test-slave-t7g5"
server_key: "cb3dcfc55c32b7747766505e95c5d101"
server_key_iv: "cfe935943a2ab28cf9dd2ac06e26f692"
server_key_version: "encryptionkey@0"
I20260808 04:40:33.496850 21706 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:33.513214 21706 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:33.516099 21706 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:33.516273 21706 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:33.516847 21706 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:33.517645 21706 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:33.517733 21706 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:33.517804 21706 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:33.517838 21706 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:33.526010 21706 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.66:39791
I20260808 04:40:33.526074 21894 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.66:39791 every 8 connection(s)
I20260808 04:40:33.526887 21706 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
I20260808 04:40:33.535935 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 21706
I20260808 04:40:33.536073 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance
Aug 08 04:40:33 dist-test-slave-t7g5 krb5kdc[21328](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164033, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:40:33.536419 12881 external_mini_cluster.cc:1428] Setting key e117e5ef76189d5e5d4c7a74bfeffb2b
I20260808 04:40:33.540235 21452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:33.528703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:50335 (local address 127.12.148.126:41519)
0808 04:40:33.528835 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:33.528839 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:33.529680 (+ 841us) server_negotiation.cc:407] Connection header received
0808 04:40:33.531027 (+ 1347us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:33.531030 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:33.531087 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:33.531175 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:33.532336 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:33.532866 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:33.534044 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:33.534268 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:33.534358 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:33.536878 (+ 2520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:33.536882 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:33.536885 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:33.536910 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:33.538289 (+ 1379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:33.538769 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:33.538773 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:33.538774 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:33.538856 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:33.539179 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:33.539182 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:33.539184 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:33.539368 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:33.539463 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:33.539947 (+ 484us) server_negotiation.cc:299] Negotiation successful
0808 04:40:33.540072 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 04:40:33.541020 21902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:33.529057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41519 (local address 127.12.148.66:50335)
0808 04:40:33.529515 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:33.529558 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:33.530806 (+ 1248us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:33.531348 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:33.531355 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:33.531701 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:33.532195 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:33.532208 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:33.532989 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:33.532992 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:33.533920 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:33.533931 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:33.534410 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:33.534414 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:33.534582 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:33.535124 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:33.535141 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:33.536718 (+ 1577us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:33.538400 (+ 1682us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:33.538406 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:33.538421 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:33.538674 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:33.538947 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:33.538950 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:33.538953 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:33.539090 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:33.539469 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:33.539476 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:33.539717 (+ 241us) client_negotiation.cc:769] Sending connection context
0808 04:40:33.539883 (+ 166us) client_negotiation.cc:240] Negotiation successful
0808 04:40:33.540212 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":117,"threads_started":1}
I20260808 04:40:33.542196 21900 heartbeater.cc:347] Connected to a master server at 127.12.148.126:41519
I20260808 04:40:33.542423 21900 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:33.542896 21900 heartbeater.cc:511] Master 127.12.148.126:41519 requested a full tablet report, sending...
I20260808 04:40:33.543910 21393 ts_manager.cc:194] Registered new tserver with Master: 21edcd9e527a42f0be2e80c4d0d3772c (127.12.148.66:39791)
I20260808 04:40:33.544464 21393 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.66@KRBTEST.COM'} at 127.12.148.66:50335
WARNING: no policy specified for kudu/127.12.148.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab.
Entry for principal kudu/127.12.148.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab.
I20260808 04:40:33.562289 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.67:0
--local_ip_for_outbound_sockets=127.12.148.67
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:41519
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:43351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:33.672292 21905 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:33.672535 21905 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:33.672575 21905 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:33.676640 21905 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:33.676693 21905 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:33.676750 21905 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.67
I20260808 04:40:33.681924 21905 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:43351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:41519
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21905
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.67
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:33.682909 21905 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:33.683889 21905 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:33.693008 21911 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:33.693050 21910 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:33.693042 21905 server_base.cc:1034] running on GCE node
W20260808 04:40:33.693008 21913 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:33.693558 21905 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:33.694175 21905 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:33.695327 21905 hybrid_clock.cc:648] HybridClock initialized: now 1786164033695295 us; error 43 us; skew 500 ppm
Aug 08 04:40:33 dist-test-slave-t7g5 krb5kdc[21328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164033, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:33.697962 21905 init.cc:377] Logged in from keytab as kudu/127.12.148.67@KRBTEST.COM (short username kudu)
I20260808 04:40:33.698792 21905 webserver.cc:460] Webserver started at http://127.12.148.67:38951/ using document root <none> and password file <none>
I20260808 04:40:33.699301 21905 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:33.699366 21905 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:33.699576 21905 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:33.701568 21905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-2/data/instance:
uuid: "7e7a5eb4fad8473a89f8048cbc9c273a"
format_stamp: "Formatted at 2026-08-08 04:40:33 on dist-test-slave-t7g5"
server_key: "fa678fce11534afd1b89030bda0c37cc"
server_key_iv: "0f183577fe18f31e5fafa396560f2c3b"
server_key_version: "encryptionkey@0"
I20260808 04:40:33.702134 21905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance:
uuid: "7e7a5eb4fad8473a89f8048cbc9c273a"
format_stamp: "Formatted at 2026-08-08 04:40:33 on dist-test-slave-t7g5"
server_key: "fa678fce11534afd1b89030bda0c37cc"
server_key_iv: "0f183577fe18f31e5fafa396560f2c3b"
server_key_version: "encryptionkey@0"
I20260808 04:40:33.705627 21905 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:40:33.708001 21923 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:33.709136 21905 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:40:33.709245 21905 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-2/wal
uuid: "7e7a5eb4fad8473a89f8048cbc9c273a"
format_stamp: "Formatted at 2026-08-08 04:40:33 on dist-test-slave-t7g5"
server_key: "fa678fce11534afd1b89030bda0c37cc"
server_key_iv: "0f183577fe18f31e5fafa396560f2c3b"
server_key_version: "encryptionkey@0"
I20260808 04:40:33.709336 21905 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:33.729141 21905 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:33.731906 21905 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:33.732080 21905 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:33.732643 21905 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:33.733469 21905 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:33.733526 21905 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:33.733580 21905 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:33.733610 21905 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:33.741768 21905 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.67:43677
I20260808 04:40:33.741796 22093 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.67:43677 every 8 connection(s)
I20260808 04:40:33.742620 21905 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
I20260808 04:40:33.748445 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 21905
I20260808 04:40:33.748550 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance
I20260808 04:40:33.748827 12881 external_mini_cluster.cc:1428] Setting key d04da5e43b7960d731a32921f0261de6
Aug 08 04:40:33 dist-test-slave-t7g5 krb5kdc[21328](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164033, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:40:33.755904 21452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:33.744330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:47599 (local address 127.12.148.126:41519)
0808 04:40:33.744464 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:33.744467 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:33.745291 (+ 824us) server_negotiation.cc:407] Connection header received
0808 04:40:33.746650 (+ 1359us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:33.746653 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:33.746710 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:33.746785 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:33.747938 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:33.748464 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:33.749948 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:33.750235 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:33.750323 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:33.752764 (+ 2441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:33.752767 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:33.752769 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:33.752793 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:33.753978 (+ 1185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:33.754457 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:33.754459 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:33.754461 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:33.754537 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:33.754855 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:33.754859 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:33.754860 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:33.755031 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:33.755117 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:33.755612 (+ 495us) server_negotiation.cc:299] Negotiation successful
0808 04:40:33.755734 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 04:40:33.756618 22099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:33.744683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41519 (local address 127.12.148.67:47599)
0808 04:40:33.745150 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:33.745192 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:33.746444 (+ 1252us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:33.746979 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:33.746986 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:33.747328 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:33.747795 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:33.747808 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:33.748588 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:33.748592 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:33.749623 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:33.749636 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:33.750383 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:33.750388 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:33.750602 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:33.751162 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:33.751178 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:33.752610 (+ 1432us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:33.754082 (+ 1472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:33.754088 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:33.754102 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:33.754361 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:33.754622 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:33.754625 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:33.754627 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:33.754759 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:33.755132 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:33.755138 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:33.755377 (+ 239us) client_negotiation.cc:769] Sending connection context
0808 04:40:33.755552 (+ 175us) client_negotiation.cc:240] Negotiation successful
0808 04:40:33.755854 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":129,"threads_started":1}
I20260808 04:40:33.757616 22095 heartbeater.cc:347] Connected to a master server at 127.12.148.126:41519
I20260808 04:40:33.757855 22095 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:33.758302 22095 heartbeater.cc:511] Master 127.12.148.126:41519 requested a full tablet report, sending...
I20260808 04:40:33.759244 21393 ts_manager.cc:194] Registered new tserver with Master: 7e7a5eb4fad8473a89f8048cbc9c273a (127.12.148.67:43677)
I20260808 04:40:33.759783 21393 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.67@KRBTEST.COM'} at 127.12.148.67:47599
I20260808 04:40:33.762475 12881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/krb5kdc/test-admin.keytab.
Aug 08 04:40:33 dist-test-slave-t7g5 krb5kdc[21328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:33.778033 12881 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260808 04:40:33.780593 22107 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:33.779226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46922 (local address 127.12.148.65:44157)
0808 04:40:33.779610 (+ 384us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:33.779619 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:33.779640 (+ 21us) server_negotiation.cc:407] Connection header received
0808 04:40:33.779685 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:33.779690 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:33.779866 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:33.779977 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:33.780461 (+ 484us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46922: BlockingRecv error: recv got EOF from 127.0.0.1:46922 (error 108)
Metrics: {"server-negotiator.queue_time_us":284,"thread_start_us":181,"threads_started":1}
W20260808 04:40:33.780736 12881 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/krb5kdc/krb5cc' of type FILE
Aug 08 04:40:33 dist-test-slave-t7g5 krb5kdc[21328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:33.781682 12881 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 04:40:33 dist-test-slave-t7g5 krb5kdc[21328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:33.782578 12881 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 04:40:33 dist-test-slave-t7g5 krb5kdc[21328](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.148.65@KRBTEST.COM
I20260808 04:40:33.791584 22107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:33.783383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46932 (local address 127.12.148.65:44157)
0808 04:40:33.783501 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:33.783505 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:33.783592 (+ 87us) server_negotiation.cc:407] Connection header received
0808 04:40:33.783679 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:33.783682 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:33.783723 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:33.783785 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:33.784315 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:33.785065 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:33.785923 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:33.786274 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:33.786366 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:33.788475 (+ 2109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:33.788485 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:33.788496 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:33.788522 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:33.789893 (+ 1371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:33.790297 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:33.790302 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:33.790303 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:33.790384 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:33.790633 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:33.790636 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:33.790638 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:33.790889 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:33.791090 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:33.791297 (+ 207us) server_negotiation.cc:299] Negotiation successful
0808 04:40:33.791458 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
W20260808 04:40:33.795116 22107 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:33.794213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46944 (local address 127.12.148.65:44157)
0808 04:40:33.794353 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:33.794357 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:33.794390 (+ 33us) server_negotiation.cc:407] Connection header received
0808 04:40:33.794541 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:33.794544 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:33.794581 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:33.794637 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:33.795022 (+ 385us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46944: BlockingRecv error: recv got EOF from 127.0.0.1:46944 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260808 04:40:33.795184 12881 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/krb5kdc/krb5cc' of type FILE
Aug 08 04:40:33 dist-test-slave-t7g5 krb5kdc[21328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:33.796130 12881 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 04:40:33 dist-test-slave-t7g5 krb5kdc[21328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:33.796931 12881 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 04:40:33 dist-test-slave-t7g5 krb5kdc[21328](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.148.65@KRBTEST.COM
I20260808 04:40:33.804541 22107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:33.797683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46946 (local address 127.12.148.65:44157)
0808 04:40:33.797797 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:33.797800 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:33.797860 (+ 60us) server_negotiation.cc:407] Connection header received
0808 04:40:33.797956 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:33.797958 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:33.797991 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:33.798043 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:33.798495 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:33.799001 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:33.799773 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:33.800001 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:33.800074 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:33.802059 (+ 1985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:33.802062 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:33.802064 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:33.802084 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:33.803279 (+ 1195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:33.803673 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:33.803675 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:33.803676 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:33.803739 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:33.803924 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:33.803926 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:33.803927 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:33.804063 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:33.804151 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:33.804297 (+ 146us) server_negotiation.cc:299] Negotiation successful
0808 04:40:33.804395 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
W20260808 04:40:33.806818 22107 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:33.806078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46952 (local address 127.12.148.65:44157)
0808 04:40:33.806200 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:33.806204 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:33.806278 (+ 74us) server_negotiation.cc:407] Connection header received
0808 04:40:33.806359 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:33.806361 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:33.806392 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:33.806448 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:33.806731 (+ 283us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46952: BlockingRecv error: recv got EOF from 127.0.0.1:46952 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260808 04:40:33.806948 12881 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786164004017495-12881-0/krb5kdc/krb5cc' of type FILE
Aug 08 04:40:33 dist-test-slave-t7g5 krb5kdc[21328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:33.807829 12881 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 04:40:33 dist-test-slave-t7g5 krb5kdc[21328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:33.808609 12881 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 04:40:33 dist-test-slave-t7g5 krb5kdc[21328](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.148.65@KRBTEST.COM
I20260808 04:40:33.817440 22107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:33.809343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46954 (local address 127.12.148.65:44157)
0808 04:40:33.809455 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:33.809458 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:33.809500 (+ 42us) server_negotiation.cc:407] Connection header received
0808 04:40:33.809579 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:33.809581 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:33.809611 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:33.809714 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:33.810212 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:33.810686 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:33.811562 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:33.811756 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:33.811818 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:33.814381 (+ 2563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:33.814384 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:33.814386 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:33.814407 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:33.815677 (+ 1270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:33.816165 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:33.816169 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:33.816171 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:33.816287 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:33.816577 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:33.816580 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:33.816582 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:33.816781 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:33.816901 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:33.817155 (+ 254us) server_negotiation.cc:299] Negotiation successful
0808 04:40:33.817271 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 04:40:33.821867 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 21485
I20260808 04:40:33.834224 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 21706
I20260808 04:40:33.844050 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 21905
I20260808 04:40:33.854324 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 21346
2026-08-08T04:40:33Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2222 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:40:33 dist-test-slave-t7g5 krb5kdc[22121](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:40:33 dist-test-slave-t7g5 krb5kdc[22121](info): set up 2 sockets
Aug 08 04:40:33 dist-test-slave-t7g5 krb5kdc[22121](info): commencing operation
krb5kdc: starting...
W20260808 04:40:34.986137 12881 mini_kdc.cc:121] Time spent starting KDC: real 1.107s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Aug 08 04:40:35 dist-test-slave-t7g5 krb5kdc[22121](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164035, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:40:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:40:35Z Disabled control of system clock
WARNING: no policy specified for oryx/127.12.148.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.148.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.148.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.126.keytab.
Entry for principal oryx/127.12.148.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.126.keytab.
I20260808 04:40:35.110452 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:41335
--webserver_interface=127.12.148.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.126.keytab
--principal=oryx/127.12.148.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:38949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:41335
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:35.219206 22139 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:35.219463 22139 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:35.219501 22139 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:35.223362 22139 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:40:35.223412 22139 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:35.223428 22139 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:35.223443 22139 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:40:35.223457 22139 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:40:35.228559 22139 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:38949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:41335
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.126.keytab
--principal=oryx/127.12.148.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:41335
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22139
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:35.229468 22139 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:35.230400 22139 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 04:40:35.238543 22139 server_base.cc:1034] running on GCE node
W20260808 04:40:35.238492 22147 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:35.238504 22146 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:35.238464 22150 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:35.239317 22139 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:35.240388 22139 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:35.241578 22139 hybrid_clock.cc:648] HybridClock initialized: now 1786164035241558 us; error 31 us; skew 500 ppm
Aug 08 04:40:35 dist-test-slave-t7g5 krb5kdc[22121](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164035, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.148.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:35.244297 22139 init.cc:377] Logged in from keytab as oryx/127.12.148.126@KRBTEST.COM (short username oryx)
I20260808 04:40:35.245184 22139 webserver.cc:460] Webserver started at http://127.12.148.126:44777/ using document root <none> and password file <none>
I20260808 04:40:35.245760 22139 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:35.245836 22139 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:35.246039 22139 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:35.248035 22139 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "218c9b6c6aa34ef291292aab18539744"
format_stamp: "Formatted at 2026-08-08 04:40:35 on dist-test-slave-t7g5"
server_key: "1b4f0e3d593aa0700b930750e0a902c9"
server_key_iv: "876083236b8e0e78bcc4300c728463f6"
server_key_version: "encryptionkey@0"
I20260808 04:40:35.248585 22139 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "218c9b6c6aa34ef291292aab18539744"
format_stamp: "Formatted at 2026-08-08 04:40:35 on dist-test-slave-t7g5"
server_key: "1b4f0e3d593aa0700b930750e0a902c9"
server_key_iv: "876083236b8e0e78bcc4300c728463f6"
server_key_version: "encryptionkey@0"
I20260808 04:40:35.252270 22139 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260808 04:40:35.254658 22158 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:35.255832 22139 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:40:35.255949 22139 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "218c9b6c6aa34ef291292aab18539744"
format_stamp: "Formatted at 2026-08-08 04:40:35 on dist-test-slave-t7g5"
server_key: "1b4f0e3d593aa0700b930750e0a902c9"
server_key_iv: "876083236b8e0e78bcc4300c728463f6"
server_key_version: "encryptionkey@0"
I20260808 04:40:35.256043 22139 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:35.269333 22139 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:35.272352 22139 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:35.272548 22139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:35.279731 22139 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:41335
I20260808 04:40:35.280009 22233 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:41335 every 8 connection(s)
I20260808 04:40:35.280714 22139 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:40:35.283371 22234 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:35.286214 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 22139
I20260808 04:40:35.286362 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:40:35.286628 12881 external_mini_cluster.cc:1428] Setting key 3165241773108a5a21b92d7aca8328e3
I20260808 04:40:35.289129 22234 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744: Bootstrap starting.
I20260808 04:40:35.291751 22234 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:35.292591 22234 log.cc:824] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:35.294747 22234 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744: No bootstrap required, opened a new log
Aug 08 04:40:35 dist-test-slave-t7g5 krb5kdc[22121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164035, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM
I20260808 04:40:35.298770 22234 raft_consensus.cc:348] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } }
I20260808 04:40:35.299033 22234 raft_consensus.cc:374] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:35.299141 22234 raft_consensus.cc:729] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218c9b6c6aa34ef291292aab18539744, State: Initialized, Role: FOLLOWER
I20260808 04:40:35.299589 22234 consensus_queue.cc:260] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } }
I20260808 04:40:35.299712 22234 raft_consensus.cc:388] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:40:35.299752 22234 raft_consensus.cc:482] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:40:35.299844 22234 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:35.300642 22234 raft_consensus.cc:504] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } }
I20260808 04:40:35.300987 22234 leader_election.cc:302] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 218c9b6c6aa34ef291292aab18539744; no voters:
I20260808 04:40:35.301285 22234 leader_election.cc:288] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:40:35.301350 22244 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:35.301555 22244 raft_consensus.cc:686] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [term 1 LEADER]: Becoming Leader. State: Replica: 218c9b6c6aa34ef291292aab18539744, State: Running, Role: LEADER
I20260808 04:40:35.301925 22244 consensus_queue.cc:237] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } }
I20260808 04:40:35.302042 22242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:35.288066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58158 (local address 127.12.148.126:41335)
0808 04:40:35.288484 (+ 418us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:35.288502 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:35.288542 (+ 40us) server_negotiation.cc:407] Connection header received
0808 04:40:35.289348 (+ 806us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:35.289372 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:35.289805 (+ 433us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:35.290155 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:35.290922 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.292373 (+ 1451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.293439 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.294140 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.294290 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:35.297031 (+ 2741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:35.297038 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:35.297055 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:35.297088 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:35.298984 (+ 1896us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.299454 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.299459 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.299463 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.299582 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.299870 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.299873 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.299875 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.300275 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:35.300462 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:35.300756 (+ 294us) server_negotiation.cc:299] Negotiation successful
0808 04:40:35.301021 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":276,"thread_start_us":112,"threads_started":1}
I20260808 04:40:35.302542 22234 sys_catalog.cc:564] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:40:35.304821 22246 sys_catalog.cc:455] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "218c9b6c6aa34ef291292aab18539744" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } }
I20260808 04:40:35.304622 22245 sys_catalog.cc:455] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 218c9b6c6aa34ef291292aab18539744. Latest consensus state: current_term: 1 leader_uuid: "218c9b6c6aa34ef291292aab18539744" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } }
I20260808 04:40:35.304910 22246 sys_catalog.cc:458] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:35.304911 22245 sys_catalog.cc:458] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [sys.catalog]: This master's current role is: LEADER
W20260808 04:40:35.307322 22264 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 04:40:35.307399 22264 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 04:40:35.307463 22268 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:40:35.308151 22268 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:40:35.312740 22268 catalog_manager.cc:1347] Generated new cluster ID: 3f5f41c2104c4ce39c1596eb686339ce
I20260808 04:40:35.312809 22268 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:40:35.320520 22268 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:40:35.321452 22268 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:40:35.331744 22268 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744: Generated new TSK 0
I20260808 04:40:35.332352 22268 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.12.148.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.148.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.148.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.65.keytab.
Entry for principal oryx/127.12.148.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.65.keytab.
I20260808 04:40:35.362900 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.65:0
--local_ip_for_outbound_sockets=127.12.148.65
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:41335
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.65.keytab
--principal=oryx/127.12.148.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:38949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:35.474131 22275 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:35.474395 22275 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:35.474437 22275 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:35.478473 22275 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:35.478533 22275 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:35.478605 22275 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.65
I20260808 04:40:35.483805 22275 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:38949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.65.keytab
--principal=oryx/127.12.148.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:41335
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22275
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.65
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:35.484819 22275 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:35.485870 22275 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:35.495155 22284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:35.495188 22282 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:35.495198 22281 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:35.495342 22275 server_base.cc:1034] running on GCE node
I20260808 04:40:35.495924 22275 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:35.496562 22275 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:35.497721 22275 hybrid_clock.cc:648] HybridClock initialized: now 1786164035497702 us; error 30 us; skew 500 ppm
Aug 08 04:40:35 dist-test-slave-t7g5 krb5kdc[22121](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164035, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.148.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:35.500468 22275 init.cc:377] Logged in from keytab as oryx/127.12.148.65@KRBTEST.COM (short username oryx)
I20260808 04:40:35.501313 22275 webserver.cc:460] Webserver started at http://127.12.148.65:43941/ using document root <none> and password file <none>
I20260808 04:40:35.501937 22275 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:35.502033 22275 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:35.502238 22275 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:35.504415 22275 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-0/data/instance:
uuid: "6867e539dee64800a41f50fc525ffba2"
format_stamp: "Formatted at 2026-08-08 04:40:35 on dist-test-slave-t7g5"
server_key: "c95fadefa30a51f3aa738ccdfe88a05d"
server_key_iv: "c74a98980ec9bede539762ef1943d743"
server_key_version: "encryptionkey@0"
I20260808 04:40:35.504972 22275 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance:
uuid: "6867e539dee64800a41f50fc525ffba2"
format_stamp: "Formatted at 2026-08-08 04:40:35 on dist-test-slave-t7g5"
server_key: "c95fadefa30a51f3aa738ccdfe88a05d"
server_key_iv: "c74a98980ec9bede539762ef1943d743"
server_key_version: "encryptionkey@0"
I20260808 04:40:35.508658 22275 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 04:40:35.511237 22293 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:35.512439 22275 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 04:40:35.512553 22275 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-0/wal
uuid: "6867e539dee64800a41f50fc525ffba2"
format_stamp: "Formatted at 2026-08-08 04:40:35 on dist-test-slave-t7g5"
server_key: "c95fadefa30a51f3aa738ccdfe88a05d"
server_key_iv: "c74a98980ec9bede539762ef1943d743"
server_key_version: "encryptionkey@0"
I20260808 04:40:35.512651 22275 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:35.521607 22275 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:35.524255 22275 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:35.524431 22275 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:35.524988 22275 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:35.525820 22275 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:35.525877 22275 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:35.525931 22275 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:35.525960 22275 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:35.534191 22275 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.65:40203
I20260808 04:40:35.534215 22460 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.65:40203 every 8 connection(s)
I20260808 04:40:35.535045 22275 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
I20260808 04:40:35.539919 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 22275
I20260808 04:40:35.540058 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance
I20260808 04:40:35.540380 12881 external_mini_cluster.cc:1428] Setting key e37587c589207bd98059a6e7d4a28a77
Aug 08 04:40:35 dist-test-slave-t7g5 krb5kdc[22121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164035, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.148.65@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM
I20260808 04:40:35.549018 22242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:35.536796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:48719 (local address 127.12.148.126:41335)
0808 04:40:35.536977 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:35.536981 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:35.537776 (+ 795us) server_negotiation.cc:407] Connection header received
0808 04:40:35.539134 (+ 1358us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:35.539137 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:35.539195 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:35.539268 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:35.540741 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.541285 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.542635 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.542950 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.543054 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:35.545611 (+ 2557us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:35.545614 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:35.545616 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:35.545640 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:35.546993 (+ 1353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.547479 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.547483 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.547484 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.547561 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.547885 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.547888 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.547890 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.548069 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:35.548156 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:35.548715 (+ 559us) server_negotiation.cc:299] Negotiation successful
0808 04:40:35.548857 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260808 04:40:35.549830 22466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:35.537164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.12.148.65:48719)
0808 04:40:35.537612 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:35.537683 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:35.538922 (+ 1239us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:35.539456 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:35.539464 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:35.539945 (+ 481us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:35.540576 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:35.540594 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.541414 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.541417 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:35.542504 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:35.542515 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.543084 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.543087 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:35.543226 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:35.543804 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:35.543820 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:35.545455 (+ 1635us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:35.547098 (+ 1643us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:35.547104 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:35.547120 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:35.547385 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:35.547643 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:35.547647 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:35.547649 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:35.547798 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:35.548168 (+ 370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:35.548175 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:35.548426 (+ 251us) client_negotiation.cc:769] Sending connection context
0808 04:40:35.548671 (+ 245us) client_negotiation.cc:240] Negotiation successful
0808 04:40:35.548991 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":118,"threads_started":1}
WARNING: no policy specified for oryx/127.12.148.66@KRBTEST.COM; defaulting to no policy
I20260808 04:40:35.550998 22464 heartbeater.cc:347] Connected to a master server at 127.12.148.126:41335
I20260808 04:40:35.551327 22464 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:35.551805 22464 heartbeater.cc:511] Master 127.12.148.126:41335 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.148.66@KRBTEST.COM" created.
I20260808 04:40:35.553424 22182 ts_manager.cc:194] Registered new tserver with Master: 6867e539dee64800a41f50fc525ffba2 (127.12.148.65:40203)
I20260808 04:40:35.554575 22182 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.148.65@KRBTEST.COM'} at 127.12.148.65:48719
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.148.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.66.keytab.
Entry for principal oryx/127.12.148.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.66.keytab.
I20260808 04:40:35.568281 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.66:0
--local_ip_for_outbound_sockets=127.12.148.66
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:41335
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.66.keytab
--principal=oryx/127.12.148.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:38949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:35.677745 22469 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:35.678002 22469 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:35.678041 22469 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:35.682034 22469 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:35.682087 22469 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:35.682150 22469 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.66
I20260808 04:40:35.687119 22469 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:38949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.66.keytab
--principal=oryx/127.12.148.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:41335
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22469
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.66
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:35.688042 22469 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:35.689002 22469 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:35.697932 22476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:35.697925 22475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:35.698117 22469 server_base.cc:1034] running on GCE node
W20260808 04:40:35.698283 22478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:35.698634 22469 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:35.699224 22469 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:35.700382 22469 hybrid_clock.cc:648] HybridClock initialized: now 1786164035700364 us; error 30 us; skew 500 ppm
Aug 08 04:40:35 dist-test-slave-t7g5 krb5kdc[22121](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164035, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.148.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:35.703051 22469 init.cc:377] Logged in from keytab as oryx/127.12.148.66@KRBTEST.COM (short username oryx)
I20260808 04:40:35.703891 22469 webserver.cc:460] Webserver started at http://127.12.148.66:46673/ using document root <none> and password file <none>
I20260808 04:40:35.704391 22469 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:35.704466 22469 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:35.704664 22469 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:35.706598 22469 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-1/data/instance:
uuid: "dedcf4f874fd4a5a91d5ba4d784c2af0"
format_stamp: "Formatted at 2026-08-08 04:40:35 on dist-test-slave-t7g5"
server_key: "fa3d55b658264da116a16c2b33c93412"
server_key_iv: "648e6386c81dd4f27c54d6716f684679"
server_key_version: "encryptionkey@0"
I20260808 04:40:35.707103 22469 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance:
uuid: "dedcf4f874fd4a5a91d5ba4d784c2af0"
format_stamp: "Formatted at 2026-08-08 04:40:35 on dist-test-slave-t7g5"
server_key: "fa3d55b658264da116a16c2b33c93412"
server_key_iv: "648e6386c81dd4f27c54d6716f684679"
server_key_version: "encryptionkey@0"
I20260808 04:40:35.710608 22469 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 04:40:35.712895 22487 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:35.714089 22469 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:40:35.714187 22469 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-1/wal
uuid: "dedcf4f874fd4a5a91d5ba4d784c2af0"
format_stamp: "Formatted at 2026-08-08 04:40:35 on dist-test-slave-t7g5"
server_key: "fa3d55b658264da116a16c2b33c93412"
server_key_iv: "648e6386c81dd4f27c54d6716f684679"
server_key_version: "encryptionkey@0"
I20260808 04:40:35.714286 22469 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:35.730794 22469 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:35.733827 22469 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:35.734004 22469 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:35.734550 22469 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:35.735337 22469 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:35.735384 22469 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:35.735428 22469 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:35.735469 22469 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:35.743573 22469 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.66:46085
I20260808 04:40:35.743688 22657 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.66:46085 every 8 connection(s)
I20260808 04:40:35.744452 22469 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
Aug 08 04:40:35 dist-test-slave-t7g5 krb5kdc[22121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164035, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.148.66@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM
I20260808 04:40:35.753986 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 22469
I20260808 04:40:35.754098 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance
I20260808 04:40:35.754421 12881 external_mini_cluster.cc:1428] Setting key d0177f9c720c678b3c8b460119e31e38
I20260808 04:40:35.757442 22242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:35.746189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:52985 (local address 127.12.148.126:41335)
0808 04:40:35.746367 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:35.746372 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:35.747157 (+ 785us) server_negotiation.cc:407] Connection header received
0808 04:40:35.748419 (+ 1262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:35.748422 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:35.748467 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:35.748536 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:35.749625 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.750178 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.751232 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.751445 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.751513 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:35.753816 (+ 2303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:35.753819 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:35.753822 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:35.753857 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:35.755390 (+ 1533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.755995 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.755999 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.756001 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.756097 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.756403 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.756406 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.756408 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.756631 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:35.756725 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:35.757169 (+ 444us) server_negotiation.cc:299] Negotiation successful
0808 04:40:35.757290 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 04:40:35.758257 22660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:35.746562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.12.148.66:52985)
0808 04:40:35.747004 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:35.747046 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:35.748229 (+ 1183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:35.748687 (+ 458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:35.748693 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:35.749047 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:35.749509 (+ 462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:35.749523 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.750280 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.750282 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:35.751137 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:35.751146 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.751549 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.751552 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:35.751691 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:35.752218 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:35.752234 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:35.753604 (+ 1370us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:35.755510 (+ 1906us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:35.755516 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:35.755531 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:35.755894 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:35.756186 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:35.756188 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:35.756189 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:35.756319 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:35.756722 (+ 403us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:35.756727 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:35.756958 (+ 231us) client_negotiation.cc:769] Sending connection context
0808 04:40:35.757101 (+ 143us) client_negotiation.cc:240] Negotiation successful
0808 04:40:35.757333 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":112,"threads_started":1}
I20260808 04:40:35.759294 22658 heartbeater.cc:347] Connected to a master server at 127.12.148.126:41335
I20260808 04:40:35.759521 22658 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:35.760000 22658 heartbeater.cc:511] Master 127.12.148.126:41335 requested a full tablet report, sending...
I20260808 04:40:35.760978 22182 ts_manager.cc:194] Registered new tserver with Master: dedcf4f874fd4a5a91d5ba4d784c2af0 (127.12.148.66:46085)
I20260808 04:40:35.761545 22182 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.148.66@KRBTEST.COM'} at 127.12.148.66:52985
WARNING: no policy specified for oryx/127.12.148.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.148.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.148.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.67.keytab.
Entry for principal oryx/127.12.148.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.67.keytab.
I20260808 04:40:35.782698 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.67:0
--local_ip_for_outbound_sockets=127.12.148.67
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:41335
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.67.keytab
--principal=oryx/127.12.148.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:38949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:35.891531 22663 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:35.891770 22663 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:35.891809 22663 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:35.895747 22663 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:35.895803 22663 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:35.895857 22663 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.67
I20260808 04:40:35.900856 22663 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:38949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.67.keytab
--principal=oryx/127.12.148.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:41335
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22663
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.67
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:35.901793 22663 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:35.902750 22663 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:35.911813 22671 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:35.911850 22674 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:35.911825 22672 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:35.912218 22663 server_base.cc:1034] running on GCE node
I20260808 04:40:35.912580 22663 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:35.913118 22663 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:35.914273 22663 hybrid_clock.cc:648] HybridClock initialized: now 1786164035914251 us; error 35 us; skew 500 ppm
Aug 08 04:40:35 dist-test-slave-t7g5 krb5kdc[22121](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164035, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.148.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:35.917037 22663 init.cc:377] Logged in from keytab as oryx/127.12.148.67@KRBTEST.COM (short username oryx)
I20260808 04:40:35.917928 22663 webserver.cc:460] Webserver started at http://127.12.148.67:41113/ using document root <none> and password file <none>
I20260808 04:40:35.918469 22663 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:35.918536 22663 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:35.918720 22663 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:35.920615 22663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-2/data/instance:
uuid: "48c5ece7716c44a4bf4e1491ec34eedd"
format_stamp: "Formatted at 2026-08-08 04:40:35 on dist-test-slave-t7g5"
server_key: "a23bd74b627e0f7e9f908db567749abb"
server_key_iv: "ba6ae2ac72c40b5c0c30b976377c71c6"
server_key_version: "encryptionkey@0"
I20260808 04:40:35.921150 22663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance:
uuid: "48c5ece7716c44a4bf4e1491ec34eedd"
format_stamp: "Formatted at 2026-08-08 04:40:35 on dist-test-slave-t7g5"
server_key: "a23bd74b627e0f7e9f908db567749abb"
server_key_iv: "ba6ae2ac72c40b5c0c30b976377c71c6"
server_key_version: "encryptionkey@0"
I20260808 04:40:35.924700 22663 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 04:40:35.927079 22684 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:35.928284 22663 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 04:40:35.928393 22663 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-2/wal
uuid: "48c5ece7716c44a4bf4e1491ec34eedd"
format_stamp: "Formatted at 2026-08-08 04:40:35 on dist-test-slave-t7g5"
server_key: "a23bd74b627e0f7e9f908db567749abb"
server_key_iv: "ba6ae2ac72c40b5c0c30b976377c71c6"
server_key_version: "encryptionkey@0"
I20260808 04:40:35.928496 22663 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:35.941762 22663 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:35.944384 22663 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:35.944553 22663 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:35.945075 22663 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:35.945878 22663 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:35.945930 22663 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:35.945981 22663 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:35.946009 22663 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:35.954382 22663 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.67:37211
I20260808 04:40:35.954416 22855 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.67:37211 every 8 connection(s)
I20260808 04:40:35.955219 22663 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
I20260808 04:40:35.958459 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 22663
I20260808 04:40:35.958565 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance
I20260808 04:40:35.958818 12881 external_mini_cluster.cc:1428] Setting key 8811fd6148542554b5baa79f4d5eb091
Aug 08 04:40:35 dist-test-slave-t7g5 krb5kdc[22121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164035, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.148.67@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM
I20260808 04:40:35.968129 22242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:35.956968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:44197 (local address 127.12.148.126:41335)
0808 04:40:35.957099 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:35.957102 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:35.957914 (+ 812us) server_negotiation.cc:407] Connection header received
0808 04:40:35.959362 (+ 1448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:35.959365 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:35.959418 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:35.959492 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:35.960846 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.961378 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.962553 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.962780 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.962868 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:35.965118 (+ 2250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:35.965121 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:35.965123 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:35.965145 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:35.966262 (+ 1117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.966721 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.966724 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.966725 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.966803 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:35.967118 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:35.967122 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:35.967123 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:35.967300 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:35.967385 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:35.967853 (+ 468us) server_negotiation.cc:299] Negotiation successful
0808 04:40:35.967971 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 04:40:35.968856 22859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:35.957301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.12.148.67:44197)
0808 04:40:35.957768 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:35.957811 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:35.959144 (+ 1333us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:35.959674 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:35.959681 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:35.960081 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:35.960722 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:35.960742 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.961497 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.961500 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:35.962436 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:35.962447 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:35.962916 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:35.962920 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:35.963100 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:35.963586 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:35.963602 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:35.964970 (+ 1368us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:35.966366 (+ 1396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:35.966372 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:35.966385 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:35.966626 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:35.966884 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:35.966887 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:35.966889 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:35.967032 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:35.967401 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:35.967408 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:35.967631 (+ 223us) client_negotiation.cc:769] Sending connection context
0808 04:40:35.967793 (+ 162us) client_negotiation.cc:240] Negotiation successful
0808 04:40:35.968103 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":105,"threads_started":1}
I20260808 04:40:35.969866 22856 heartbeater.cc:347] Connected to a master server at 127.12.148.126:41335
I20260808 04:40:35.970082 22856 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:35.970521 22856 heartbeater.cc:511] Master 127.12.148.126:41335 requested a full tablet report, sending...
I20260808 04:40:35.971481 22182 ts_manager.cc:194] Registered new tserver with Master: 48c5ece7716c44a4bf4e1491ec34eedd (127.12.148.67:37211)
I20260808 04:40:35.972108 22182 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.148.67@KRBTEST.COM'} at 127.12.148.67:44197
I20260808 04:40:35.972604 12881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.12.148.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.148.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.148.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.125.keytab.
Entry for principal oryx/127.12.148.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.125.keytab.
I20260808 04:40:36.000361 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.125:41193
--webserver_interface=127.12.148.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.125.keytab
--principal=oryx/127.12.148.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:38949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:41335,127.12.148.125:41193
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:36.110014 22865 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:36.110268 22865 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:36.110316 22865 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:36.114360 22865 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:40:36.114421 22865 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:36.114454 22865 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:36.114482 22865 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:40:36.114511 22865 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:40:36.119819 22865 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:38949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:41335,127.12.148.125:41193
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.125.keytab
--principal=oryx/127.12.148.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.125:41193
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.148.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22865
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
W20260808 04:40:36.120030 22865 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.12.148.126:41335,127.12.148.125:41193'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260808 04:40:36.120858 22865 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:36.121876 22865 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 04:40:36.130052 22865 server_base.cc:1034] running on GCE node
W20260808 04:40:36.130064 22871 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:36.130097 22874 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:36.129999 22876 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:36.130795 22865 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:36.131839 22865 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:36.132998 22865 hybrid_clock.cc:648] HybridClock initialized: now 1786164036132976 us; error 34 us; skew 500 ppm
Aug 08 04:40:36 dist-test-slave-t7g5 krb5kdc[22121](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164036, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.148.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:36.135622 22865 init.cc:377] Logged in from keytab as oryx/127.12.148.125@KRBTEST.COM (short username oryx)
I20260808 04:40:36.136468 22865 webserver.cc:460] Webserver started at http://127.12.148.125:37117/ using document root <none> and password file <none>
I20260808 04:40:36.136976 22865 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:36.137043 22865 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:36.137228 22865 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:36.139195 22865 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-1/data/instance:
uuid: "5840bba663a9429c8faecf68a8c2c955"
format_stamp: "Formatted at 2026-08-08 04:40:36 on dist-test-slave-t7g5"
server_key: "bcf0d4dc2f51c0db50c0fbd79aa25f37"
server_key_iv: "7799cfa04e5f5403fca39878091a8ae3"
server_key_version: "encryptionkey@0"
I20260808 04:40:36.139725 22865 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-1/wal/instance:
uuid: "5840bba663a9429c8faecf68a8c2c955"
format_stamp: "Formatted at 2026-08-08 04:40:36 on dist-test-slave-t7g5"
server_key: "bcf0d4dc2f51c0db50c0fbd79aa25f37"
server_key_iv: "7799cfa04e5f5403fca39878091a8ae3"
server_key_version: "encryptionkey@0"
I20260808 04:40:36.143205 22865 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260808 04:40:36.145399 22890 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:36.146551 22865 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 04:40:36.146661 22865 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-1/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-1/wal
uuid: "5840bba663a9429c8faecf68a8c2c955"
format_stamp: "Formatted at 2026-08-08 04:40:36 on dist-test-slave-t7g5"
server_key: "bcf0d4dc2f51c0db50c0fbd79aa25f37"
server_key_iv: "7799cfa04e5f5403fca39878091a8ae3"
server_key_version: "encryptionkey@0"
I20260808 04:40:36.146751 22865 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:36.164455 22865 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:36.167419 22865 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:36.167594 22865 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:36.174106 22865 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.125:41193
I20260808 04:40:36.174355 22974 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.125:41193 every 8 connection(s)
I20260808 04:40:36.175042 22865 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-1/data/info.pb
I20260808 04:40:36.176548 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 22865
I20260808 04:40:36.178151 22975 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:36.182197 22975 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 04:40:36 dist-test-slave-t7g5 krb5kdc[22121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164035, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.148.125@KRBTEST.COM
Aug 08 04:40:36 dist-test-slave-t7g5 krb5kdc[22121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164036, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.148.125@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM
I20260808 04:40:36.191653 22978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.178109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43282 (local address 127.12.148.125:41193)
0808 04:40:36.178495 (+ 386us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:36.178513 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:36.178559 (+ 46us) server_negotiation.cc:407] Connection header received
0808 04:40:36.179363 (+ 804us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:36.179380 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:36.179699 (+ 319us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:36.179998 (+ 299us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:36.180871 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.181900 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.183020 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.183475 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.183590 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.186169 (+ 2579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:36.186176 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:36.186188 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:36.186221 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:36.188004 (+ 1783us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.188415 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.188422 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.188428 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.188570 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.188876 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.188881 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.188883 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.189417 (+ 534us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:36.189674 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:36.190173 (+ 499us) server_negotiation.cc:299] Negotiation successful
0808 04:40:36.190625 (+ 452us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":253,"thread_start_us":121,"threads_started":1}
I20260808 04:40:36.193502 22979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.184005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.0.0.1:58168)
0808 04:40:36.184398 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:36.184445 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:36.184556 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:36.184883 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:36.184888 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:36.185212 (+ 324us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:36.185342 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.185348 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.186231 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.186234 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.186886 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.186895 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.187394 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.187398 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.187519 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.187928 (+ 409us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:36.187943 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:36.189490 (+ 1547us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:36.191465 (+ 1975us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.191473 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.191479 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.191854 (+ 375us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.192187 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.192190 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.192192 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.192283 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.192852 (+ 569us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:36.192858 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:36.192977 (+ 119us) client_negotiation.cc:769] Sending connection context
0808 04:40:36.193148 (+ 171us) client_negotiation.cc:240] Negotiation successful
0808 04:40:36.193317 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":148,"threads_started":1}
I20260808 04:40:36.193523 22242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.184057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58168 (local address 127.12.148.126:41335)
0808 04:40:36.184186 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:36.184190 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:36.184531 (+ 341us) server_negotiation.cc:407] Connection header received
0808 04:40:36.184648 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:36.184651 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:36.184708 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:36.184803 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:36.185483 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.186104 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.187003 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.187268 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.187358 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.189686 (+ 2328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:36.189690 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:36.189692 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:36.189723 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:36.191355 (+ 1632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.191970 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.191975 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.191977 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.192075 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.192411 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.192415 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.192417 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.192701 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:36.192801 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:36.193242 (+ 441us) server_negotiation.cc:299] Negotiation successful
0808 04:40:36.193370 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 04:40:36.194931 22975 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.148.125" port: 41193 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 04:40:36 dist-test-slave-t7g5 krb5kdc[22121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164036, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.148.125@KRBTEST.COM for oryx/127.12.148.125@KRBTEST.COM
I20260808 04:40:36.202886 22979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.195394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.125:41193 (local address 127.0.0.1:43284)
0808 04:40:36.195535 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:36.195550 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:36.195626 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:36.195840 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:36.195843 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:36.196035 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:36.196139 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.196145 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.197606 (+ 1461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.197609 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.198201 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.198211 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.198729 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.198733 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.198814 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.199192 (+ 378us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:36.199201 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:36.200333 (+ 1132us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:36.201627 (+ 1294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.201629 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.201631 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.201863 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.202075 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.202077 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.202078 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.202146 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.202483 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:36.202486 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:36.202565 (+ 79us) client_negotiation.cc:769] Sending connection context
0808 04:40:36.202644 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 04:40:36.202743 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260808 04:40:36.202906 22978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.195550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43284 (local address 127.12.148.125:41193)
0808 04:40:36.195658 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:36.195662 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:36.195675 (+ 13us) server_negotiation.cc:407] Connection header received
0808 04:40:36.195700 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:36.195703 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:36.195736 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:36.195794 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:36.196229 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.197494 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.198309 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.198631 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.198726 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.200469 (+ 1743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:36.200472 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:36.200474 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:36.200494 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:36.201538 (+ 1044us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.201937 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.201940 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.201941 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.202011 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.202202 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.202204 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.202205 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.202391 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:36.202474 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:36.202686 (+ 212us) server_negotiation.cc:299] Negotiation successful
0808 04:40:36.202795 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":23,"server-negotiator.queue_time_us":25}
I20260808 04:40:36.205540 22975 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955: Bootstrap starting.
I20260808 04:40:36.207738 22975 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:36.208442 22975 log.cc:824] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:36.210284 22975 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955: No bootstrap required, opened a new log
I20260808 04:40:36.213234 22975 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 41193 } }
I20260808 04:40:36.213431 22975 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:36.213495 22975 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5840bba663a9429c8faecf68a8c2c955, State: Initialized, Role: FOLLOWER
I20260808 04:40:36.213927 22975 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 41193 } }
I20260808 04:40:36.214350 22982 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 41193 } } }
I20260808 04:40:36.214478 22982 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:40:36.215066 22975 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [sys.catalog]: configured and running, proceeding with master startup.
W20260808 04:40:36.219635 22995 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 04:40:36.219722 22995 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 04:40:36.221876 22865 master_runner.cc:428] Detected that this master 5840bba663a9429c8faecf68a8c2c955 is joining an existing cluster
I20260808 04:40:36.221942 22865 master_runner.cc:432] Initiating AddMaster RPC to add 127.12.148.125:41193
I20260808 04:40:36.232309 22978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.224817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43290 (local address 127.12.148.125:41193)
0808 04:40:36.224912 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:36.224915 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:36.224927 (+ 12us) server_negotiation.cc:407] Connection header received
0808 04:40:36.225026 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:36.225029 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:36.225065 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:36.225134 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:36.225710 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.226412 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.227273 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.227524 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.227606 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.229103 (+ 1497us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:36.229106 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:36.229109 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:36.229131 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:36.230660 (+ 1529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.231128 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.231132 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.231133 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.231218 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.231466 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.231469 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.231471 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.231653 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:36.231711 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:36.232014 (+ 303us) server_negotiation.cc:299] Negotiation successful
0808 04:40:36.232121 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":26,"server-negotiator.queue_time_us":39}
I20260808 04:40:36.232640 22242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.224215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58172 (local address 127.12.148.126:41335)
0808 04:40:36.224340 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:36.224345 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:36.224590 (+ 245us) server_negotiation.cc:407] Connection header received
0808 04:40:36.224778 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:36.224781 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:36.224830 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:36.224882 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:36.225532 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.226350 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.227665 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.228005 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.228081 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.229454 (+ 1373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:36.229458 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:36.229461 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:36.229487 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:36.230805 (+ 1318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.231376 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.231379 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.231381 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.231474 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.231740 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.231743 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.231745 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.231948 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:36.232038 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:36.232372 (+ 334us) server_negotiation.cc:299] Negotiation successful
0808 04:40:36.232488 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 04:40:36.232708 23007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.224574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.125:41193 (local address 127.0.0.1:43290)
0808 04:40:36.224836 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:36.224849 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:36.224941 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:36.225162 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:36.225165 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:36.225434 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:36.225572 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.225580 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.226523 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.226525 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.227165 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.227173 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.227627 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.227631 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.227714 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.228530 (+ 816us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:36.228545 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:36.228985 (+ 440us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:36.230772 (+ 1787us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.230776 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.230777 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.231046 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.231287 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.231291 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.231292 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.231377 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.231764 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:36.231767 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:36.231844 (+ 77us) client_negotiation.cc:769] Sending connection context
0808 04:40:36.232433 (+ 589us) client_negotiation.cc:240] Negotiation successful
0808 04:40:36.232551 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"mutex_wait_us":48,"thread_start_us":80,"threads_started":1}
I20260808 04:40:36.233108 23006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.224135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.0.0.1:58172)
0808 04:40:36.224509 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:36.224524 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:36.224663 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:36.225041 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:36.225043 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:36.225317 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:36.225419 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.225425 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.226460 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.226464 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.227526 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.227537 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.228230 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.228234 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.228338 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.228755 (+ 417us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:36.228770 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:36.229309 (+ 539us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:36.230910 (+ 1601us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.230913 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.230915 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.231282 (+ 367us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.231555 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.231557 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.231559 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.231648 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.232032 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:36.232035 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:36.232125 (+ 90us) client_negotiation.cc:769] Sending connection context
0808 04:40:36.232809 (+ 684us) client_negotiation.cc:240] Negotiation successful
0808 04:40:36.232945 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"mutex_wait_us":57,"thread_start_us":76,"threads_started":1}
Aug 08 04:40:36 dist-test-slave-t7g5 krb5kdc[22121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164035, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.148.126@KRBTEST.COM for oryx/127.12.148.125@KRBTEST.COM
I20260808 04:40:36.244956 22978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.237069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43306 (local address 127.12.148.125:41193)
0808 04:40:36.237160 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:36.237164 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:36.237440 (+ 276us) server_negotiation.cc:407] Connection header received
0808 04:40:36.237622 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:36.237625 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:36.237703 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:36.237770 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:36.238365 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.238814 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.239642 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.239844 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.239925 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.242151 (+ 2226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:36.242154 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:36.242155 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:36.242176 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:36.243339 (+ 1163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.243823 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.243825 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.243826 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.243893 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.244131 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.244133 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.244134 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.244293 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:36.244362 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:36.244706 (+ 344us) server_negotiation.cc:299] Negotiation successful
0808 04:40:36.244814 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 04:40:36.244984 23009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.237027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.125:41193 (local address 127.0.0.1:43306)
0808 04:40:36.237332 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:36.237371 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:36.237505 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:36.237806 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:36.237812 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:36.238149 (+ 337us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:36.238255 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.238261 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.238911 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.238915 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.239533 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.239542 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.239938 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.239942 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.240053 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.240475 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:36.240486 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:36.242029 (+ 1543us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:36.243439 (+ 1410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.243449 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.243455 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.243739 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.243967 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.243970 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.243973 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.244061 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.244377 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:36.244383 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:36.244504 (+ 121us) client_negotiation.cc:769] Sending connection context
0808 04:40:36.244642 (+ 138us) client_negotiation.cc:240] Negotiation successful
0808 04:40:36.244820 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":85,"threads_started":1}
I20260808 04:40:36.246466 22182 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.12.148.125:41193: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "5840bba663a9429c8faecf68a8c2c955"
member_type: NON_VOTER
last_known_addr {
host: "127.12.148.125"
port: 41193
}
attrs {
promote: true
}
}
dest_uuid: "218c9b6c6aa34ef291292aab18539744"
cas_config_opid_index: -1
I20260808 04:40:36.247206 22182 consensus_queue.cc:237] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: NON_VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: true } }
I20260808 04:40:36.251489 23014 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 5840bba663a9429c8faecf68a8c2c955 (127.12.148.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: NON_VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: true } } }
I20260808 04:40:36.252166 22933 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:36.253170 23014 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.12.148.125:41193
I20260808 04:40:36.253450 22933 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [term 1 FOLLOWER]: Refusing update from remote peer 218c9b6c6aa34ef291292aab18539744: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260808 04:40:36.253494 23014 sys_catalog.cc:455] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "218c9b6c6aa34ef291292aab18539744" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: NON_VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: true } } }
I20260808 04:40:36.253577 23014 sys_catalog.cc:458] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:36.253646 22865 master.cc:537] Master@127.12.148.125:41193 shutting down...
I20260808 04:40:36.254132 23014 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: NON_VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
WARNING: no policy specified for oryx/127.12.148.124@KRBTEST.COM; defaulting to no policy
W20260808 04:40:36.256071 22162 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260808 04:40:36.257180 22162 consensus_peers.cc:487] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 -> Peer 5840bba663a9429c8faecf68a8c2c955 (127.12.148.125:41193): Couldn't send request to peer 5840bba663a9429c8faecf68a8c2c955. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.148.124@KRBTEST.COM" created.
I20260808 04:40:36.260466 22865 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:36.260773 22865 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:36.260875 22865 tablet_replica.cc:330] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955: stopping tablet replica
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.148.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.124.keytab.
Entry for principal oryx/127.12.148.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.124.keytab.
I20260808 04:40:36.274446 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.124:35345
--webserver_interface=127.12.148.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.124.keytab
--principal=oryx/127.12.148.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:38949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:41335,127.12.148.125:41193,127.12.148.124:35345
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 04:40:36.275942 22865 master.cc:552] Master@127.12.148.125:41193 shutdown complete.
I20260808 04:40:36.275997 22865 master_runner.cc:305] Clearing existing system tablet
I20260808 04:40:36.276221 22865 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:36.276279 22865 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:36.277514 22865 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 04:40:36.278326 23021 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:36.278551 22865 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:36.278690 22865 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 04:40:36.278734 22865 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-1/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-1/wal
uuid: "5840bba663a9429c8faecf68a8c2c955"
format_stamp: "Formatted at 2026-08-08 04:40:36 on dist-test-slave-t7g5"
server_key: "bcf0d4dc2f51c0db50c0fbd79aa25f37"
server_key_iv: "7799cfa04e5f5403fca39878091a8ae3"
server_key_version: "encryptionkey@0"
I20260808 04:40:36.280807 22865 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:36.283154 22865 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 04:40:36.283246 22865 log.cc:1196] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260808 04:40:36.283499 22865 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955: Deleting consensus metadata
I20260808 04:40:36.283661 22865 master_runner.cc:315] Copying system tablet from 127.12.148.126:41335
I20260808 04:40:36.284948 22865 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955: tablet copy: Beginning tablet copy session from remote peer at address 127.12.148.126:41335
I20260808 04:40:36.294667 22242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.285741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58176 (local address 127.12.148.126:41335)
0808 04:40:36.285861 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:36.285865 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:36.286433 (+ 568us) server_negotiation.cc:407] Connection header received
0808 04:40:36.286620 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:36.286624 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:36.286670 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:36.286717 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:36.287331 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.288142 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.289297 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.289619 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.289721 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.291091 (+ 1370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:36.291095 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:36.291098 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:36.291123 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:36.292685 (+ 1562us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.293361 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.293364 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.293366 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.293461 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.293759 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.293762 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.293763 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.293971 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:36.294036 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:36.294376 (+ 340us) server_negotiation.cc:299] Negotiation successful
0808 04:40:36.294507 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 04:40:36.295240 23031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.285975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.0.0.1:58176)
0808 04:40:36.286343 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:36.286357 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:36.286523 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:36.286857 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:36.286859 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:36.287077 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:36.287207 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.287213 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.288278 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.288281 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.289160 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.289172 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.289877 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.289881 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.289976 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.290508 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:36.290521 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:36.290940 (+ 419us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:36.293002 (+ 2062us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.293005 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.293007 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.293254 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.293558 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.293561 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.293563 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.293642 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.294105 (+ 463us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:36.294108 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:36.294208 (+ 100us) client_negotiation.cc:769] Sending connection context
0808 04:40:36.294887 (+ 679us) client_negotiation.cc:240] Negotiation successful
0808 04:40:36.295048 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":106,"threads_started":1}
I20260808 04:40:36.295840 22214 tablet_copy_service.cc:140] P 218c9b6c6aa34ef291292aab18539744: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 5840bba663a9429c8faecf68a8c2c955 ({username='oryx', principal='oryx/127.12.148.125@KRBTEST.COM'} at 127.0.0.1:58176)
I20260808 04:40:36.296021 22214 tablet_copy_service.cc:161] P 218c9b6c6aa34ef291292aab18539744: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 5840bba663a9429c8faecf68a8c2c955 at {username='oryx', principal='oryx/127.12.148.125@KRBTEST.COM'} at 127.0.0.1:58176: session id = 5840bba663a9429c8faecf68a8c2c955-00000000000000000000000000000000
I20260808 04:40:36.297554 22214 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 04:40:36.299402 22865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 04:40:36.301306 22865 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955: tablet copy: Starting download of 0 data blocks...
I20260808 04:40:36.301457 22865 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955: tablet copy: Starting download of 1 WAL segments...
I20260808 04:40:36.303115 22865 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 04:40:36.304698 22214 tablet_copy_service.cc:342] P 218c9b6c6aa34ef291292aab18539744: Request end of tablet copy session 5840bba663a9429c8faecf68a8c2c955-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.12.148.125@KRBTEST.COM'} at 127.0.0.1:58176
I20260808 04:40:36.304792 22214 tablet_copy_service.cc:433] P 218c9b6c6aa34ef291292aab18539744: ending tablet copy session 5840bba663a9429c8faecf68a8c2c955-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 5840bba663a9429c8faecf68a8c2c955
I20260808 04:40:36.311728 22865 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:36.313249 23037 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:36.313390 23032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:36.313546 22865 server_base.cc:1034] running on GCE node
W20260808 04:40:36.317811 23033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:36.318045 22865 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:36.318352 22865 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:36.319496 22865 hybrid_clock.cc:648] HybridClock initialized: now 1786164036319475 us; error 41 us; skew 500 ppm
Aug 08 04:40:36 dist-test-slave-t7g5 krb5kdc[22121](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164036, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.148.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:36.320851 22865 init.cc:377] Logged in from keytab as oryx/127.12.148.125@KRBTEST.COM (short username oryx)
I20260808 04:40:36.321291 22865 webserver.cc:460] Webserver started at http://127.12.148.125:39029/ using document root <none> and password file <none>
I20260808 04:40:36.321485 22865 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:36.321520 22865 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:36.322702 22865 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 04:40:36.323596 23050 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:36.323817 22865 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 04:40:36.323907 22865 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-1/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-1/wal
uuid: "5840bba663a9429c8faecf68a8c2c955"
format_stamp: "Formatted at 2026-08-08 04:40:36 on dist-test-slave-t7g5"
server_key: "bcf0d4dc2f51c0db50c0fbd79aa25f37"
server_key_iv: "7799cfa04e5f5403fca39878091a8ae3"
server_key_version: "encryptionkey@0"
I20260808 04:40:36.323992 22865 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:36.342242 22865 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:36.344026 22865 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:36.348627 22865 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.125:41193
I20260808 04:40:36.348829 23130 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.125:41193 every 8 connection(s)
I20260808 04:40:36.349185 22865 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-1/data/info.pb
I20260808 04:40:36.350780 23131 sys_catalog.cc:263] Verifying existing consensus state
I20260808 04:40:36.351572 23131 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955: Bootstrap starting.
I20260808 04:40:36.360352 23131 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 04:40:36.360623 23131 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955: Bootstrap complete.
I20260808 04:40:36.361102 23131 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: NON_VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: true } }
I20260808 04:40:36.361218 23131 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5840bba663a9429c8faecf68a8c2c955, State: Initialized, Role: LEARNER
I20260808 04:40:36.361320 23131 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: NON_VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: true } }
I20260808 04:40:36.361627 23134 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: NON_VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: true } } }
I20260808 04:40:36.361785 23131 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:40:36.361846 23134 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [sys.catalog]: This master's current role is: LEARNER
I20260808 04:40:36.364995 23151 catalog_manager.cc:1259] Loaded cluster ID: 3f5f41c2104c4ce39c1596eb686339ce
I20260808 04:40:36.365044 23151 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955: loading cluster ID for follower catalog manager: success
I20260808 04:40:36.366598 23151 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955: acquiring CA information for follower catalog manager: success
I20260808 04:40:36.367681 23151 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260808 04:40:36.425988 23019 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:36.426229 23019 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:36.426275 23019 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:36.430300 23019 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:40:36.430353 23019 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:36.430372 23019 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:36.430402 23019 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:40:36.430428 23019 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:40:36.435514 23019 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:38949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:41335,127.12.148.125:41193,127.12.148.124:35345
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.124.keytab
--principal=oryx/127.12.148.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.124:35345
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.148.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23019
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:36.436432 23019 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:36.437362 23019 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:36.445323 23158 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:36.445323 23157 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:36.445333 23164 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:36.445516 23019 server_base.cc:1034] running on GCE node
I20260808 04:40:36.446152 23019 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:36.447222 23019 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:36.448379 23019 hybrid_clock.cc:648] HybridClock initialized: now 1786164036448365 us; error 25 us; skew 500 ppm
Aug 08 04:40:36 dist-test-slave-t7g5 krb5kdc[22121](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164036, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.148.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:36.451237 23019 init.cc:377] Logged in from keytab as oryx/127.12.148.124@KRBTEST.COM (short username oryx)
I20260808 04:40:36.452070 23019 webserver.cc:460] Webserver started at http://127.12.148.124:43371/ using document root <none> and password file <none>
I20260808 04:40:36.452633 23019 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:36.452701 23019 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:36.452888 23019 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:36.454932 23019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-2/data/instance:
uuid: "4d013e883a6b4893b49cafa319d3eb20"
format_stamp: "Formatted at 2026-08-08 04:40:36 on dist-test-slave-t7g5"
server_key: "a7f81d52c9093d46795ab8654415ac54"
server_key_iv: "72b7c5569442d32de059d80bc9814a9b"
server_key_version: "encryptionkey@0"
I20260808 04:40:36.455484 23019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-2/wal/instance:
uuid: "4d013e883a6b4893b49cafa319d3eb20"
format_stamp: "Formatted at 2026-08-08 04:40:36 on dist-test-slave-t7g5"
server_key: "a7f81d52c9093d46795ab8654415ac54"
server_key_iv: "72b7c5569442d32de059d80bc9814a9b"
server_key_version: "encryptionkey@0"
I20260808 04:40:36.459163 23019 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 04:40:36.461544 23174 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:36.462917 23019 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:40:36.463033 23019 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-2/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-2/wal
uuid: "4d013e883a6b4893b49cafa319d3eb20"
format_stamp: "Formatted at 2026-08-08 04:40:36 on dist-test-slave-t7g5"
server_key: "a7f81d52c9093d46795ab8654415ac54"
server_key_iv: "72b7c5569442d32de059d80bc9814a9b"
server_key_version: "encryptionkey@0"
I20260808 04:40:36.463127 23019 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:36.506886 23019 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:36.510277 23019 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:36.510470 23019 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:36.517647 23019 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.124:35345
I20260808 04:40:36.517949 23247 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.124:35345 every 8 connection(s)
I20260808 04:40:36.518748 23019 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-2/data/info.pb
I20260808 04:40:36.521517 23248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:36.522172 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 23019
I20260808 04:40:36.526674 23248 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 04:40:36 dist-test-slave-t7g5 krb5kdc[22121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164035, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.148.124@KRBTEST.COM
Aug 08 04:40:36 dist-test-slave-t7g5 krb5kdc[22121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164036, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.148.124@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM
I20260808 04:40:36.537712 23250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.523812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43356 (local address 127.12.148.124:35345)
0808 04:40:36.524369 (+ 557us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:36.524390 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:36.524438 (+ 48us) server_negotiation.cc:407] Connection header received
0808 04:40:36.525132 (+ 694us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:36.525158 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:36.525601 (+ 443us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:36.525990 (+ 389us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:36.526652 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.528087 (+ 1435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.529191 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.529765 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.529890 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.532730 (+ 2840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:36.532736 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:36.532745 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:36.532771 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:36.534702 (+ 1931us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.535125 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.535131 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.535136 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.535236 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.535497 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.535500 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.535502 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.535856 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:36.536033 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:36.536547 (+ 514us) server_negotiation.cc:299] Negotiation successful
0808 04:40:36.536839 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":389,"thread_start_us":111,"threads_started":1}
I20260808 04:40:36.538283 22242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.528663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58182 (local address 127.12.148.126:41335)
0808 04:40:36.528787 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:36.528791 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:36.529053 (+ 262us) server_negotiation.cc:407] Connection header received
0808 04:40:36.529172 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:36.529176 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:36.529228 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:36.529305 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:36.530081 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.530585 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.531802 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.532137 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.532242 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.534828 (+ 2586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:36.534831 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:36.534834 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:36.534862 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:36.536397 (+ 1535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.536941 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.536945 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.536947 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.537043 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.537317 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.537319 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.537321 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.537534 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:36.537631 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:36.538026 (+ 395us) server_negotiation.cc:299] Negotiation successful
0808 04:40:36.538139 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 04:40:36.538810 23251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.528560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.0.0.1:58182)
0808 04:40:36.528936 (+ 376us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:36.528975 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:36.529088 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:36.529366 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:36.529370 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:36.529744 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:36.529941 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.529951 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.530714 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.530717 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.531690 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.531700 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.532297 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.532301 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.532412 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.532893 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:36.532906 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:36.534678 (+ 1772us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:36.536519 (+ 1841us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.536534 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.536539 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.536829 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.537135 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.537138 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.537140 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.537236 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.537638 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:36.537643 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:36.537783 (+ 140us) client_negotiation.cc:769] Sending connection context
0808 04:40:36.538471 (+ 688us) client_negotiation.cc:240] Negotiation successful
0808 04:40:36.538642 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"mutex_wait_us":29,"thread_start_us":130,"threads_started":1}
I20260808 04:40:36.539832 23248 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.148.125" port: 41193 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 04:40:36 dist-test-slave-t7g5 krb5kdc[22121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164036, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.148.124@KRBTEST.COM for oryx/127.12.148.125@KRBTEST.COM
I20260808 04:40:36.547374 23251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.540212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.125:41193 (local address 127.0.0.1:43310)
0808 04:40:36.540313 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:36.540324 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:36.540382 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:36.540774 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:36.540777 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:36.540918 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:36.541001 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.541006 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.541948 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.541952 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.542470 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.542478 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.542906 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.542910 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.543000 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.543366 (+ 366us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:36.543377 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:36.544406 (+ 1029us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:36.545979 (+ 1573us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.545983 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.545985 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.546166 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.546416 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.546419 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.546421 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.546580 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.546933 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:36.546936 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:36.547016 (+ 80us) client_negotiation.cc:769] Sending connection context
0808 04:40:36.547112 (+ 96us) client_negotiation.cc:240] Negotiation successful
0808 04:40:36.547234 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 04:40:36.547432 23252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.540344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43310 (local address 127.12.148.125:41193)
0808 04:40:36.540583 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:36.540586 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:36.540597 (+ 11us) server_negotiation.cc:407] Connection header received
0808 04:40:36.540632 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:36.540634 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:36.540669 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:36.540744 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:36.541111 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.541839 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.542576 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.542810 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.542897 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.544544 (+ 1647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:36.544547 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:36.544549 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:36.544572 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:36.545881 (+ 1309us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.546252 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.546256 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.546257 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.546333 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.546668 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.546672 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.546673 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.546842 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:36.546929 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:36.547174 (+ 245us) server_negotiation.cc:299] Negotiation successful
0808 04:40:36.547287 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":81,"threads_started":1}
I20260808 04:40:36.548086 23248 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.148.124" port: 35345 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 04:40:36 dist-test-slave-t7g5 krb5kdc[22121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164036, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.148.124@KRBTEST.COM for oryx/127.12.148.124@KRBTEST.COM
I20260808 04:40:36.555094 23251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.548475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:35345 (local address 127.0.0.1:43362)
0808 04:40:36.548590 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:36.548604 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:36.548674 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:36.548864 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:36.548867 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:36.549012 (+ 145us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:36.549072 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.549077 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.550119 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.550122 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.550592 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.550600 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.550992 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.550995 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.551062 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.551412 (+ 350us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:36.551425 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:36.552502 (+ 1077us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:36.553998 (+ 1496us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.554000 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.554002 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.554175 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.554420 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.554422 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.554423 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.554485 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.554755 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:36.554757 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:36.554824 (+ 67us) client_negotiation.cc:769] Sending connection context
0808 04:40:36.554900 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 04:40:36.554996 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260808 04:40:36.555176 23250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.548539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43362 (local address 127.12.148.124:35345)
0808 04:40:36.548623 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:36.548627 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:36.548638 (+ 11us) server_negotiation.cc:407] Connection header received
0808 04:40:36.548750 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:36.548753 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:36.548786 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:36.548843 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:36.549167 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.550011 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.550691 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.550899 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.550979 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.552619 (+ 1640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:36.552622 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:36.552623 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:36.552644 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:36.553914 (+ 1270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.554244 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.554246 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.554247 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.554356 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.554545 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.554547 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.554548 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.554696 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:36.554761 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:36.554939 (+ 178us) server_negotiation.cc:299] Negotiation successful
0808 04:40:36.555049 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":18,"server-negotiator.queue_time_us":34}
I20260808 04:40:36.556954 22464 heartbeater.cc:503] Master 127.12.148.126:41335 was elected leader, sending a full tablet report...
I20260808 04:40:36.558094 23248 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20: Bootstrap starting.
I20260808 04:40:36.560379 23248 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:36.561106 23248 log.cc:824] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:36.563078 23248 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20: No bootstrap required, opened a new log
I20260808 04:40:36.566035 23248 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 41193 } } peers { permanent_uuid: "4d013e883a6b4893b49cafa319d3eb20" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 35345 } }
I20260808 04:40:36.566232 23248 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:36.566270 23248 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d013e883a6b4893b49cafa319d3eb20, State: Initialized, Role: FOLLOWER
I20260808 04:40:36.566655 23248 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 41193 } } peers { permanent_uuid: "4d013e883a6b4893b49cafa319d3eb20" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 35345 } }
I20260808 04:40:36.567087 23255 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 41193 } } peers { permanent_uuid: "4d013e883a6b4893b49cafa319d3eb20" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 35345 } } }
I20260808 04:40:36.567229 23255 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:40:36.567819 23248 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [sys.catalog]: configured and running, proceeding with master startup.
W20260808 04:40:36.572067 23267 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 04:40:36.572142 23267 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 04:40:36.575372 23019 master_runner.cc:428] Detected that this master 4d013e883a6b4893b49cafa319d3eb20 is joining an existing cluster
I20260808 04:40:36.575420 23019 master_runner.cc:432] Initiating AddMaster RPC to add 127.12.148.124:35345
I20260808 04:40:36.590983 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 22275
I20260808 04:40:36.604034 23273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.577247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.0.0.1:58192)
0808 04:40:36.577534 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:36.577546 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:36.577695 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:36.577951 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:36.577954 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:36.578175 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:36.578442 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.578449 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.579449 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.579452 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.580338 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.580346 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.580783 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.580786 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.580870 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.581414 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:36.581428 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:36.581939 (+ 511us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:36.583884 (+ 1945us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.583887 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.583889 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.584198 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.584453 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.584456 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.584458 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.602669 (+ 18211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.603452 (+ 783us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:36.603455 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:36.603574 (+ 119us) client_negotiation.cc:769] Sending connection context
0808 04:40:36.603671 (+ 97us) client_negotiation.cc:240] Negotiation successful
0808 04:40:36.603828 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"spinlock_wait_cycles":1792,"thread_start_us":95,"threads_started":1}
I20260808 04:40:36.604588 22242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.577328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58192 (local address 127.12.148.126:41335)
0808 04:40:36.577449 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:36.577454 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:36.577605 (+ 151us) server_negotiation.cc:407] Connection header received
0808 04:40:36.577813 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:36.577815 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:36.577857 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:36.577920 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:36.578554 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.579332 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.580453 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.580667 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.580752 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.582077 (+ 1325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:36.582080 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:36.582083 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:36.582107 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:36.583769 (+ 1662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.584287 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.584291 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.584292 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.584374 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.602968 (+ 18594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.602972 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.602974 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.603269 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:36.603376 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:36.604279 (+ 903us) server_negotiation.cc:299] Negotiation successful
0808 04:40:36.604412 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 04:40:36.605634 23250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.578294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43370 (local address 127.12.148.124:35345)
0808 04:40:36.578399 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:36.578403 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:36.578756 (+ 353us) server_negotiation.cc:407] Connection header received
0808 04:40:36.578880 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:36.578883 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:36.578913 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:36.578952 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:36.579437 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.580147 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.581567 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.581892 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.581963 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.583362 (+ 1399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:36.583366 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:36.583369 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:36.583393 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:36.603397 (+ 20004us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.603845 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.603848 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.603849 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.603917 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.604593 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.604596 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.604598 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.604804 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:36.604874 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:36.605406 (+ 532us) server_negotiation.cc:299] Negotiation successful
0808 04:40:36.605510 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 04:40:36.606287 23274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.578028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:35345 (local address 127.0.0.1:43370)
0808 04:40:36.578689 (+ 661us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:36.578701 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:36.578803 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:36.579048 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:36.579050 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:36.579245 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:36.579336 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.579342 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.580262 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.580264 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.581451 (+ 1187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.581462 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.582076 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.582079 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.582168 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.582799 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:36.582813 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:36.583208 (+ 395us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:36.603527 (+ 20319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.603530 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.603532 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.603758 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.604012 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.604014 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.604016 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.604494 (+ 478us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.605160 (+ 666us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:36.605163 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:36.605263 (+ 100us) client_negotiation.cc:769] Sending connection context
0808 04:40:36.606000 (+ 737us) client_negotiation.cc:240] Negotiation successful
0808 04:40:36.606133 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":587,"mutex_wait_us":449,"thread_start_us":84,"threads_started":1}
I20260808 04:40:36.609635 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.65:40203
--local_ip_for_outbound_sockets=127.12.148.65
--tserver_master_addrs=127.12.148.126:41335
--webserver_port=43941
--webserver_interface=127.12.148.65
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.65.keytab
--principal=oryx/127.12.148.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:38949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.12.148.126:41335,127.12.148.125:41193
--tserver_master_addrs=127.12.148.126:41335,127.12.148.125:41193,127.12.148.124:35345 with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 04:40:36.612028 23252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.577754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43314 (local address 127.12.148.125:41193)
0808 04:40:36.577876 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:36.577880 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:36.578433 (+ 553us) server_negotiation.cc:407] Connection header received
0808 04:40:36.578479 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:36.578482 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:36.578534 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:36.578614 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:36.579311 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.580124 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.583264 (+ 3140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.583858 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.583936 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.608072 (+ 24136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:36.608076 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:36.608079 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:36.608109 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:36.610013 (+ 1904us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.610706 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.610710 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.610712 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.610801 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.611107 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.611111 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.611112 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.611315 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:36.611390 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:36.611730 (+ 340us) server_negotiation.cc:299] Negotiation successful
0808 04:40:36.611865 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 04:40:36.612696 23277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.577642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.125:41193 (local address 127.0.0.1:43314)
0808 04:40:36.578254 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:36.578266 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:36.578361 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:36.578733 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:36.578736 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:36.579050 (+ 314us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:36.579168 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.579176 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.580298 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.580302 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.582913 (+ 2611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.582924 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.584314 (+ 1390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.584318 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.584411 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.584773 (+ 362us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:36.584787 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:36.607889 (+ 23102us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:36.610359 (+ 2470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.610362 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.610364 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.610597 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.610906 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.610909 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.610911 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.611011 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.611448 (+ 437us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:36.611450 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:36.611546 (+ 96us) client_negotiation.cc:769] Sending connection context
0808 04:40:36.612388 (+ 842us) client_negotiation.cc:240] Negotiation successful
0808 04:40:36.612534 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"thread_start_us":84,"threads_started":1}
Aug 08 04:40:36 dist-test-slave-t7g5 krb5kdc[22121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164035, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.148.126@KRBTEST.COM for oryx/127.12.148.124@KRBTEST.COM
I20260808 04:40:36.617417 23009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.608611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:35345 (local address 127.0.0.1:43376)
0808 04:40:36.608779 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:36.608791 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:36.608869 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:36.609246 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:36.609249 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:36.609433 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:36.609553 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.609560 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.610564 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.610568 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.611352 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.611363 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.612021 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.612024 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.612120 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.612544 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:36.612558 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:36.614046 (+ 1488us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:36.615860 (+ 1814us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.615864 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.615866 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.616110 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.616391 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.616394 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.616396 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.616484 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.616904 (+ 420us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:36.616907 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:36.617027 (+ 120us) client_negotiation.cc:769] Sending connection context
0808 04:40:36.617116 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 04:40:36.617257 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":94}
I20260808 04:40:36.618271 23250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.608553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43376 (local address 127.12.148.124:35345)
0808 04:40:36.609021 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:36.609025 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:36.609037 (+ 12us) server_negotiation.cc:407] Connection header received
0808 04:40:36.609100 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:36.609103 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:36.609149 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:36.609218 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:36.609712 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.610424 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.611472 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.611805 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.611910 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.614182 (+ 2272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:36.614185 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:36.614187 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:36.614211 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:36.615735 (+ 1524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.616211 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.616214 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.616216 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.616302 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.616571 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.616574 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.616575 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.616776 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:36.617869 (+ 1093us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:36.618022 (+ 153us) server_negotiation.cc:299] Negotiation successful
0808 04:40:36.618135 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396}
I20260808 04:40:36.619940 22182 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.12.148.124:35345: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "4d013e883a6b4893b49cafa319d3eb20"
member_type: NON_VOTER
last_known_addr {
host: "127.12.148.124"
port: 35345
}
attrs {
promote: true
}
}
dest_uuid: "218c9b6c6aa34ef291292aab18539744"
cas_config_opid_index: 5
I20260808 04:40:36.620676 22182 consensus_queue.cc:237] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: NON_VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: true } } peers { permanent_uuid: "4d013e883a6b4893b49cafa319d3eb20" member_type: NON_VOTER last_known_addr { host: "127.12.148.124" port: 35345 } attrs { promote: true } }
I20260808 04:40:36.622136 23013 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 4d013e883a6b4893b49cafa319d3eb20 (127.12.148.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: NON_VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: true } } peers { permanent_uuid: "4d013e883a6b4893b49cafa319d3eb20" member_type: NON_VOTER last_known_addr { host: "127.12.148.124" port: 35345 } attrs { promote: true } } }
I20260808 04:40:36.622432 23213 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:36.623390 23013 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.12.148.124:35345
I20260808 04:40:36.623580 23013 sys_catalog.cc:455] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "218c9b6c6aa34ef291292aab18539744" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: NON_VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: true } } peers { permanent_uuid: "4d013e883a6b4893b49cafa319d3eb20" member_type: NON_VOTER last_known_addr { host: "127.12.148.124" port: 35345 } attrs { promote: true } } }
I20260808 04:40:36.623683 23013 sys_catalog.cc:458] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:36.623809 23213 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [term 1 FOLLOWER]: Refusing update from remote peer 218c9b6c6aa34ef291292aab18539744: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 04:40:36.624217 23019 master.cc:537] Master@127.12.148.124:35345 shutting down...
I20260808 04:40:36.624778 23014 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d013e883a6b4893b49cafa319d3eb20" member_type: NON_VOTER last_known_addr { host: "127.12.148.124" port: 35345 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 04:40:36.626736 22162 consensus_peers.cc:487] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 -> Peer 4d013e883a6b4893b49cafa319d3eb20 (127.12.148.124:35345): Couldn't send request to peer 4d013e883a6b4893b49cafa319d3eb20. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 04:40:36.628973 23009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.621987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.125:41193 (local address 127.0.0.1:43330)
0808 04:40:36.623983 (+ 1996us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:36.623996 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:36.624076 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:36.624550 (+ 474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:36.624553 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:36.624572 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:36.624657 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.624663 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.625625 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.625628 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.627244 (+ 1616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.627254 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.628517 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.628521 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.628624 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.628677 (+ 53us) client_negotiation.cc:769] Sending connection context
0808 04:40:36.628758 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 04:40:36.628835 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1928}
I20260808 04:40:36.629403 23252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.622085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43330 (local address 127.12.148.125:41193)
0808 04:40:36.622199 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:36.622203 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:36.624156 (+ 1953us) server_negotiation.cc:407] Connection header received
0808 04:40:36.624205 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:36.624208 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:36.624291 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:36.624381 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:36.624784 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.625503 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.627359 (+ 1856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.628122 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.628256 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.628418 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:36.629211 (+ 793us) server_negotiation.cc:299] Negotiation successful
0808 04:40:36.629290 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 04:40:36.630002 23019 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:36.630183 23094 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [term 1 LEARNER]: Refusing update from remote peer 218c9b6c6aa34ef291292aab18539744: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 04:40:36.630290 23019 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:36.630384 23019 tablet_replica.cc:330] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20: stopping tablet replica
I20260808 04:40:36.630553 23014 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: NON_VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260808 04:40:36.633703 23094 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 4d013e883a6b4893b49cafa319d3eb20 (127.12.148.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: NON_VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: true } } peers { permanent_uuid: "4d013e883a6b4893b49cafa319d3eb20" member_type: NON_VOTER last_known_addr { host: "127.12.148.124" port: 35345 } attrs { promote: true } } }
I20260808 04:40:36.635977 23134 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 218c9b6c6aa34ef291292aab18539744. Latest consensus state: current_term: 1 leader_uuid: "218c9b6c6aa34ef291292aab18539744" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: NON_VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: true } } peers { permanent_uuid: "4d013e883a6b4893b49cafa319d3eb20" member_type: NON_VOTER last_known_addr { host: "127.12.148.124" port: 35345 } attrs { promote: true } } }
I20260808 04:40:36.636102 23134 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [sys.catalog]: This master's current role is: LEARNER
I20260808 04:40:36.636189 23134 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "218c9b6c6aa34ef291292aab18539744" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: NON_VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: true } } peers { permanent_uuid: "4d013e883a6b4893b49cafa319d3eb20" member_type: NON_VOTER last_known_addr { host: "127.12.148.124" port: 35345 } attrs { promote: true } } }
I20260808 04:40:36.636261 23134 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [sys.catalog]: This master's current role is: LEARNER
I20260808 04:40:36.637910 23019 master.cc:552] Master@127.12.148.124:35345 shutdown complete.
I20260808 04:40:36.637998 23019 master_runner.cc:305] Clearing existing system tablet
I20260808 04:40:36.638271 23019 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:36.638350 23019 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:36.638888 23014 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744: attempting to promote NON_VOTER 5840bba663a9429c8faecf68a8c2c955 to VOTER
I20260808 04:40:36.639405 23014 consensus_queue.cc:237] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: false } } peers { permanent_uuid: "4d013e883a6b4893b49cafa319d3eb20" member_type: NON_VOTER last_known_addr { host: "127.12.148.124" port: 35345 } attrs { promote: true } }
I20260808 04:40:36.640844 23094 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [term 1 LEARNER]: Refusing update from remote peer 218c9b6c6aa34ef291292aab18539744: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260808 04:40:36.641215 23013 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260808 04:40:36.641394 23009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.640437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:35345 (local address 127.0.0.1:43378)
0808 04:40:36.641173 (+ 736us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:36.641264 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.124:35345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260808 04:40:36.642529 23009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.642287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:35345 (local address 127.0.0.1:43386)
0808 04:40:36.642418 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:36.642464 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.124:35345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
W20260808 04:40:36.642689 22162 consensus_peers.cc:487] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 -> Peer 4d013e883a6b4893b49cafa319d3eb20 (127.12.148.124:35345): Couldn't send request to peer 4d013e883a6b4893b49cafa319d3eb20. Status: Network error: Client connection negotiation failed: client connection to 127.12.148.124:35345: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 04:40:36.643603 23013 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 5840bba663a9429c8faecf68a8c2c955 (127.12.148.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: false } } peers { permanent_uuid: "4d013e883a6b4893b49cafa319d3eb20" member_type: NON_VOTER last_known_addr { host: "127.12.148.124" port: 35345 } attrs { promote: true } } }
I20260808 04:40:36.644058 23094 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 5840bba663a9429c8faecf68a8c2c955 (127.12.148.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: false } } peers { permanent_uuid: "4d013e883a6b4893b49cafa319d3eb20" member_type: NON_VOTER last_known_addr { host: "127.12.148.124" port: 35345 } attrs { promote: true } } }
I20260808 04:40:36.645047 23013 sys_catalog.cc:455] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "218c9b6c6aa34ef291292aab18539744" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: false } } peers { permanent_uuid: "4d013e883a6b4893b49cafa319d3eb20" member_type: NON_VOTER last_known_addr { host: "127.12.148.124" port: 35345 } attrs { promote: true } } }
I20260808 04:40:36.645143 23013 sys_catalog.cc:458] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:36.645246 23013 sys_catalog.cc:455] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "218c9b6c6aa34ef291292aab18539744" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: false } } peers { permanent_uuid: "4d013e883a6b4893b49cafa319d3eb20" member_type: NON_VOTER last_known_addr { host: "127.12.148.124" port: 35345 } attrs { promote: true } } }
I20260808 04:40:36.645305 23013 sys_catalog.cc:458] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:36.645784 23280 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "218c9b6c6aa34ef291292aab18539744" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: false } } peers { permanent_uuid: "4d013e883a6b4893b49cafa319d3eb20" member_type: NON_VOTER last_known_addr { host: "127.12.148.124" port: 35345 } attrs { promote: true } } }
I20260808 04:40:36.645936 23280 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:40:36.650002 23019 fs_manager.cc:709] Time spent opening directory manager: real 0.009s user 0.001s sys 0.000s
I20260808 04:40:36.650916 23287 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:36.651131 23019 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:36.651263 23019 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 04:40:36.651311 23019 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-2/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-2/wal
uuid: "4d013e883a6b4893b49cafa319d3eb20"
format_stamp: "Formatted at 2026-08-08 04:40:36 on dist-test-slave-t7g5"
server_key: "a7f81d52c9093d46795ab8654415ac54"
server_key_iv: "72b7c5569442d32de059d80bc9814a9b"
server_key_version: "encryptionkey@0"
I20260808 04:40:36.653230 23019 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:36.655571 23019 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 04:40:36.655664 23019 log.cc:1196] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260808 04:40:36.655893 23019 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20: Deleting consensus metadata
I20260808 04:40:36.656055 23019 master_runner.cc:315] Copying system tablet from 127.12.148.126:41335
I20260808 04:40:36.657160 23019 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20: tablet copy: Beginning tablet copy session from remote peer at address 127.12.148.126:41335
I20260808 04:40:36.670653 23295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.657689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.0.0.1:58206)
0808 04:40:36.662271 (+ 4582us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:36.662285 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:36.662408 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:36.662708 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:36.662711 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:36.662959 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:36.663091 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.663099 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.664157 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.664160 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.665081 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.665092 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.665685 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.665689 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.665788 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.666353 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:36.666367 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:36.666793 (+ 426us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:36.668911 (+ 2118us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.668914 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.668917 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.669174 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.669478 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.669482 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.669484 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.669593 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.670096 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:36.670099 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:36.670203 (+ 104us) client_negotiation.cc:769] Sending connection context
0808 04:40:36.670298 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 04:40:36.670442 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4503,"thread_start_us":85,"threads_started":1}
I20260808 04:40:36.670667 22242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.657787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58206 (local address 127.12.148.126:41335)
0808 04:40:36.657899 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:36.657904 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:36.662380 (+ 4476us) server_negotiation.cc:407] Connection header received
0808 04:40:36.662508 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:36.662511 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:36.662566 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:36.662657 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:36.663246 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.664045 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.665207 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.665545 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.665685 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.666956 (+ 1271us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:36.666960 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:36.666963 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:36.666991 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:36.668807 (+ 1816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.669277 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.669281 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.669283 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.669377 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.669758 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.669761 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.669763 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.670000 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:36.670100 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:36.670374 (+ 274us) server_negotiation.cc:299] Negotiation successful
0808 04:40:36.670514 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 04:40:36.671458 22214 tablet_copy_service.cc:140] P 218c9b6c6aa34ef291292aab18539744: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 4d013e883a6b4893b49cafa319d3eb20 ({username='oryx', principal='oryx/127.12.148.124@KRBTEST.COM'} at 127.0.0.1:58206)
I20260808 04:40:36.671561 22214 tablet_copy_service.cc:161] P 218c9b6c6aa34ef291292aab18539744: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 4d013e883a6b4893b49cafa319d3eb20 at {username='oryx', principal='oryx/127.12.148.124@KRBTEST.COM'} at 127.0.0.1:58206: session id = 4d013e883a6b4893b49cafa319d3eb20-00000000000000000000000000000000
I20260808 04:40:36.672623 22214 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 04:40:36.674014 23019 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 04:40:36.676393 23019 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20: tablet copy: Starting download of 0 data blocks...
I20260808 04:40:36.676661 23019 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20: tablet copy: Starting download of 1 WAL segments...
I20260808 04:40:36.678201 23019 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 04:40:36.679850 22214 tablet_copy_service.cc:342] P 218c9b6c6aa34ef291292aab18539744: Request end of tablet copy session 4d013e883a6b4893b49cafa319d3eb20-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.12.148.124@KRBTEST.COM'} at 127.0.0.1:58206
I20260808 04:40:36.679925 22214 tablet_copy_service.cc:433] P 218c9b6c6aa34ef291292aab18539744: ending tablet copy session 4d013e883a6b4893b49cafa319d3eb20-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 4d013e883a6b4893b49cafa319d3eb20
I20260808 04:40:36.687522 23019 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:36.689206 23296 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:36.689297 23302 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:36.689841 23019 server_base.cc:1034] running on GCE node
W20260808 04:40:36.690017 23299 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:36.690241 23019 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:36.690531 23019 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:36.691676 23019 hybrid_clock.cc:648] HybridClock initialized: now 1786164036691664 us; error 31 us; skew 500 ppm
Aug 08 04:40:36 dist-test-slave-t7g5 krb5kdc[22121](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164036, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.148.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:36.693276 23019 init.cc:377] Logged in from keytab as oryx/127.12.148.124@KRBTEST.COM (short username oryx)
I20260808 04:40:36.693774 23019 webserver.cc:460] Webserver started at http://127.12.148.124:43815/ using document root <none> and password file <none>
I20260808 04:40:36.693955 23019 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:36.693989 23019 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:36.695241 23019 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 04:40:36.696501 23309 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:36.696750 23019 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 04:40:36.696867 23019 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-2/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-2/wal
uuid: "4d013e883a6b4893b49cafa319d3eb20"
format_stamp: "Formatted at 2026-08-08 04:40:36 on dist-test-slave-t7g5"
server_key: "a7f81d52c9093d46795ab8654415ac54"
server_key_iv: "72b7c5569442d32de059d80bc9814a9b"
server_key_version: "encryptionkey@0"
I20260808 04:40:36.697003 23019 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:36.728945 23019 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:36.731002 23019 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:36.735674 23019 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.124:35345
I20260808 04:40:36.735723 23384 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.124:35345 every 8 connection(s)
I20260808 04:40:36.736378 23019 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/master-2/data/info.pb
I20260808 04:40:36.738284 23387 sys_catalog.cc:263] Verifying existing consensus state
I20260808 04:40:36.739354 23387 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20: Bootstrap starting.
W20260808 04:40:36.749631 23278 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:36.749889 23278 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:36.749964 23278 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260808 04:40:36.750069 23387 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 04:40:36.750344 23387 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20: Bootstrap complete.
I20260808 04:40:36.750880 23387 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: false } } peers { permanent_uuid: "4d013e883a6b4893b49cafa319d3eb20" member_type: NON_VOTER last_known_addr { host: "127.12.148.124" port: 35345 } attrs { promote: true } }
I20260808 04:40:36.751011 23387 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4d013e883a6b4893b49cafa319d3eb20, State: Initialized, Role: LEARNER
I20260808 04:40:36.751112 23387 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: false } } peers { permanent_uuid: "4d013e883a6b4893b49cafa319d3eb20" member_type: NON_VOTER last_known_addr { host: "127.12.148.124" port: 35345 } attrs { promote: true } }
I20260808 04:40:36.751451 23401 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: false } } peers { permanent_uuid: "4d013e883a6b4893b49cafa319d3eb20" member_type: NON_VOTER last_known_addr { host: "127.12.148.124" port: 35345 } attrs { promote: true } } }
I20260808 04:40:36.751555 23387 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:40:36.751649 23401 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [sys.catalog]: This master's current role is: LEARNER
I20260808 04:40:36.754228 23417 catalog_manager.cc:1259] Loaded cluster ID: 3f5f41c2104c4ce39c1596eb686339ce
I20260808 04:40:36.754346 23417 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20: loading cluster ID for follower catalog manager: success
W20260808 04:40:36.754881 23278 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:36.754961 23278 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:36.755050 23278 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.65
I20260808 04:40:36.756548 23417 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20: acquiring CA information for follower catalog manager: success
I20260808 04:40:36.757966 23417 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 04:40:36.761070 23278 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:38949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.65.keytab
--principal=oryx/127.12.148.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.65:40203
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.148.65
--webserver_port=43941
--tserver_master_addrs=127.12.148.126:41335,127.12.148.125:41193,127.12.148.124:35345
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23278
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.65
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:36.762027 23278 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:36.762959 23278 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 04:40:36.763500 22658 heartbeater.cc:503] Master 127.12.148.126:41335 was elected leader, sending a full tablet report...
W20260808 04:40:36.772109 23420 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:36.772105 23421 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:36.772107 23423 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:36.772466 23278 server_base.cc:1034] running on GCE node
I20260808 04:40:36.772804 23278 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:36.773356 23278 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:36.774505 23278 hybrid_clock.cc:648] HybridClock initialized: now 1786164036774489 us; error 26 us; skew 500 ppm
Aug 08 04:40:36 dist-test-slave-t7g5 krb5kdc[22121](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164036, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.148.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:36.777133 23278 init.cc:377] Logged in from keytab as oryx/127.12.148.65@KRBTEST.COM (short username oryx)
I20260808 04:40:36.777942 23278 webserver.cc:460] Webserver started at http://127.12.148.65:43941/ using document root <none> and password file <none>
I20260808 04:40:36.778450 23278 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:36.778532 23278 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:36.782116 23278 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:40:36.783962 23435 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:36.785080 23278 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:40:36.785194 23278 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-0/wal
uuid: "6867e539dee64800a41f50fc525ffba2"
format_stamp: "Formatted at 2026-08-08 04:40:35 on dist-test-slave-t7g5"
server_key: "c95fadefa30a51f3aa738ccdfe88a05d"
server_key_iv: "c74a98980ec9bede539762ef1943d743"
server_key_version: "encryptionkey@0"
I20260808 04:40:36.785709 23278 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:36.802446 23278 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:36.805347 23278 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:36.805531 23278 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:36.806098 23278 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:36.806914 23278 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:36.806967 23278 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:36.807018 23278 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:36.807047 23278 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:36.815258 23278 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.65:40203
I20260808 04:40:36.815284 23594 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.65:40203 every 8 connection(s)
I20260808 04:40:36.816211 23278 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
I20260808 04:40:36.820323 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 23278
I20260808 04:40:36.820523 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 22469
I20260808 04:40:36.836652 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.66:46085
--local_ip_for_outbound_sockets=127.12.148.66
--tserver_master_addrs=127.12.148.126:41335
--webserver_port=46673
--webserver_interface=127.12.148.66
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.66.keytab
--principal=oryx/127.12.148.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:38949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.12.148.126:41335,127.12.148.125:41193
--tserver_master_addrs=127.12.148.126:41335,127.12.148.125:41193,127.12.148.124:35345 with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 04:40:36 dist-test-slave-t7g5 krb5kdc[22121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164036, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.148.65@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM
Aug 08 04:40:36 dist-test-slave-t7g5 krb5kdc[22121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164036, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.148.65@KRBTEST.COM for oryx/127.12.148.124@KRBTEST.COM
Aug 08 04:40:36 dist-test-slave-t7g5 krb5kdc[22121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164036, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.148.65@KRBTEST.COM for oryx/127.12.148.125@KRBTEST.COM
I20260808 04:40:36.843029 22242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.817947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:46781 (local address 127.12.148.126:41335)
0808 04:40:36.818087 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:36.818090 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:36.819321 (+ 1231us) server_negotiation.cc:407] Connection header received
0808 04:40:36.831470 (+ 12149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:36.831474 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:36.831531 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:36.831585 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:36.832775 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.833531 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.835291 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.835627 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.835705 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.838564 (+ 2859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:36.838568 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:36.838570 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:36.838595 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:36.839901 (+ 1306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.841223 (+ 1322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.841227 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.841229 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.841329 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.841754 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.841757 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.841759 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.841993 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:36.842075 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:36.842726 (+ 651us) server_negotiation.cc:299] Negotiation successful
0808 04:40:36.842862 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 04:40:36.843523 23252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.820045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:39675 (local address 127.12.148.125:41193)
0808 04:40:36.820163 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:36.820166 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:36.820493 (+ 327us) server_negotiation.cc:407] Connection header received
0808 04:40:36.830270 (+ 9777us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:36.830274 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:36.830352 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:36.830405 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:36.832313 (+ 1908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.833078 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.834704 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.835030 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.835101 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.839924 (+ 4823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:36.839927 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:36.839930 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:36.839958 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:36.841573 (+ 1615us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.842173 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.842176 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.842178 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.842280 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.842592 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.842596 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.842598 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.842813 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:36.842896 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:36.843245 (+ 349us) server_negotiation.cc:299] Negotiation successful
0808 04:40:36.843371 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 04:40:36.844439 23600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.819588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:35345 (local address 127.12.148.65:51883)
0808 04:40:36.820170 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:36.820184 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:36.829935 (+ 9751us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:36.830698 (+ 763us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:36.830708 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:36.831303 (+ 595us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:36.832174 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.832184 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.833551 (+ 1367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.833554 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.834524 (+ 970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.834533 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.835276 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.835281 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.835550 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.836246 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:36.836259 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:36.838756 (+ 2497us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:36.841699 (+ 2943us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.841702 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.841704 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.842048 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.842330 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.842348 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.842349 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.842435 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.842865 (+ 430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:36.842867 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:36.842947 (+ 80us) client_negotiation.cc:769] Sending connection context
0808 04:40:36.843040 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 04:40:36.843384 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":516,"mutex_wait_us":191,"spinlock_wait_cycles":11264,"thread_start_us":78,"threads_started":1}
I20260808 04:40:36.844447 23604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.819892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.125:41193 (local address 127.12.148.65:39675)
0808 04:40:36.820407 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:36.820421 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:36.830152 (+ 9731us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:36.830698 (+ 546us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:36.830708 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:36.831303 (+ 595us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:36.832134 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.832156 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.833253 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.833256 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.834570 (+ 1314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.834580 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.835276 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.835280 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.835542 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.836208 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:36.836230 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:36.839791 (+ 3561us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:36.841720 (+ 1929us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.841723 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.841726 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.842059 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.842393 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.842396 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.842398 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.842487 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.842956 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:36.842959 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:36.843047 (+ 88us) client_negotiation.cc:769] Sending connection context
0808 04:40:36.843657 (+ 610us) client_negotiation.cc:240] Negotiation successful
0808 04:40:36.843799 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":459,"mutex_wait_us":95,"spinlock_wait_cycles":65536,"thread_start_us":78,"threads_started":1}
I20260808 04:40:36.845109 23599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.818332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.12.148.65:46781)
0808 04:40:36.819176 (+ 844us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:36.819217 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:36.829921 (+ 10704us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:36.831784 (+ 1863us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:36.831786 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:36.831974 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:36.832618 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.832628 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.833730 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.833733 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.835161 (+ 1428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:36.835170 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.836252 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.836256 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:36.836348 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.836786 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:36.836799 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:36.838380 (+ 1581us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:36.840007 (+ 1627us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.840013 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.840029 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.841094 (+ 1065us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.841443 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:36.841446 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:36.841448 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:36.841622 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:36.842138 (+ 516us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:36.842144 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:36.842439 (+ 295us) client_negotiation.cc:769] Sending connection context
0808 04:40:36.843916 (+ 1477us) client_negotiation.cc:240] Negotiation successful
0808 04:40:36.844051 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":665,"mutex_wait_us":539,"thread_start_us":519,"threads_started":1}
I20260808 04:40:36.845177 23603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:36.819748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:51883 (local address 127.12.148.124:35345)
0808 04:40:36.819988 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:36.820007 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:36.820270 (+ 263us) server_negotiation.cc:407] Connection header received
0808 04:40:36.830310 (+ 10040us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:36.830313 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:36.830372 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:36.830454 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:36.832320 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.833426 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.834644 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:36.835011 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:36.835106 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:36.838887 (+ 3781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:36.838890 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:36.838893 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:36.838950 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:36.841558 (+ 2608us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.842143 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.842146 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.842148 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.842233 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:36.842546 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:36.842549 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:36.842551 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:36.842759 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:36.844794 (+ 2035us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:36.844886 (+ 92us) server_negotiation.cc:299] Negotiation successful
0808 04:40:36.845015 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":80,"threads_started":1}
I20260808 04:40:36.845865 23597 heartbeater.cc:347] Connected to a master server at 127.12.148.125:41193
I20260808 04:40:36.845942 23595 heartbeater.cc:347] Connected to a master server at 127.12.148.124:35345
I20260808 04:40:36.846107 23597 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:36.846107 23595 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:36.846686 23595 heartbeater.cc:511] Master 127.12.148.124:35345 requested a full tablet report, sending...
I20260808 04:40:36.846688 23597 heartbeater.cc:511] Master 127.12.148.125:41193 requested a full tablet report, sending...
I20260808 04:40:36.846836 23596 heartbeater.cc:347] Connected to a master server at 127.12.148.126:41335
I20260808 04:40:36.846903 23596 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:36.847043 23596 heartbeater.cc:511] Master 127.12.148.126:41335 requested a full tablet report, sending...
I20260808 04:40:36.848105 22182 ts_manager.cc:194] Re-registered known tserver with Master: 6867e539dee64800a41f50fc525ffba2 (127.12.148.65:40203)
I20260808 04:40:36.848400 23077 ts_manager.cc:194] Registered new tserver with Master: 6867e539dee64800a41f50fc525ffba2 (127.12.148.65:40203)
I20260808 04:40:36.848691 22182 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.148.65@KRBTEST.COM'} at 127.12.148.65:46781
I20260808 04:40:36.849577 23336 ts_manager.cc:194] Registered new tserver with Master: 6867e539dee64800a41f50fc525ffba2 (127.12.148.65:40203)
W20260808 04:40:36.953006 23605 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:36.953263 23605 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:36.953307 23605 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:36.957355 23605 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:36.957417 23605 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:36.957480 23605 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.66
I20260808 04:40:36.962651 23605 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:38949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.66.keytab
--principal=oryx/127.12.148.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.66:46085
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.148.66
--webserver_port=46673
--tserver_master_addrs=127.12.148.126:41335,127.12.148.125:41193,127.12.148.124:35345
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23605
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.66
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:36.963640 23605 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:36.964612 23605 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:36.973841 23614 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:36.973872 23612 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:36.973901 23611 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:36.974081 23605 server_base.cc:1034] running on GCE node
I20260808 04:40:36.974385 22856 heartbeater.cc:503] Master 127.12.148.126:41335 was elected leader, sending a full tablet report...
I20260808 04:40:36.974730 23605 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:36.975383 23605 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:36.976589 23605 hybrid_clock.cc:648] HybridClock initialized: now 1786164036976566 us; error 31 us; skew 500 ppm
Aug 08 04:40:36 dist-test-slave-t7g5 krb5kdc[22121](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164036, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.148.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:36.979260 23605 init.cc:377] Logged in from keytab as oryx/127.12.148.66@KRBTEST.COM (short username oryx)
I20260808 04:40:36.980127 23605 webserver.cc:460] Webserver started at http://127.12.148.66:46673/ using document root <none> and password file <none>
I20260808 04:40:36.980655 23605 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:36.980754 23605 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:36.984896 23605 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 04:40:36.986945 23624 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:36.988094 23605 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 04:40:36.988205 23605 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-1/wal
uuid: "dedcf4f874fd4a5a91d5ba4d784c2af0"
format_stamp: "Formatted at 2026-08-08 04:40:35 on dist-test-slave-t7g5"
server_key: "fa3d55b658264da116a16c2b33c93412"
server_key_iv: "648e6386c81dd4f27c54d6716f684679"
server_key_version: "encryptionkey@0"
I20260808 04:40:36.988746 23605 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:36.999634 23605 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:37.002449 23605 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:37.002614 23605 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:37.003185 23605 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:37.004038 23605 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:37.004096 23605 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:37.004149 23605 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:37.004179 23605 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:37.012971 23605 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.66:46085
I20260808 04:40:37.013041 23798 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.66:46085 every 8 connection(s)
I20260808 04:40:37.013974 23605 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
I20260808 04:40:37.024159 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 23605
I20260808 04:40:37.024344 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 22663
Aug 08 04:40:37 dist-test-slave-t7g5 krb5kdc[22121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164036, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.148.66@KRBTEST.COM for oryx/127.12.148.124@KRBTEST.COM
Aug 08 04:40:37 dist-test-slave-t7g5 krb5kdc[22121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164036, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.148.66@KRBTEST.COM for oryx/127.12.148.125@KRBTEST.COM
Aug 08 04:40:37 dist-test-slave-t7g5 krb5kdc[22121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164036, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.148.66@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM
I20260808 04:40:37.045257 23603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:37.017861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:43769 (local address 127.12.148.124:35345)
0808 04:40:37.017981 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:37.017986 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:37.018161 (+ 175us) server_negotiation.cc:407] Connection header received
0808 04:40:37.018454 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:37.018457 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:37.018513 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:37.018589 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:37.019984 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.020788 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.022090 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.022429 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.022525 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:37.040536 (+ 18011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:37.040541 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:37.040544 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:37.040578 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:37.042531 (+ 1953us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:37.043358 (+ 827us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:37.043362 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:37.043364 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:37.043455 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:37.043847 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:37.043851 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:37.043852 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:37.044106 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:37.044198 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:37.044962 (+ 764us) server_negotiation.cc:299] Negotiation successful
0808 04:40:37.045101 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 04:40:37.045261 23252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:37.017556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:39665 (local address 127.12.148.125:41193)
0808 04:40:37.017713 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:37.017718 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:37.017733 (+ 15us) server_negotiation.cc:407] Connection header received
0808 04:40:37.018479 (+ 746us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:37.018483 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:37.018538 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:37.018588 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:37.020004 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.020821 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.021903 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.022177 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.022275 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:37.040436 (+ 18161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:37.040440 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:37.040443 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:37.040477 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:37.042574 (+ 2097us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:37.043394 (+ 820us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:37.043397 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:37.043399 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:37.043601 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:37.043905 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:37.043909 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:37.043910 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:37.044134 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:37.044226 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:37.044956 (+ 730us) server_negotiation.cc:299] Negotiation successful
0808 04:40:37.045089 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 04:40:37.045261 22242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:37.015702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:52537 (local address 127.12.148.126:41335)
0808 04:40:37.015855 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:37.015859 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:37.017148 (+ 1289us) server_negotiation.cc:407] Connection header received
0808 04:40:37.018479 (+ 1331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:37.018482 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:37.018538 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:37.018588 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:37.019994 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.020529 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.022108 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.022381 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.022478 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:37.040776 (+ 18298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:37.040779 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:37.040782 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:37.040814 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:37.042476 (+ 1662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:37.043394 (+ 918us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:37.043397 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:37.043399 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:37.043498 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:37.043905 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:37.043909 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:37.043910 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:37.044134 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:37.044213 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:37.044956 (+ 743us) server_negotiation.cc:299] Negotiation successful
0808 04:40:37.045089 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 04:40:37.047019 23807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:37.017846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:35345 (local address 127.12.148.66:43769)
0808 04:40:37.018076 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:37.018089 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:37.018252 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:37.018780 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:37.018788 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:37.019256 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:37.019832 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:37.019846 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.020907 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.020910 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:37.021969 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:37.021980 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.022543 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.022546 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:37.022651 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:37.023187 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:37.023203 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:37.040191 (+ 16988us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:37.042672 (+ 2481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:37.042676 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:37.042678 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:37.043235 (+ 557us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:37.043557 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:37.043560 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:37.043562 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:37.043747 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:37.044268 (+ 521us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:37.044275 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:37.044670 (+ 395us) client_negotiation.cc:769] Sending connection context
0808 04:40:37.045442 (+ 772us) client_negotiation.cc:240] Negotiation successful
0808 04:40:37.045897 (+ 455us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"mutex_wait_us":212,"spinlock_wait_cycles":7808,"thread_start_us":70,"threads_started":1}
I20260808 04:40:37.047016 23805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:37.016127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.12.148.66:52537)
0808 04:40:37.016989 (+ 862us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:37.017031 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:37.018250 (+ 1219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:37.018781 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:37.018790 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:37.019297 (+ 507us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:37.019848 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:37.019854 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.020670 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.020672 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:37.021970 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:37.021980 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.022611 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.022615 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:37.022702 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:37.023322 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:37.023336 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:37.040584 (+ 17248us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:37.042632 (+ 2048us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:37.042640 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:37.042659 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:37.043274 (+ 615us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:37.043702 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:37.043705 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:37.043716 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:37.043806 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:37.044276 (+ 470us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:37.044279 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:37.044667 (+ 388us) client_negotiation.cc:769] Sending connection context
0808 04:40:37.045476 (+ 809us) client_negotiation.cc:240] Negotiation successful
0808 04:40:37.045975 (+ 499us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":680,"mutex_wait_us":389,"spinlock_wait_cycles":33792,"thread_start_us":533,"threads_started":1}
I20260808 04:40:37.047287 23806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:37.017383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.125:41193 (local address 127.12.148.66:39665)
0808 04:40:37.017646 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:37.017679 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:37.018250 (+ 571us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:37.018781 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:37.018790 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:37.019310 (+ 520us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:37.019844 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:37.019854 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.020943 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.020947 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:37.021790 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:37.021799 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.022319 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.022323 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:37.022504 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:37.023081 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:37.023096 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:37.040182 (+ 17086us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:37.042674 (+ 2492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:37.042677 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:37.042679 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:37.043274 (+ 595us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:37.043682 (+ 408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:37.043685 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:37.043687 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:37.043794 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:37.044276 (+ 482us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:37.044279 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:37.044667 (+ 388us) client_negotiation.cc:769] Sending connection context
0808 04:40:37.045476 (+ 809us) client_negotiation.cc:240] Negotiation successful
0808 04:40:37.046040 (+ 564us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"mutex_wait_us":348,"spinlock_wait_cycles":59904,"thread_start_us":87,"threads_started":1}
I20260808 04:40:37.048293 23802 heartbeater.cc:347] Connected to a master server at 127.12.148.125:41193
I20260808 04:40:37.048391 23800 heartbeater.cc:347] Connected to a master server at 127.12.148.124:35345
I20260808 04:40:37.048391 23801 heartbeater.cc:347] Connected to a master server at 127.12.148.126:41335
I20260808 04:40:37.048563 23802 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:37.048561 23800 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:37.048561 23801 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:37.048677 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.67:37211
--local_ip_for_outbound_sockets=127.12.148.67
--tserver_master_addrs=127.12.148.126:41335
--webserver_port=41113
--webserver_interface=127.12.148.67
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.67.keytab
--principal=oryx/127.12.148.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:38949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.12.148.126:41335,127.12.148.125:41193
--tserver_master_addrs=127.12.148.126:41335,127.12.148.125:41193,127.12.148.124:35345 with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 04:40:37.049156 23800 heartbeater.cc:511] Master 127.12.148.124:35345 requested a full tablet report, sending...
I20260808 04:40:37.049158 23801 heartbeater.cc:511] Master 127.12.148.126:41335 requested a full tablet report, sending...
I20260808 04:40:37.049157 23802 heartbeater.cc:511] Master 127.12.148.125:41193 requested a full tablet report, sending...
I20260808 04:40:37.050369 23336 ts_manager.cc:194] Registered new tserver with Master: dedcf4f874fd4a5a91d5ba4d784c2af0 (127.12.148.66:46085)
I20260808 04:40:37.050441 23077 ts_manager.cc:194] Registered new tserver with Master: dedcf4f874fd4a5a91d5ba4d784c2af0 (127.12.148.66:46085)
I20260808 04:40:37.050452 22182 ts_manager.cc:194] Re-registered known tserver with Master: dedcf4f874fd4a5a91d5ba4d784c2af0 (127.12.148.66:46085)
I20260808 04:40:37.051177 22182 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.148.66@KRBTEST.COM'} at 127.12.148.66:52537
I20260808 04:40:37.087285 23009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:37.083923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:35345 (local address 127.0.0.1:43398)
0808 04:40:37.084070 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:37.084085 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:37.084206 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:37.084465 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:37.084469 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:37.084490 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:37.084608 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:37.084615 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.085351 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.085354 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:37.086167 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:37.086178 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.086860 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.086863 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:37.086961 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:37.086985 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 04:40:37.087067 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 04:40:37.087145 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260808 04:40:37.087285 23603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:37.083977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43398 (local address 127.12.148.124:35345)
0808 04:40:37.084096 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:37.084100 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:37.084153 (+ 53us) server_negotiation.cc:407] Connection header received
0808 04:40:37.084306 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:37.084308 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:37.084361 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:37.084451 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:37.084718 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.085242 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.086296 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.086738 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.086851 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:37.086999 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:37.087081 (+ 82us) server_negotiation.cc:299] Negotiation successful
0808 04:40:37.087148 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 04:40:37.088033 23355 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260808 04:40:37.088511 23401 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 218c9b6c6aa34ef291292aab18539744. Latest consensus state: current_term: 1 leader_uuid: "218c9b6c6aa34ef291292aab18539744" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: false } } peers { permanent_uuid: "4d013e883a6b4893b49cafa319d3eb20" member_type: NON_VOTER last_known_addr { host: "127.12.148.124" port: 35345 } attrs { promote: true } } }
I20260808 04:40:37.088670 23401 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [sys.catalog]: This master's current role is: LEARNER
W20260808 04:40:37.162963 23810 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:37.163252 23810 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:37.163337 23810 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:37.167275 23810 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:37.167341 23810 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:37.167426 23810 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.67
I20260808 04:40:37.172626 23810 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:38949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.67.keytab
--principal=oryx/127.12.148.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.67:37211
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.148.67
--webserver_port=41113
--tserver_master_addrs=127.12.148.126:41335,127.12.148.125:41193,127.12.148.124:35345
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23810
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.67
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:37.173693 23810 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:37.174678 23810 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:37.184122 23818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:37.184151 23816 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:37.184151 23815 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:37.184495 23810 server_base.cc:1034] running on GCE node
I20260808 04:40:37.184881 23810 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:37.185528 23810 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:37.186710 23810 hybrid_clock.cc:648] HybridClock initialized: now 1786164037186689 us; error 32 us; skew 500 ppm
Aug 08 04:40:37 dist-test-slave-t7g5 krb5kdc[22121](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164037, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.148.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:37.189949 23810 init.cc:377] Logged in from keytab as oryx/127.12.148.67@KRBTEST.COM (short username oryx)
I20260808 04:40:37.191069 23810 webserver.cc:460] Webserver started at http://127.12.148.67:41113/ using document root <none> and password file <none>
I20260808 04:40:37.191795 23810 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:37.191911 23810 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:37.197276 23810 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 04:40:37.199856 23829 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:37.201258 23810 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 04:40:37.201380 23810 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-2/wal
uuid: "48c5ece7716c44a4bf4e1491ec34eedd"
format_stamp: "Formatted at 2026-08-08 04:40:35 on dist-test-slave-t7g5"
server_key: "a23bd74b627e0f7e9f908db567749abb"
server_key_iv: "ba6ae2ac72c40b5c0c30b976377c71c6"
server_key_version: "encryptionkey@0"
I20260808 04:40:37.202170 23810 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:37.234515 23810 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:37.237819 23810 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:37.238019 23810 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:37.238622 23810 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:37.239488 23810 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:37.239542 23810 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:37.239586 23810 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:37.239610 23810 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:37.249248 23810 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.67:37211
I20260808 04:40:37.249277 23998 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.67:37211 every 8 connection(s)
I20260808 04:40:37.250289 23810 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
I20260808 04:40:37.258057 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 23810
Aug 08 04:40:37 dist-test-slave-t7g5 krb5kdc[22121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164037, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.148.67@KRBTEST.COM for oryx/127.12.148.124@KRBTEST.COM
Aug 08 04:40:37 dist-test-slave-t7g5 krb5kdc[22121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164037, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.148.67@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM
Aug 08 04:40:37 dist-test-slave-t7g5 krb5kdc[22121](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164037, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.148.67@KRBTEST.COM for oryx/127.12.148.125@KRBTEST.COM
I20260808 04:40:37.271207 23603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:37.254609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:44309 (local address 127.12.148.124:35345)
0808 04:40:37.254731 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:37.254735 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:37.254748 (+ 13us) server_negotiation.cc:407] Connection header received
0808 04:40:37.254789 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:37.254792 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:37.254832 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:37.254901 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:37.256223 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.257040 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.258868 (+ 1828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.259204 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.259281 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:37.264894 (+ 5613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:37.264898 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:37.264901 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:37.264926 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:37.268267 (+ 3341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:37.268871 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:37.268875 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:37.268877 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:37.268973 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:37.269581 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:37.269585 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:37.269586 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:37.269841 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:37.269954 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:37.270904 (+ 950us) server_negotiation.cc:299] Negotiation successful
0808 04:40:37.271039 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 04:40:37.272341 24003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:37.252572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.12.148.67:53145)
0808 04:40:37.253444 (+ 872us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:37.253485 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:37.254488 (+ 1003us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:37.255088 (+ 600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:37.255097 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:37.255614 (+ 517us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:37.256090 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:37.256096 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.257180 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.257183 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:37.258724 (+ 1541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:37.258734 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.259493 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.259497 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:37.259807 (+ 310us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:37.262127 (+ 2320us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:37.262142 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:37.265798 (+ 3656us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:37.268263 (+ 2465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:37.268270 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:37.268287 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:37.268822 (+ 535us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:37.269123 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:37.269126 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:37.269128 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:37.269299 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:37.270007 (+ 708us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:37.270015 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:37.270420 (+ 405us) client_negotiation.cc:769] Sending connection context
0808 04:40:37.270626 (+ 206us) client_negotiation.cc:240] Negotiation successful
0808 04:40:37.270995 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":688,"mutex_wait_us":350,"spinlock_wait_cycles":37120,"thread_start_us":549,"threads_started":1}
I20260808 04:40:37.273123 22242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:37.252122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:53145 (local address 127.12.148.126:41335)
0808 04:40:37.252253 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:37.252257 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:37.253587 (+ 1330us) server_negotiation.cc:407] Connection header received
0808 04:40:37.254729 (+ 1142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:37.254733 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:37.254785 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:37.254865 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:37.256252 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.257037 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.258911 (+ 1874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.259243 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.259306 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:37.265911 (+ 6605us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:37.265915 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:37.265918 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:37.265947 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:37.268125 (+ 2178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:37.268931 (+ 806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:37.268935 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:37.268936 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:37.269022 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:37.269598 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:37.269602 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:37.269603 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:37.269854 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:37.269951 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:37.272863 (+ 2912us) server_negotiation.cc:299] Negotiation successful
0808 04:40:37.272977 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 04:40:37.273185 24020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:37.260721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43336 (local address 127.12.148.125:41193)
0808 04:40:37.260948 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:37.260951 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:37.261368 (+ 417us) server_negotiation.cc:407] Connection header received
0808 04:40:37.261505 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:37.261507 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:37.261556 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:37.261641 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:37.262823 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.263487 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.264416 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.264647 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.264731 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:37.266463 (+ 1732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:37.266467 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:37.266470 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:37.266495 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:37.270094 (+ 3599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:37.271787 (+ 1693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:37.271790 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:37.271792 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:37.271881 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:37.272209 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:37.272212 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:37.272214 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:37.272435 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:37.272540 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:37.272888 (+ 348us) server_negotiation.cc:299] Negotiation successful
0808 04:40:37.273025 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":74,"threads_started":1}
I20260808 04:40:37.273789 24006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:37.254235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:35345 (local address 127.12.148.67:44309)
0808 04:40:37.254465 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:37.254479 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:37.254568 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:37.255087 (+ 519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:37.255094 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:37.255591 (+ 497us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:37.256075 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:37.256089 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.257180 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.257183 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:37.258724 (+ 1541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:37.258734 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.259493 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.259497 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:37.259805 (+ 308us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:37.261908 (+ 2103us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:37.261928 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:37.264742 (+ 2814us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:37.268372 (+ 3630us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:37.268375 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:37.268377 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:37.268671 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:37.269388 (+ 717us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:37.269391 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:37.269393 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:37.269473 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:37.270011 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:37.270014 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:37.270421 (+ 407us) client_negotiation.cc:769] Sending connection context
0808 04:40:37.270630 (+ 209us) client_negotiation.cc:240] Negotiation successful
0808 04:40:37.273588 (+ 2958us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"mutex_wait_us":2881,"spinlock_wait_cycles":14208,"thread_start_us":83,"threads_started":1}
I20260808 04:40:37.274232 24000 heartbeater.cc:347] Connected to a master server at 127.12.148.126:41335
I20260808 04:40:37.274497 24000 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:37.274721 24021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:37.261127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43400 (local address 127.12.148.124:35345)
0808 04:40:37.261427 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:37.261431 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:37.262654 (+ 1223us) server_negotiation.cc:407] Connection header received
0808 04:40:37.262856 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:37.262860 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:37.262912 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:37.262970 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:37.263798 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.264556 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.265789 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.266461 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.266530 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:37.269435 (+ 2905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:37.269439 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:37.269441 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:37.269464 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:37.272031 (+ 2567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:37.272701 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:37.272704 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:37.272706 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:37.272797 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:37.273094 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:37.273098 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:37.273100 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:37.273645 (+ 545us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:37.273772 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:37.274427 (+ 655us) server_negotiation.cc:299] Negotiation successful
0808 04:40:37.274562 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":70,"threads_started":1}
I20260808 04:40:37.275044 24000 heartbeater.cc:511] Master 127.12.148.126:41335 requested a full tablet report, sending...
I20260808 04:40:37.275548 24004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:37.253900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.125:41193 (local address 127.12.148.67:38039)
0808 04:40:37.254157 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:37.254171 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:37.254492 (+ 321us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:37.255088 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:37.255097 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:37.255652 (+ 555us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:37.256087 (+ 435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:37.256096 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.257863 (+ 1767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.257887 (+ 24us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:37.258737 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:37.258748 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.259540 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.259544 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:37.259773 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:37.262008 (+ 2235us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:37.262024 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:37.266105 (+ 4081us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:37.268383 (+ 2278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:37.268386 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:37.268388 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:37.274187 (+ 5799us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:37.274511 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:37.274513 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:37.274516 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:37.274602 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:37.275031 (+ 429us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:37.275034 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:37.275115 (+ 81us) client_negotiation.cc:769] Sending connection context
0808 04:40:37.275252 (+ 137us) client_negotiation.cc:240] Negotiation successful
0808 04:40:37.275382 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"mutex_wait_us":59,"spinlock_wait_cycles":16512,"thread_start_us":92,"threads_started":1}
I20260808 04:40:37.275573 23252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:37.254050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:38039 (local address 127.12.148.125:41193)
0808 04:40:37.254177 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:37.254182 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:37.254249 (+ 67us) server_negotiation.cc:407] Connection header received
0808 04:40:37.254729 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:37.254733 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:37.254785 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:37.254837 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:37.257178 (+ 2341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.257727 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.258892 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.259216 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.259327 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:37.266265 (+ 6938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:37.266269 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:37.266272 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:37.266300 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:37.268256 (+ 1956us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:37.274300 (+ 6044us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:37.274304 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:37.274306 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:37.274400 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:37.274706 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:37.274710 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:37.274712 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:37.274920 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:37.275029 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:37.275317 (+ 288us) server_negotiation.cc:299] Negotiation successful
0808 04:40:37.275427 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 04:40:37.276142 23999 heartbeater.cc:347] Connected to a master server at 127.12.148.124:35345
I20260808 04:40:37.276222 23999 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:37.276243 22182 ts_manager.cc:194] Re-registered known tserver with Master: 48c5ece7716c44a4bf4e1491ec34eedd (127.12.148.67:37211)
I20260808 04:40:37.276367 23999 heartbeater.cc:511] Master 127.12.148.124:35345 requested a full tablet report, sending...
I20260808 04:40:37.276441 24001 heartbeater.cc:347] Connected to a master server at 127.12.148.125:41193
I20260808 04:40:37.276520 24001 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:37.276664 24001 heartbeater.cc:511] Master 127.12.148.125:41193 requested a full tablet report, sending...
I20260808 04:40:37.276965 22182 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.148.67@KRBTEST.COM'} at 127.12.148.67:53145
I20260808 04:40:37.276988 23336 ts_manager.cc:194] Registered new tserver with Master: 48c5ece7716c44a4bf4e1491ec34eedd (127.12.148.67:37211)
I20260808 04:40:37.277696 23077 ts_manager.cc:194] Registered new tserver with Master: 48c5ece7716c44a4bf4e1491ec34eedd (127.12.148.67:37211)
I20260808 04:40:37.278666 24015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:37.260317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58210 (local address 127.12.148.126:41335)
0808 04:40:37.260516 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:37.260519 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:37.261174 (+ 655us) server_negotiation.cc:407] Connection header received
0808 04:40:37.261220 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:37.261222 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:37.261273 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:37.261365 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:37.266561 (+ 5196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.267353 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.268416 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.268741 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.268809 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:37.270649 (+ 1840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:37.270653 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:37.270655 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:37.270677 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:37.272313 (+ 1636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:37.272787 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:37.272791 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:37.272793 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:37.272894 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:37.273196 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:37.273200 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:37.273201 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:37.273404 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:37.276606 (+ 3202us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:37.277214 (+ 608us) server_negotiation.cc:299] Negotiation successful
0808 04:40:37.277355 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"spinlock_wait_cycles":13696,"thread_start_us":65,"threads_started":1}
I20260808 04:40:37.281168 22182 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58210:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:40:37.284997 22182 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:40:37.287678 23286 sys_catalog.cc:455] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "218c9b6c6aa34ef291292aab18539744" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: false } } peers { permanent_uuid: "4d013e883a6b4893b49cafa319d3eb20" member_type: NON_VOTER last_known_addr { host: "127.12.148.124" port: 35345 } attrs { promote: true } } }
I20260808 04:40:37.287811 23286 sys_catalog.cc:458] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:37.291181 24026 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744: attempting to promote NON_VOTER 4d013e883a6b4893b49cafa319d3eb20 to VOTER
I20260808 04:40:37.291549 24026 consensus_queue.cc:237] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: false } } peers { permanent_uuid: "4d013e883a6b4893b49cafa319d3eb20" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 35345 } attrs { promote: false } }
I20260808 04:40:37.292912 23355 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [term 1 LEARNER]: Refusing update from remote peer 218c9b6c6aa34ef291292aab18539744: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260808 04:40:37.293433 23286 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d013e883a6b4893b49cafa319d3eb20" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 35345 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260808 04:40:37.293642 23094 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [term 1 FOLLOWER]: Refusing update from remote peer 218c9b6c6aa34ef291292aab18539744: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260808 04:40:37.294333 23286 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260808 04:40:37.295536 24027 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 4d013e883a6b4893b49cafa319d3eb20 (127.12.148.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: false } } peers { permanent_uuid: "4d013e883a6b4893b49cafa319d3eb20" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 35345 } attrs { promote: false } } }
I20260808 04:40:37.296046 23355 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 4d013e883a6b4893b49cafa319d3eb20 (127.12.148.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: false } } peers { permanent_uuid: "4d013e883a6b4893b49cafa319d3eb20" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 35345 } attrs { promote: false } } }
I20260808 04:40:37.296840 23286 sys_catalog.cc:455] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "218c9b6c6aa34ef291292aab18539744" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: false } } peers { permanent_uuid: "4d013e883a6b4893b49cafa319d3eb20" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 35345 } attrs { promote: false } } }
I20260808 04:40:37.296954 23286 sys_catalog.cc:458] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:37.297716 24027 sys_catalog.cc:455] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "218c9b6c6aa34ef291292aab18539744" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: false } } peers { permanent_uuid: "4d013e883a6b4893b49cafa319d3eb20" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 35345 } attrs { promote: false } } }
I20260808 04:40:37.297821 24027 sys_catalog.cc:458] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:37.297938 24027 sys_catalog.cc:455] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "218c9b6c6aa34ef291292aab18539744" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: false } } peers { permanent_uuid: "4d013e883a6b4893b49cafa319d3eb20" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 35345 } attrs { promote: false } } }
I20260808 04:40:37.298020 24027 sys_catalog.cc:458] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:37.298039 23094 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 4d013e883a6b4893b49cafa319d3eb20 (127.12.148.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: false } } peers { permanent_uuid: "4d013e883a6b4893b49cafa319d3eb20" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 35345 } attrs { promote: false } } }
I20260808 04:40:37.298484 23401 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "218c9b6c6aa34ef291292aab18539744" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: false } } peers { permanent_uuid: "4d013e883a6b4893b49cafa319d3eb20" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 35345 } attrs { promote: false } } }
I20260808 04:40:37.298590 23401 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:40:37.301118 24035 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "218c9b6c6aa34ef291292aab18539744" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: false } } peers { permanent_uuid: "4d013e883a6b4893b49cafa319d3eb20" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 35345 } attrs { promote: false } } }
I20260808 04:40:37.301251 24035 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:40:37.306270 24042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:37.300991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:40203 (local address 127.0.0.1:55534)
0808 04:40:37.301767 (+ 776us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:37.301780 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:37.301967 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:37.302475 (+ 508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:37.302478 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:37.302496 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:37.302582 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:37.302589 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.303617 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.303620 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:37.304949 (+ 1329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:37.304960 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.305846 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.305850 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:37.305960 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:37.305983 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 04:40:37.306061 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 04:40:37.306132 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":708,"thread_start_us":105,"threads_started":1}
I20260808 04:40:37.306314 24038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:37.300705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55534 (local address 127.12.148.65:40203)
0808 04:40:37.300965 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:37.300984 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:37.301877 (+ 893us) server_negotiation.cc:407] Connection header received
0808 04:40:37.302138 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:37.302144 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:37.302340 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:37.302496 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:37.302710 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.303520 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.305106 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.305736 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.305834 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:37.305991 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:37.306093 (+ 102us) server_negotiation.cc:299] Negotiation successful
0808 04:40:37.306187 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":64,"threads_started":1}
I20260808 04:40:37.306422 23009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:37.300866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.67:37211 (local address 127.0.0.1:40780)
0808 04:40:37.301171 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:37.301186 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:37.301265 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:37.302154 (+ 889us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:37.302157 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:37.302174 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:37.302280 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:37.302286 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.303869 (+ 1583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.303873 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:37.304953 (+ 1080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:37.304960 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.306071 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.306076 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:37.306164 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:37.306189 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 04:40:37.306237 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 04:40:37.306304 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230}
I20260808 04:40:37.306991 24041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:37.301165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40780 (local address 127.12.148.67:37211)
0808 04:40:37.301630 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:37.301643 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:37.301691 (+ 48us) server_negotiation.cc:407] Connection header received
0808 04:40:37.301773 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:37.301779 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:37.302024 (+ 245us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:37.302200 (+ 176us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:37.302817 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.303756 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.305080 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.305938 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.306560 (+ 622us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:37.306706 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:37.306755 (+ 49us) server_negotiation.cc:299] Negotiation successful
0808 04:40:37.306837 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":368,"thread_start_us":151,"threads_started":1}
I20260808 04:40:37.308880 24043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:37.301518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48734 (local address 127.12.148.66:46085)
0808 04:40:37.302011 (+ 493us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:37.302024 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:37.304079 (+ 2055us) server_negotiation.cc:407] Connection header received
0808 04:40:37.304182 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:37.304187 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:37.304334 (+ 147us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:37.304464 (+ 130us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:37.304667 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.305576 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.307743 (+ 2167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.308323 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.308429 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:37.308566 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:37.308655 (+ 89us) server_negotiation.cc:299] Negotiation successful
0808 04:40:37.308739 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":403,"thread_start_us":188,"threads_started":1}
I20260808 04:40:37.308939 24039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:37.301480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:46085 (local address 127.0.0.1:48734)
0808 04:40:37.303980 (+ 2500us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:37.303991 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:37.304080 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:37.304461 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:37.304463 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:37.304479 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:37.304564 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:37.304570 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.305731 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.305735 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:37.307604 (+ 1869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:37.307616 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.308442 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.308446 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:37.308529 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:37.308551 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 04:40:37.308628 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 04:40:37.308698 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2447,"thread_start_us":86,"threads_started":1}
I20260808 04:40:37.309726 23501 tablet_service.cc:1467] Processing CreateTablet for tablet 642170df43b54d2dbf1c9d58d5d0cbf5 (DEFAULT_TABLE table=test-table [id=d912f7d17a6a4e89b2d46f6c441bf564]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:37.309725 23902 tablet_service.cc:1467] Processing CreateTablet for tablet 642170df43b54d2dbf1c9d58d5d0cbf5 (DEFAULT_TABLE table=test-table [id=d912f7d17a6a4e89b2d46f6c441bf564]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:37.310892 23501 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 642170df43b54d2dbf1c9d58d5d0cbf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:37.310892 23902 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 642170df43b54d2dbf1c9d58d5d0cbf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:37.316088 23694 tablet_service.cc:1467] Processing CreateTablet for tablet 642170df43b54d2dbf1c9d58d5d0cbf5 (DEFAULT_TABLE table=test-table [id=d912f7d17a6a4e89b2d46f6c441bf564]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:37.316968 23694 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 642170df43b54d2dbf1c9d58d5d0cbf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:37.319233 24045 tablet_bootstrap.cc:492] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 48c5ece7716c44a4bf4e1491ec34eedd: Bootstrap starting.
I20260808 04:40:37.320539 24046 tablet_bootstrap.cc:492] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 6867e539dee64800a41f50fc525ffba2: Bootstrap starting.
I20260808 04:40:37.321630 24045 tablet_bootstrap.cc:654] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 48c5ece7716c44a4bf4e1491ec34eedd: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:37.322325 24046 tablet_bootstrap.cc:654] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 6867e539dee64800a41f50fc525ffba2: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:37.322549 24045 log.cc:824] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 48c5ece7716c44a4bf4e1491ec34eedd: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:37.323058 24046 log.cc:824] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 6867e539dee64800a41f50fc525ffba2: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:37.324446 24049 tablet_bootstrap.cc:492] T 642170df43b54d2dbf1c9d58d5d0cbf5 P dedcf4f874fd4a5a91d5ba4d784c2af0: Bootstrap starting.
I20260808 04:40:37.324950 24046 tablet_bootstrap.cc:492] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 6867e539dee64800a41f50fc525ffba2: No bootstrap required, opened a new log
I20260808 04:40:37.324975 24045 tablet_bootstrap.cc:492] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 48c5ece7716c44a4bf4e1491ec34eedd: No bootstrap required, opened a new log
I20260808 04:40:37.325143 24045 ts_tablet_manager.cc:1397] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 48c5ece7716c44a4bf4e1491ec34eedd: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 04:40:37.325145 24046 ts_tablet_manager.cc:1397] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 6867e539dee64800a41f50fc525ffba2: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260808 04:40:37.326658 24049 tablet_bootstrap.cc:654] T 642170df43b54d2dbf1c9d58d5d0cbf5 P dedcf4f874fd4a5a91d5ba4d784c2af0: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:37.327443 24049 log.cc:824] T 642170df43b54d2dbf1c9d58d5d0cbf5 P dedcf4f874fd4a5a91d5ba4d784c2af0: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:37.328666 24045 raft_consensus.cc:348] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 48c5ece7716c44a4bf4e1491ec34eedd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6867e539dee64800a41f50fc525ffba2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40203 } } peers { permanent_uuid: "48c5ece7716c44a4bf4e1491ec34eedd" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37211 } } peers { permanent_uuid: "dedcf4f874fd4a5a91d5ba4d784c2af0" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 46085 } }
I20260808 04:40:37.328877 24045 raft_consensus.cc:374] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 48c5ece7716c44a4bf4e1491ec34eedd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:37.328931 24045 raft_consensus.cc:729] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 48c5ece7716c44a4bf4e1491ec34eedd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48c5ece7716c44a4bf4e1491ec34eedd, State: Initialized, Role: FOLLOWER
I20260808 04:40:37.329316 24045 consensus_queue.cc:260] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 48c5ece7716c44a4bf4e1491ec34eedd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6867e539dee64800a41f50fc525ffba2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40203 } } peers { permanent_uuid: "48c5ece7716c44a4bf4e1491ec34eedd" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37211 } } peers { permanent_uuid: "dedcf4f874fd4a5a91d5ba4d784c2af0" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 46085 } }
I20260808 04:40:37.329392 24046 raft_consensus.cc:348] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 6867e539dee64800a41f50fc525ffba2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6867e539dee64800a41f50fc525ffba2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40203 } } peers { permanent_uuid: "48c5ece7716c44a4bf4e1491ec34eedd" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37211 } } peers { permanent_uuid: "dedcf4f874fd4a5a91d5ba4d784c2af0" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 46085 } }
I20260808 04:40:37.329614 24049 tablet_bootstrap.cc:492] T 642170df43b54d2dbf1c9d58d5d0cbf5 P dedcf4f874fd4a5a91d5ba4d784c2af0: No bootstrap required, opened a new log
I20260808 04:40:37.329677 24046 raft_consensus.cc:374] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 6867e539dee64800a41f50fc525ffba2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:37.329825 24049 ts_tablet_manager.cc:1397] T 642170df43b54d2dbf1c9d58d5d0cbf5 P dedcf4f874fd4a5a91d5ba4d784c2af0: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.001s
I20260808 04:40:37.330248 24045 ts_tablet_manager.cc:1428] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 48c5ece7716c44a4bf4e1491ec34eedd: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260808 04:40:37.330374 24046 raft_consensus.cc:729] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 6867e539dee64800a41f50fc525ffba2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6867e539dee64800a41f50fc525ffba2, State: Initialized, Role: FOLLOWER
I20260808 04:40:37.330564 24000 heartbeater.cc:503] Master 127.12.148.126:41335 was elected leader, sending a full tablet report...
I20260808 04:40:37.330834 24046 consensus_queue.cc:260] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 6867e539dee64800a41f50fc525ffba2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6867e539dee64800a41f50fc525ffba2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40203 } } peers { permanent_uuid: "48c5ece7716c44a4bf4e1491ec34eedd" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37211 } } peers { permanent_uuid: "dedcf4f874fd4a5a91d5ba4d784c2af0" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 46085 } }
I20260808 04:40:37.331755 24046 ts_tablet_manager.cc:1428] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 6867e539dee64800a41f50fc525ffba2: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260808 04:40:37.331935 23596 heartbeater.cc:503] Master 127.12.148.126:41335 was elected leader, sending a full tablet report...
I20260808 04:40:37.337021 24049 raft_consensus.cc:348] T 642170df43b54d2dbf1c9d58d5d0cbf5 P dedcf4f874fd4a5a91d5ba4d784c2af0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6867e539dee64800a41f50fc525ffba2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40203 } } peers { permanent_uuid: "48c5ece7716c44a4bf4e1491ec34eedd" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37211 } } peers { permanent_uuid: "dedcf4f874fd4a5a91d5ba4d784c2af0" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 46085 } }
I20260808 04:40:37.337206 24049 raft_consensus.cc:374] T 642170df43b54d2dbf1c9d58d5d0cbf5 P dedcf4f874fd4a5a91d5ba4d784c2af0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:37.337260 24049 raft_consensus.cc:729] T 642170df43b54d2dbf1c9d58d5d0cbf5 P dedcf4f874fd4a5a91d5ba4d784c2af0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dedcf4f874fd4a5a91d5ba4d784c2af0, State: Initialized, Role: FOLLOWER
I20260808 04:40:37.337605 24049 consensus_queue.cc:260] T 642170df43b54d2dbf1c9d58d5d0cbf5 P dedcf4f874fd4a5a91d5ba4d784c2af0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6867e539dee64800a41f50fc525ffba2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40203 } } peers { permanent_uuid: "48c5ece7716c44a4bf4e1491ec34eedd" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37211 } } peers { permanent_uuid: "dedcf4f874fd4a5a91d5ba4d784c2af0" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 46085 } }
I20260808 04:40:37.338196 23801 heartbeater.cc:503] Master 127.12.148.126:41335 was elected leader, sending a full tablet report...
I20260808 04:40:37.338433 24049 ts_tablet_manager.cc:1428] T 642170df43b54d2dbf1c9d58d5d0cbf5 P dedcf4f874fd4a5a91d5ba4d784c2af0: Time spent starting tablet: real 0.009s user 0.003s sys 0.002s
I20260808 04:40:37.351940 24054 raft_consensus.cc:482] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 6867e539dee64800a41f50fc525ffba2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:40:37.352113 24054 raft_consensus.cc:504] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 6867e539dee64800a41f50fc525ffba2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6867e539dee64800a41f50fc525ffba2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40203 } } peers { permanent_uuid: "48c5ece7716c44a4bf4e1491ec34eedd" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37211 } } peers { permanent_uuid: "dedcf4f874fd4a5a91d5ba4d784c2af0" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 46085 } }
I20260808 04:40:37.353288 24054 leader_election.cc:288] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 6867e539dee64800a41f50fc525ffba2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48c5ece7716c44a4bf4e1491ec34eedd (127.12.148.67:37211), dedcf4f874fd4a5a91d5ba4d784c2af0 (127.12.148.66:46085)
I20260808 04:40:37.357527 24043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:37.353833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:45843 (local address 127.12.148.66:46085)
0808 04:40:37.353940 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:37.353944 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:37.354507 (+ 563us) server_negotiation.cc:407] Connection header received
0808 04:40:37.354552 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:37.354555 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:37.354594 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:37.354661 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:37.354899 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.355481 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.356453 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.357023 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.357136 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:37.357188 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:37.357345 (+ 157us) server_negotiation.cc:299] Negotiation successful
0808 04:40:37.357412 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 04:40:37.357547 24056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:37.353612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:46085 (local address 127.12.148.65:45843)
0808 04:40:37.354327 (+ 715us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:37.354338 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:37.354420 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:37.354691 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:37.354693 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:37.354711 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:37.354797 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:37.354803 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.355578 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.355581 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:37.356332 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:37.356340 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.357134 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.357138 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:37.357227 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:37.357252 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 04:40:37.357321 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 04:40:37.357388 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":661,"thread_start_us":91,"threads_started":1}
I20260808 04:40:37.358055 24041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:37.353927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:33949 (local address 127.12.148.67:37211)
0808 04:40:37.354026 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:37.354029 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:37.354040 (+ 11us) server_negotiation.cc:407] Connection header received
0808 04:40:37.354079 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:37.354081 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:37.354113 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:37.354174 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:37.354433 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.355119 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.356606 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.357162 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.357255 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:37.357287 (+ 32us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:37.357867 (+ 580us) server_negotiation.cc:299] Negotiation successful
0808 04:40:37.357946 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 04:40:37.358106 23726 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "642170df43b54d2dbf1c9d58d5d0cbf5" candidate_uuid: "6867e539dee64800a41f50fc525ffba2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dedcf4f874fd4a5a91d5ba4d784c2af0" is_pre_election: true
I20260808 04:40:37.358327 24058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:37.353478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.67:37211 (local address 127.12.148.65:33949)
0808 04:40:37.353900 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:37.353914 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:37.354002 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:37.354200 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:37.354203 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:37.354220 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:37.354322 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:37.354327 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.355232 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.355235 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:37.356484 (+ 1249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:37.356494 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.357347 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.357361 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:37.357456 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:37.357479 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 04:40:37.358120 (+ 641us) client_negotiation.cc:240] Negotiation successful
0808 04:40:37.358197 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":76,"threads_started":1}
I20260808 04:40:37.358366 23726 raft_consensus.cc:2454] T 642170df43b54d2dbf1c9d58d5d0cbf5 P dedcf4f874fd4a5a91d5ba4d784c2af0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6867e539dee64800a41f50fc525ffba2 in term 0.
I20260808 04:40:37.358780 23438 leader_election.cc:302] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 6867e539dee64800a41f50fc525ffba2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6867e539dee64800a41f50fc525ffba2, dedcf4f874fd4a5a91d5ba4d784c2af0; no voters:
I20260808 04:40:37.359066 24054 raft_consensus.cc:2781] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 6867e539dee64800a41f50fc525ffba2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:40:37.359179 24054 raft_consensus.cc:482] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 6867e539dee64800a41f50fc525ffba2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:40:37.359231 24054 raft_consensus.cc:3037] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 6867e539dee64800a41f50fc525ffba2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:37.359273 23929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "642170df43b54d2dbf1c9d58d5d0cbf5" candidate_uuid: "6867e539dee64800a41f50fc525ffba2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48c5ece7716c44a4bf4e1491ec34eedd" is_pre_election: true
I20260808 04:40:37.359544 23929 raft_consensus.cc:2454] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 48c5ece7716c44a4bf4e1491ec34eedd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6867e539dee64800a41f50fc525ffba2 in term 0.
I20260808 04:40:37.360428 24054 raft_consensus.cc:504] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 6867e539dee64800a41f50fc525ffba2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6867e539dee64800a41f50fc525ffba2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40203 } } peers { permanent_uuid: "48c5ece7716c44a4bf4e1491ec34eedd" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37211 } } peers { permanent_uuid: "dedcf4f874fd4a5a91d5ba4d784c2af0" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 46085 } }
I20260808 04:40:37.360726 24054 leader_election.cc:288] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 6867e539dee64800a41f50fc525ffba2 [CANDIDATE]: Term 1 election: Requested vote from peers 48c5ece7716c44a4bf4e1491ec34eedd (127.12.148.67:37211), dedcf4f874fd4a5a91d5ba4d784c2af0 (127.12.148.66:46085)
I20260808 04:40:37.361024 23726 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "642170df43b54d2dbf1c9d58d5d0cbf5" candidate_uuid: "6867e539dee64800a41f50fc525ffba2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dedcf4f874fd4a5a91d5ba4d784c2af0"
I20260808 04:40:37.361052 23929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "642170df43b54d2dbf1c9d58d5d0cbf5" candidate_uuid: "6867e539dee64800a41f50fc525ffba2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48c5ece7716c44a4bf4e1491ec34eedd"
I20260808 04:40:37.361140 23726 raft_consensus.cc:3037] T 642170df43b54d2dbf1c9d58d5d0cbf5 P dedcf4f874fd4a5a91d5ba4d784c2af0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:37.361142 23929 raft_consensus.cc:3037] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 48c5ece7716c44a4bf4e1491ec34eedd [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:37.362232 23726 raft_consensus.cc:2454] T 642170df43b54d2dbf1c9d58d5d0cbf5 P dedcf4f874fd4a5a91d5ba4d784c2af0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6867e539dee64800a41f50fc525ffba2 in term 1.
I20260808 04:40:37.362406 23929 raft_consensus.cc:2454] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 48c5ece7716c44a4bf4e1491ec34eedd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6867e539dee64800a41f50fc525ffba2 in term 1.
I20260808 04:40:37.362546 23438 leader_election.cc:302] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 6867e539dee64800a41f50fc525ffba2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6867e539dee64800a41f50fc525ffba2, dedcf4f874fd4a5a91d5ba4d784c2af0; no voters:
I20260808 04:40:37.362712 24054 raft_consensus.cc:2781] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 6867e539dee64800a41f50fc525ffba2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:37.362859 24054 raft_consensus.cc:686] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 6867e539dee64800a41f50fc525ffba2 [term 1 LEADER]: Becoming Leader. State: Replica: 6867e539dee64800a41f50fc525ffba2, State: Running, Role: LEADER
I20260808 04:40:37.363173 24054 consensus_queue.cc:237] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 6867e539dee64800a41f50fc525ffba2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6867e539dee64800a41f50fc525ffba2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40203 } } peers { permanent_uuid: "48c5ece7716c44a4bf4e1491ec34eedd" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37211 } } peers { permanent_uuid: "dedcf4f874fd4a5a91d5ba4d784c2af0" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 46085 } }
I20260808 04:40:37.366319 22182 catalog_manager.cc:5495] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 6867e539dee64800a41f50fc525ffba2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6867e539dee64800a41f50fc525ffba2 (127.12.148.65). New cstate: current_term: 1 leader_uuid: "6867e539dee64800a41f50fc525ffba2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6867e539dee64800a41f50fc525ffba2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48c5ece7716c44a4bf4e1491ec34eedd" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dedcf4f874fd4a5a91d5ba4d784c2af0" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 46085 } health_report { overall_health: UNKNOWN } } }
I20260808 04:40:37.383967 24038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:37.380967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55540 (local address 127.12.148.65:40203)
0808 04:40:37.381079 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:37.381082 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:37.381095 (+ 13us) server_negotiation.cc:407] Connection header received
0808 04:40:37.381207 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:37.381209 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:37.381257 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:37.381339 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:37.381525 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.382063 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.382823 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.383027 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.383100 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:37.383319 (+ 219us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:37.383703 (+ 384us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:37.383788 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:37.383817 (+ 29us) server_negotiation.cc:299] Negotiation successful
0808 04:40:37.383865 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 04:40:37.389549 23726 raft_consensus.cc:1261] T 642170df43b54d2dbf1c9d58d5d0cbf5 P dedcf4f874fd4a5a91d5ba4d784c2af0 [term 1 FOLLOWER]: Refusing update from remote peer 6867e539dee64800a41f50fc525ffba2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:37.389554 23929 raft_consensus.cc:1261] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 48c5ece7716c44a4bf4e1491ec34eedd [term 1 FOLLOWER]: Refusing update from remote peer 6867e539dee64800a41f50fc525ffba2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:37.390241 24054 consensus_queue.cc:1035] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 6867e539dee64800a41f50fc525ffba2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dedcf4f874fd4a5a91d5ba4d784c2af0" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 46085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:37.390432 24061 consensus_queue.cc:1035] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 6867e539dee64800a41f50fc525ffba2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48c5ece7716c44a4bf4e1491ec34eedd" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:37.406862 24070 mvcc.cc:205] Tried to move back new op lower bound from 7316127897141174272 to 7316127897042255872. Current Snapshot: MvccSnapshot[applied={T|T < 7316127897141174272 or (T in {7316127897141174272})}]
I20260808 04:40:37.409314 22181 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58210:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:37.409473 22181 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58210:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:37.413156 22181 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 218c9b6c6aa34ef291292aab18539744: Sending DeleteTablet for 3 replicas of tablet 642170df43b54d2dbf1c9d58d5d0cbf5
I20260808 04:40:37.414237 23902 tablet_service.cc:1514] Processing DeleteTablet for tablet 642170df43b54d2dbf1c9d58d5d0cbf5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:37 UTC) from {username='oryx', principal='oryx/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:40780
I20260808 04:40:37.414502 23501 tablet_service.cc:1514] Processing DeleteTablet for tablet 642170df43b54d2dbf1c9d58d5d0cbf5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:37 UTC) from {username='oryx', principal='oryx/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:55534
I20260808 04:40:37.414674 23694 tablet_service.cc:1514] Processing DeleteTablet for tablet 642170df43b54d2dbf1c9d58d5d0cbf5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:37 UTC) from {username='oryx', principal='oryx/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:48734
I20260808 04:40:37.414940 24082 tablet_replica.cc:330] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 6867e539dee64800a41f50fc525ffba2: stopping tablet replica
I20260808 04:40:37.415267 24084 tablet_replica.cc:330] T 642170df43b54d2dbf1c9d58d5d0cbf5 P dedcf4f874fd4a5a91d5ba4d784c2af0: stopping tablet replica
I20260808 04:40:37.415279 24082 raft_consensus.cc:2229] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 6867e539dee64800a41f50fc525ffba2 [term 1 LEADER]: Raft consensus shutting down.
I20260808 04:40:37.415637 24082 raft_consensus.cc:2258] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 6867e539dee64800a41f50fc525ffba2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:37.415643 24084 raft_consensus.cc:2229] T 642170df43b54d2dbf1c9d58d5d0cbf5 P dedcf4f874fd4a5a91d5ba4d784c2af0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:37.415998 24081 tablet_replica.cc:330] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 48c5ece7716c44a4bf4e1491ec34eedd: stopping tablet replica
I20260808 04:40:37.416119 24084 raft_consensus.cc:2258] T 642170df43b54d2dbf1c9d58d5d0cbf5 P dedcf4f874fd4a5a91d5ba4d784c2af0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:37.416299 24081 raft_consensus.cc:2229] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 48c5ece7716c44a4bf4e1491ec34eedd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:37.416617 24081 raft_consensus.cc:2258] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 48c5ece7716c44a4bf4e1491ec34eedd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:37.417768 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 22139
I20260808 04:40:37.423386 24081 ts_tablet_manager.cc:1905] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 48c5ece7716c44a4bf4e1491ec34eedd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:37.425822 24084 ts_tablet_manager.cc:1905] T 642170df43b54d2dbf1c9d58d5d0cbf5 P dedcf4f874fd4a5a91d5ba4d784c2af0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:37.426092 24081 ts_tablet_manager.cc:1918] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 48c5ece7716c44a4bf4e1491ec34eedd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:40:37.426203 24081 log.cc:1196] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 48c5ece7716c44a4bf4e1491ec34eedd: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-2/wal/wals/642170df43b54d2dbf1c9d58d5d0cbf5
I20260808 04:40:37.426542 24081 ts_tablet_manager.cc:1939] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 48c5ece7716c44a4bf4e1491ec34eedd: Deleting consensus metadata
I20260808 04:40:37.427598 24082 ts_tablet_manager.cc:1905] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 6867e539dee64800a41f50fc525ffba2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:37.430083 24084 ts_tablet_manager.cc:1918] T 642170df43b54d2dbf1c9d58d5d0cbf5 P dedcf4f874fd4a5a91d5ba4d784c2af0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:40:37.430243 24084 log.cc:1196] T 642170df43b54d2dbf1c9d58d5d0cbf5 P dedcf4f874fd4a5a91d5ba4d784c2af0: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-1/wal/wals/642170df43b54d2dbf1c9d58d5d0cbf5
I20260808 04:40:37.430620 24084 ts_tablet_manager.cc:1939] T 642170df43b54d2dbf1c9d58d5d0cbf5 P dedcf4f874fd4a5a91d5ba4d784c2af0: Deleting consensus metadata
I20260808 04:40:37.432245 24082 ts_tablet_manager.cc:1918] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 6867e539dee64800a41f50fc525ffba2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:40:37.432344 24082 log.cc:1196] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 6867e539dee64800a41f50fc525ffba2: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-0/wal/wals/642170df43b54d2dbf1c9d58d5d0cbf5
I20260808 04:40:37.432651 24082 ts_tablet_manager.cc:1939] T 642170df43b54d2dbf1c9d58d5d0cbf5 P 6867e539dee64800a41f50fc525ffba2: Deleting consensus metadata
W20260808 04:40:37.433977 23626 connection.cc:535] server connection from 127.0.0.1:48734 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 04:40:37.433982 23438 connection.cc:535] server connection from 127.0.0.1:55534 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 04:40:37.434001 23831 connection.cc:535] server connection from 127.0.0.1:40780 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 04:40:37.447285 23603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:37.437962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43410 (local address 127.12.148.124:35345)
0808 04:40:37.438075 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:37.438079 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:37.438323 (+ 244us) server_negotiation.cc:407] Connection header received
0808 04:40:37.438495 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:37.438499 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:37.438552 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:37.438631 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:37.439495 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.440217 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.441261 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.441562 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.441647 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:37.443519 (+ 1872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:37.443523 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:37.443526 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:37.443553 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:37.445442 (+ 1889us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:37.445978 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:37.445982 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:37.445984 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:37.446072 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:37.446341 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:37.446344 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:37.446345 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:37.446553 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:37.446672 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:37.447018 (+ 346us) server_negotiation.cc:299] Negotiation successful
0808 04:40:37.447131 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 04:40:37.447448 23252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:37.416862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43352 (local address 127.12.148.125:41193)
0808 04:40:37.416969 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:37.416973 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:37.438033 (+ 21060us) server_negotiation.cc:407] Connection header received
0808 04:40:37.438135 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:37.438138 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:37.438180 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:37.438249 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:37.439219 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.440012 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.441148 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.441462 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.441531 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:37.443584 (+ 2053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:37.443588 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:37.443590 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:37.443614 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:37.445598 (+ 1984us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:37.446135 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:37.446138 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:37.446140 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:37.446225 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:37.446525 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:37.446529 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:37.446530 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:37.446746 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:37.446846 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:37.447188 (+ 342us) server_negotiation.cc:299] Negotiation successful
0808 04:40:37.447285 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 04:40:37.447768 24020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:37.437642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43358 (local address 127.12.148.125:41193)
0808 04:40:37.437792 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:37.437797 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:37.437811 (+ 14us) server_negotiation.cc:407] Connection header received
0808 04:40:37.437933 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:37.437936 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:37.437990 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:37.438043 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:37.439579 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.440386 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.441589 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.441967 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.442038 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:37.443672 (+ 1634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:37.443676 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:37.443679 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:37.443706 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:37.445521 (+ 1815us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:37.446108 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:37.446112 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:37.446114 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:37.446206 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:37.446509 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:37.446512 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:37.446514 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:37.446729 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:37.446827 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:37.447504 (+ 677us) server_negotiation.cc:299] Negotiation successful
0808 04:40:37.447621 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 04:40:37.455516 24021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:37.416030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43408 (local address 127.12.148.124:35345)
0808 04:40:37.416145 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:37.416150 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:37.448740 (+ 32590us) server_negotiation.cc:407] Connection header received
0808 04:40:37.449121 (+ 381us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:37.449124 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:37.449169 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:37.449229 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:37.449826 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.450305 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.451012 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:37.451242 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:37.451322 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:37.452707 (+ 1385us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:37.452711 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:37.452714 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:37.452737 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:37.454101 (+ 1364us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:37.454469 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:37.454472 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:37.454474 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:37.454548 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:37.454780 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:37.454783 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:37.454784 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:37.454948 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:37.455055 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:37.455262 (+ 207us) server_negotiation.cc:299] Negotiation successful
0808 04:40:37.455366 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 04:40:38.404021 24093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:38.403494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.12.148.67:59477)
0808 04:40:38.403796 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:38.403902 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":93,"threads_started":1}
W20260808 04:40:38.404394 24000 heartbeater.cc:644] Failed to heartbeat to 127.12.148.126:41335 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
I20260808 04:40:38.407625 24094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:38.407213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.12.148.65:57191)
0808 04:40:38.407457 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:38.407528 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":76,"threads_started":1}
W20260808 04:40:38.407938 23596 heartbeater.cc:644] Failed to heartbeat to 127.12.148.126:41335 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
I20260808 04:40:38.408821 24096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:38.408451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.12.148.66:49403)
0808 04:40:38.408654 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:38.408742 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":58,"threads_started":1}
W20260808 04:40:38.409080 23801 heartbeater.cc:644] Failed to heartbeat to 127.12.148.126:41335 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
I20260808 04:40:38.914129 24097 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218c9b6c6aa34ef291292aab18539744)
I20260808 04:40:38.914215 24099 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218c9b6c6aa34ef291292aab18539744)
I20260808 04:40:38.914318 24097 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: false } } peers { permanent_uuid: "4d013e883a6b4893b49cafa319d3eb20" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 35345 } attrs { promote: false } }
I20260808 04:40:38.914425 24099 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: false } } peers { permanent_uuid: "4d013e883a6b4893b49cafa319d3eb20" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 35345 } attrs { promote: false } }
I20260808 04:40:38.915246 24097 leader_election.cc:288] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218c9b6c6aa34ef291292aab18539744 (127.12.148.126:41335), 5840bba663a9429c8faecf68a8c2c955 (127.12.148.125:41193)
I20260808 04:40:38.915314 24099 leader_election.cc:288] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218c9b6c6aa34ef291292aab18539744 (127.12.148.126:41335), 4d013e883a6b4893b49cafa319d3eb20 (127.12.148.124:35345)
I20260808 04:40:38.916219 24100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:38.915464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.0.0.1:58674)
0808 04:40:38.916050 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:38.916134 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":60,"threads_started":1}
I20260808 04:40:38.916281 24105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:38.915439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.0.0.1:58662)
0808 04:40:38.916101 (+ 662us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:38.916184 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":588,"thread_start_us":68,"threads_started":1}
W20260808 04:40:38.916417 23056 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
W20260808 04:40:38.916445 23315 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
I20260808 04:40:38.917271 24102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:38.917094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.0.0.1:58678)
0808 04:40:38.917175 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:38.917219 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260808 04:40:38.917445 23056 leader_election.cc:334] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 218c9b6c6aa34ef291292aab18539744 (127.12.148.126:41335): Network error: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
I20260808 04:40:38.917984 24101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:38.917760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.0.0.1:58692)
0808 04:40:38.917866 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:38.917919 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260808 04:40:38.918165 23315 leader_election.cc:334] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 218c9b6c6aa34ef291292aab18539744 (127.12.148.126:41335): Network error: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
I20260808 04:40:38.920256 24100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:38.915725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:35345 (local address 127.0.0.1:43416)
0808 04:40:38.916357 (+ 632us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:38.916369 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:38.916470 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:38.916854 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:38.916857 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:38.916877 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:38.916972 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:38.916978 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:38.917992 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:38.917996 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:38.918943 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:38.918953 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:38.919759 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:38.919798 (+ 39us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:38.919950 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:38.919977 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 04:40:38.920070 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 04:40:38.920140 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":576,"mutex_wait_us":36,"thread_start_us":61,"threads_started":1}
I20260808 04:40:38.920289 24107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:38.915919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43416 (local address 127.12.148.124:35345)
0808 04:40:38.916105 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:38.916110 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:38.916553 (+ 443us) server_negotiation.cc:407] Connection header received
0808 04:40:38.916602 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:38.916605 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:38.916653 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:38.916727 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:38.917074 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:38.917879 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:38.919070 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:38.919636 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:38.919742 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:38.919784 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:38.920082 (+ 298us) server_negotiation.cc:299] Negotiation successful
0808 04:40:38.920159 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":41,"server-negotiator.queue_time_us":124,"thread_start_us":57,"threads_started":1}
I20260808 04:40:38.920533 24105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:38.915762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.125:41193 (local address 127.0.0.1:43360)
0808 04:40:38.916860 (+ 1098us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:38.916876 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:38.916987 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:38.917379 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:38.917382 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:38.917400 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:38.917484 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:38.917490 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:38.918397 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:38.918399 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:38.919331 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:38.919342 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:38.920122 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:38.920125 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:38.920222 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:38.920247 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 04:40:38.920336 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 04:40:38.920410 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1046,"mutex_wait_us":30,"thread_start_us":72,"threads_started":1}
I20260808 04:40:38.920743 24109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:38.915879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43360 (local address 127.12.148.125:41193)
0808 04:40:38.916127 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:38.916132 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:38.916943 (+ 811us) server_negotiation.cc:407] Connection header received
0808 04:40:38.917118 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:38.917122 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:38.917168 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:38.917238 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:38.917609 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:38.918272 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:38.919475 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:38.920019 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:38.920117 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:38.920156 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:38.920600 (+ 444us) server_negotiation.cc:299] Negotiation successful
0808 04:40:38.920662 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":33,"server-negotiator.queue_time_us":189,"thread_start_us":83,"threads_started":1}
I20260808 04:40:38.920686 23355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5840bba663a9429c8faecf68a8c2c955" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "4d013e883a6b4893b49cafa319d3eb20" is_pre_election: true
I20260808 04:40:38.920985 23355 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5840bba663a9429c8faecf68a8c2c955 in term 1.
I20260808 04:40:38.921151 23094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4d013e883a6b4893b49cafa319d3eb20" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "5840bba663a9429c8faecf68a8c2c955" is_pre_election: true
I20260808 04:40:38.921339 23094 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d013e883a6b4893b49cafa319d3eb20 in term 1.
I20260808 04:40:38.921396 23056 leader_election.cc:302] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d013e883a6b4893b49cafa319d3eb20, 5840bba663a9429c8faecf68a8c2c955; no voters: 218c9b6c6aa34ef291292aab18539744
I20260808 04:40:38.921576 24099 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 04:40:38.921629 24099 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 218c9b6c6aa34ef291292aab18539744)
I20260808 04:40:38.921693 24099 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [term 1 FOLLOWER]: Advancing to term 2
I20260808 04:40:38.921690 23315 leader_election.cc:302] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d013e883a6b4893b49cafa319d3eb20, 5840bba663a9429c8faecf68a8c2c955; no voters: 218c9b6c6aa34ef291292aab18539744
I20260808 04:40:38.921938 24097 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 04:40:38.922006 24097 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 218c9b6c6aa34ef291292aab18539744)
I20260808 04:40:38.922043 24097 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [term 1 FOLLOWER]: Advancing to term 2
I20260808 04:40:38.922989 24099 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: false } } peers { permanent_uuid: "4d013e883a6b4893b49cafa319d3eb20" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 35345 } attrs { promote: false } }
I20260808 04:40:38.923174 24097 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: false } } peers { permanent_uuid: "4d013e883a6b4893b49cafa319d3eb20" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 35345 } attrs { promote: false } }
I20260808 04:40:38.923372 24099 leader_election.cc:288] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [CANDIDATE]: Term 2 election: Requested vote from peers 218c9b6c6aa34ef291292aab18539744 (127.12.148.126:41335), 4d013e883a6b4893b49cafa319d3eb20 (127.12.148.124:35345)
I20260808 04:40:38.923527 24097 leader_election.cc:288] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [CANDIDATE]: Term 2 election: Requested vote from peers 218c9b6c6aa34ef291292aab18539744 (127.12.148.126:41335), 5840bba663a9429c8faecf68a8c2c955 (127.12.148.125:41193)
I20260808 04:40:38.923743 24100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:38.923487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.0.0.1:58706)
0808 04:40:38.923575 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:38.923681 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260808 04:40:38.923837 24105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:38.923626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.0.0.1:58716)
0808 04:40:38.923714 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:38.923765 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260808 04:40:38.923943 23355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5840bba663a9429c8faecf68a8c2c955" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "4d013e883a6b4893b49cafa319d3eb20"
I20260808 04:40:38.923990 23094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4d013e883a6b4893b49cafa319d3eb20" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "5840bba663a9429c8faecf68a8c2c955"
I20260808 04:40:38.924113 23355 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5840bba663a9429c8faecf68a8c2c955 in current term 2: Already voted for candidate 4d013e883a6b4893b49cafa319d3eb20 in this term.
I20260808 04:40:38.924149 23094 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d013e883a6b4893b49cafa319d3eb20 in current term 2: Already voted for candidate 5840bba663a9429c8faecf68a8c2c955 in this term.
I20260808 04:40:38.924829 24105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:38.924639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.0.0.1:58730)
0808 04:40:38.924734 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:38.924780 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 04:40:38.924929 24100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:38.924730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.0.0.1:58738)
0808 04:40:38.924824 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:38.924871 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260808 04:40:38.924928 23315 leader_election.cc:334] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 218c9b6c6aa34ef291292aab18539744 (127.12.148.126:41335): Network error: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
I20260808 04:40:38.924993 23315 leader_election.cc:302] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d013e883a6b4893b49cafa319d3eb20; no voters: 218c9b6c6aa34ef291292aab18539744, 5840bba663a9429c8faecf68a8c2c955
W20260808 04:40:38.925050 23056 leader_election.cc:334] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 218c9b6c6aa34ef291292aab18539744 (127.12.148.126:41335): Network error: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
I20260808 04:40:38.925105 23056 leader_election.cc:302] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5840bba663a9429c8faecf68a8c2c955; no voters: 218c9b6c6aa34ef291292aab18539744, 4d013e883a6b4893b49cafa319d3eb20
I20260808 04:40:38.925113 24097 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260808 04:40:38.925227 24099 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260808 04:40:39.405627 24112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:39.405062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.12.148.67:40623)
0808 04:40:39.405413 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:39.405507 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":98,"threads_started":1}
I20260808 04:40:39.408886 24113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:39.408467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.12.148.65:43035)
0808 04:40:39.408716 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:39.408782 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":89,"threads_started":1}
I20260808 04:40:39.410027 24115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:39.409542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.12.148.66:50347)
0808 04:40:39.409903 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:39.409954 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":72,"threads_started":1}
I20260808 04:40:40.406857 24117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.406383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.12.148.67:51665)
0808 04:40:40.406663 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.406741 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":105,"threads_started":1}
I20260808 04:40:40.410045 24118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.409590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.12.148.65:40251)
0808 04:40:40.409850 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.409942 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":97,"threads_started":1}
I20260808 04:40:40.410900 24119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.410549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.12.148.66:57153)
0808 04:40:40.410773 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.410823 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":67,"threads_started":1}
I20260808 04:40:40.502413 24120 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:40:40.502547 24120 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: false } } peers { permanent_uuid: "4d013e883a6b4893b49cafa319d3eb20" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 35345 } attrs { promote: false } }
I20260808 04:40:40.502903 24120 leader_election.cc:288] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 218c9b6c6aa34ef291292aab18539744 (127.12.148.126:41335), 5840bba663a9429c8faecf68a8c2c955 (127.12.148.125:41193)
I20260808 04:40:40.503396 24121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.503038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.0.0.1:58986)
0808 04:40:40.503230 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.503295 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":56,"threads_started":1}
I20260808 04:40:40.503489 23094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4d013e883a6b4893b49cafa319d3eb20" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "5840bba663a9429c8faecf68a8c2c955" is_pre_election: true
I20260808 04:40:40.503652 23094 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d013e883a6b4893b49cafa319d3eb20 in term 2.
I20260808 04:40:40.504113 23315 leader_election.cc:302] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d013e883a6b4893b49cafa319d3eb20, 5840bba663a9429c8faecf68a8c2c955; no voters:
I20260808 04:40:40.504215 24121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.503989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.0.0.1:59000)
0808 04:40:40.504103 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.504154 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260808 04:40:40.504276 24120 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260808 04:40:40.504323 23315 leader_election.cc:334] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 218c9b6c6aa34ef291292aab18539744 (127.12.148.126:41335): Network error: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
I20260808 04:40:40.504340 24120 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:40:40.504420 24120 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [term 2 FOLLOWER]: Advancing to term 3
I20260808 04:40:40.505460 24120 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: false } } peers { permanent_uuid: "4d013e883a6b4893b49cafa319d3eb20" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 35345 } attrs { promote: false } }
I20260808 04:40:40.505791 24120 leader_election.cc:288] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [CANDIDATE]: Term 3 election: Requested vote from peers 218c9b6c6aa34ef291292aab18539744 (127.12.148.126:41335), 5840bba663a9429c8faecf68a8c2c955 (127.12.148.125:41193)
I20260808 04:40:40.506132 24121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.505910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.0.0.1:59014)
0808 04:40:40.506012 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.506067 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260808 04:40:40.506307 23094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4d013e883a6b4893b49cafa319d3eb20" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "5840bba663a9429c8faecf68a8c2c955"
I20260808 04:40:40.506458 23094 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [term 2 FOLLOWER]: Advancing to term 3
I20260808 04:40:40.507370 23094 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d013e883a6b4893b49cafa319d3eb20 in term 3.
I20260808 04:40:40.507725 23315 leader_election.cc:302] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d013e883a6b4893b49cafa319d3eb20, 5840bba663a9429c8faecf68a8c2c955; no voters:
I20260808 04:40:40.507916 24120 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 04:40:40.508149 24120 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [term 3 LEADER]: Becoming Leader. State: Replica: 4d013e883a6b4893b49cafa319d3eb20, State: Running, Role: LEADER
I20260808 04:40:40.508227 24121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.507977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.0.0.1:59026)
0808 04:40:40.508083 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.508133 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260808 04:40:40.508392 23315 leader_election.cc:334] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 218c9b6c6aa34ef291292aab18539744 (127.12.148.126:41335): Network error: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
I20260808 04:40:40.508495 24120 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: false } } peers { permanent_uuid: "4d013e883a6b4893b49cafa319d3eb20" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 35345 } attrs { promote: false } }
I20260808 04:40:40.509835 24124 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4d013e883a6b4893b49cafa319d3eb20. Latest consensus state: current_term: 3 leader_uuid: "4d013e883a6b4893b49cafa319d3eb20" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: false } } peers { permanent_uuid: "4d013e883a6b4893b49cafa319d3eb20" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 35345 } attrs { promote: false } } }
I20260808 04:40:40.509936 24124 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:40.510203 24130 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:40:40.512468 24130 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:40:40.512854 24130 catalog_manager.cc:1259] Loaded cluster ID: 3f5f41c2104c4ce39c1596eb686339ce
I20260808 04:40:40.512900 24130 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:40:40.513434 24130 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:40:40.513847 24130 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20: Loaded TSK: 0
I20260808 04:40:40.514497 24130 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:40:40.585970 23335 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43410:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:40:40.589054 23335 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:40:40.591956 24121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.591702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.0.0.1:59048)
0808 04:40:40.591816 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.591885 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260808 04:40:40.592224 23094 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [term 3 FOLLOWER]: Refusing update from remote peer 4d013e883a6b4893b49cafa319d3eb20: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260808 04:40:40.592638 24121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.592432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.0.0.1:59064)
0808 04:40:40.592533 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.592581 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260808 04:40:40.592700 24120 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260808 04:40:40.592933 23315 consensus_peers.cc:487] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 -> Peer 218c9b6c6aa34ef291292aab18539744 (127.12.148.126:41335): Couldn't send request to peer 218c9b6c6aa34ef291292aab18539744. Status: Network error: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 04:40:40.594287 24133 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4d013e883a6b4893b49cafa319d3eb20. Latest consensus state: current_term: 3 leader_uuid: "4d013e883a6b4893b49cafa319d3eb20" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: false } } peers { permanent_uuid: "4d013e883a6b4893b49cafa319d3eb20" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 35345 } attrs { promote: false } } }
I20260808 04:40:40.594405 24133 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:40:40.595528 24120 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "4d013e883a6b4893b49cafa319d3eb20" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: false } } peers { permanent_uuid: "4d013e883a6b4893b49cafa319d3eb20" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 35345 } attrs { promote: false } } }
I20260808 04:40:40.595646 24120 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:40.595836 24133 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "4d013e883a6b4893b49cafa319d3eb20" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "218c9b6c6aa34ef291292aab18539744" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41335 } } peers { permanent_uuid: "5840bba663a9429c8faecf68a8c2c955" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 41193 } attrs { promote: false } } peers { permanent_uuid: "4d013e883a6b4893b49cafa319d3eb20" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 35345 } attrs { promote: false } } }
I20260808 04:40:40.595954 24133 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5840bba663a9429c8faecf68a8c2c955 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:40:40.605706 24121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.600939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:40203 (local address 127.0.0.1:55546)
0808 04:40:40.601072 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.601087 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:40.601158 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:40.602280 (+ 1122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:40.602283 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:40.602301 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:40.602407 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:40.602413 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:40.603288 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:40.603291 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:40.604374 (+ 1083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:40.604384 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:40.605263 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:40.605266 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:40.605355 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:40.605381 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 04:40:40.605475 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 04:40:40.605548 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":78,"mutex_wait_us":38}
I20260808 04:40:40.605722 24140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.601075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55546 (local address 127.12.148.65:40203)
0808 04:40:40.602046 (+ 971us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:40.602051 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:40.602065 (+ 14us) server_negotiation.cc:407] Connection header received
0808 04:40:40.602119 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:40.602122 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:40.602169 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:40.602263 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:40.602545 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:40.603183 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:40.604530 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:40.605154 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:40.605251 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:40.605314 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:40.605486 (+ 172us) server_negotiation.cc:299] Negotiation successful
0808 04:40:40.605562 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":892,"thread_start_us":77,"threads_started":1}
I20260808 04:40:40.605912 24141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.601398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:46085 (local address 127.0.0.1:48740)
0808 04:40:40.601609 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.601622 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:40.601723 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:40.602680 (+ 957us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:40.602683 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:40.602699 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:40.602781 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:40.602787 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:40.603730 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:40.603733 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:40.604829 (+ 1096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:40.604840 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:40.605539 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:40.605542 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:40.605623 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:40.605644 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 04:40:40.605717 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 04:40:40.605783 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"mutex_wait_us":38,"thread_start_us":77,"threads_started":1}
I20260808 04:40:40.606140 24143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.601424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.67:37211 (local address 127.0.0.1:40786)
0808 04:40:40.602230 (+ 806us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.602243 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:40.602317 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:40.602537 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:40.602540 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:40.602556 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:40.602648 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:40.602654 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:40.603689 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:40.603693 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:40.604848 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:40.604858 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:40.605723 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:40.605726 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:40.605813 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:40.605872 (+ 59us) client_negotiation.cc:769] Sending connection context
0808 04:40:40.605936 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 04:40:40.606006 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":746,"mutex_wait_us":2,"thread_start_us":86,"threads_started":1}
I20260808 04:40:40.606576 24145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.601992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48740 (local address 127.12.148.66:46085)
0808 04:40:40.602480 (+ 488us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:40.602483 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:40.602494 (+ 11us) server_negotiation.cc:407] Connection header received
0808 04:40:40.602540 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:40.602542 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:40.602583 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:40.602666 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:40.602892 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:40.603645 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:40.604933 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:40.605416 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:40.606198 (+ 782us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:40.606342 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:40.606377 (+ 35us) server_negotiation.cc:299] Negotiation successful
0808 04:40:40.606443 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":417,"thread_start_us":76,"threads_started":1}
I20260808 04:40:40.606521 23501 tablet_service.cc:1467] Processing CreateTablet for tablet ee1cf10647d94253b27424960f7dd1b3 (DEFAULT_TABLE table=test-table [id=14c5328321114dbab25a1b044a08f63b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:40.606580 24144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.601826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40786 (local address 127.12.148.67:37211)
0808 04:40:40.602303 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:40.602308 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:40.602322 (+ 14us) server_negotiation.cc:407] Connection header received
0808 04:40:40.602384 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:40.602387 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:40.602432 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:40.602527 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:40.602777 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:40.603575 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:40.604981 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:40.605538 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:40.605634 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:40.606320 (+ 686us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:40.606360 (+ 40us) server_negotiation.cc:299] Negotiation successful
0808 04:40:40.606429 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":402,"thread_start_us":71,"threads_started":1}
I20260808 04:40:40.606825 23501 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee1cf10647d94253b27424960f7dd1b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:40.607107 23694 tablet_service.cc:1467] Processing CreateTablet for tablet ee1cf10647d94253b27424960f7dd1b3 (DEFAULT_TABLE table=test-table [id=14c5328321114dbab25a1b044a08f63b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:40.607159 23902 tablet_service.cc:1467] Processing CreateTablet for tablet ee1cf10647d94253b27424960f7dd1b3 (DEFAULT_TABLE table=test-table [id=14c5328321114dbab25a1b044a08f63b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:40.607360 23694 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee1cf10647d94253b27424960f7dd1b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:40.607424 23902 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee1cf10647d94253b27424960f7dd1b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:40.609409 24147 tablet_bootstrap.cc:492] T ee1cf10647d94253b27424960f7dd1b3 P dedcf4f874fd4a5a91d5ba4d784c2af0: Bootstrap starting.
I20260808 04:40:40.609793 24151 tablet_bootstrap.cc:492] T ee1cf10647d94253b27424960f7dd1b3 P 48c5ece7716c44a4bf4e1491ec34eedd: Bootstrap starting.
I20260808 04:40:40.610261 24147 tablet_bootstrap.cc:654] T ee1cf10647d94253b27424960f7dd1b3 P dedcf4f874fd4a5a91d5ba4d784c2af0: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:40.610666 24151 tablet_bootstrap.cc:654] T ee1cf10647d94253b27424960f7dd1b3 P 48c5ece7716c44a4bf4e1491ec34eedd: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:40.611020 24148 tablet_bootstrap.cc:492] T ee1cf10647d94253b27424960f7dd1b3 P 6867e539dee64800a41f50fc525ffba2: Bootstrap starting.
I20260808 04:40:40.611816 24148 tablet_bootstrap.cc:654] T ee1cf10647d94253b27424960f7dd1b3 P 6867e539dee64800a41f50fc525ffba2: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:40.611908 24151 tablet_bootstrap.cc:492] T ee1cf10647d94253b27424960f7dd1b3 P 48c5ece7716c44a4bf4e1491ec34eedd: No bootstrap required, opened a new log
I20260808 04:40:40.611997 24151 ts_tablet_manager.cc:1397] T ee1cf10647d94253b27424960f7dd1b3 P 48c5ece7716c44a4bf4e1491ec34eedd: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 04:40:40.612531 24151 raft_consensus.cc:348] T ee1cf10647d94253b27424960f7dd1b3 P 48c5ece7716c44a4bf4e1491ec34eedd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6867e539dee64800a41f50fc525ffba2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40203 } } peers { permanent_uuid: "48c5ece7716c44a4bf4e1491ec34eedd" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37211 } } peers { permanent_uuid: "dedcf4f874fd4a5a91d5ba4d784c2af0" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 46085 } }
I20260808 04:40:40.612658 24151 raft_consensus.cc:374] T ee1cf10647d94253b27424960f7dd1b3 P 48c5ece7716c44a4bf4e1491ec34eedd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:40.612710 24151 raft_consensus.cc:729] T ee1cf10647d94253b27424960f7dd1b3 P 48c5ece7716c44a4bf4e1491ec34eedd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48c5ece7716c44a4bf4e1491ec34eedd, State: Initialized, Role: FOLLOWER
I20260808 04:40:40.612862 24151 consensus_queue.cc:260] T ee1cf10647d94253b27424960f7dd1b3 P 48c5ece7716c44a4bf4e1491ec34eedd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6867e539dee64800a41f50fc525ffba2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40203 } } peers { permanent_uuid: "48c5ece7716c44a4bf4e1491ec34eedd" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37211 } } peers { permanent_uuid: "dedcf4f874fd4a5a91d5ba4d784c2af0" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 46085 } }
I20260808 04:40:40.612960 24147 tablet_bootstrap.cc:492] T ee1cf10647d94253b27424960f7dd1b3 P dedcf4f874fd4a5a91d5ba4d784c2af0: No bootstrap required, opened a new log
I20260808 04:40:40.612960 24148 tablet_bootstrap.cc:492] T ee1cf10647d94253b27424960f7dd1b3 P 6867e539dee64800a41f50fc525ffba2: No bootstrap required, opened a new log
I20260808 04:40:40.613046 24147 ts_tablet_manager.cc:1397] T ee1cf10647d94253b27424960f7dd1b3 P dedcf4f874fd4a5a91d5ba4d784c2af0: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260808 04:40:40.613046 24148 ts_tablet_manager.cc:1397] T ee1cf10647d94253b27424960f7dd1b3 P 6867e539dee64800a41f50fc525ffba2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 04:40:40.613215 24151 ts_tablet_manager.cc:1428] T ee1cf10647d94253b27424960f7dd1b3 P 48c5ece7716c44a4bf4e1491ec34eedd: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260808 04:40:40.613418 24148 raft_consensus.cc:348] T ee1cf10647d94253b27424960f7dd1b3 P 6867e539dee64800a41f50fc525ffba2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6867e539dee64800a41f50fc525ffba2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40203 } } peers { permanent_uuid: "48c5ece7716c44a4bf4e1491ec34eedd" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37211 } } peers { permanent_uuid: "dedcf4f874fd4a5a91d5ba4d784c2af0" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 46085 } }
I20260808 04:40:40.613418 24147 raft_consensus.cc:348] T ee1cf10647d94253b27424960f7dd1b3 P dedcf4f874fd4a5a91d5ba4d784c2af0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6867e539dee64800a41f50fc525ffba2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40203 } } peers { permanent_uuid: "48c5ece7716c44a4bf4e1491ec34eedd" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37211 } } peers { permanent_uuid: "dedcf4f874fd4a5a91d5ba4d784c2af0" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 46085 } }
I20260808 04:40:40.613520 24147 raft_consensus.cc:374] T ee1cf10647d94253b27424960f7dd1b3 P dedcf4f874fd4a5a91d5ba4d784c2af0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:40.613521 24148 raft_consensus.cc:374] T ee1cf10647d94253b27424960f7dd1b3 P 6867e539dee64800a41f50fc525ffba2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:40.613552 24147 raft_consensus.cc:729] T ee1cf10647d94253b27424960f7dd1b3 P dedcf4f874fd4a5a91d5ba4d784c2af0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dedcf4f874fd4a5a91d5ba4d784c2af0, State: Initialized, Role: FOLLOWER
I20260808 04:40:40.613552 24148 raft_consensus.cc:729] T ee1cf10647d94253b27424960f7dd1b3 P 6867e539dee64800a41f50fc525ffba2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6867e539dee64800a41f50fc525ffba2, State: Initialized, Role: FOLLOWER
I20260808 04:40:40.613704 24148 consensus_queue.cc:260] T ee1cf10647d94253b27424960f7dd1b3 P 6867e539dee64800a41f50fc525ffba2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6867e539dee64800a41f50fc525ffba2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40203 } } peers { permanent_uuid: "48c5ece7716c44a4bf4e1491ec34eedd" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37211 } } peers { permanent_uuid: "dedcf4f874fd4a5a91d5ba4d784c2af0" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 46085 } }
I20260808 04:40:40.613699 24147 consensus_queue.cc:260] T ee1cf10647d94253b27424960f7dd1b3 P dedcf4f874fd4a5a91d5ba4d784c2af0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6867e539dee64800a41f50fc525ffba2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40203 } } peers { permanent_uuid: "48c5ece7716c44a4bf4e1491ec34eedd" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37211 } } peers { permanent_uuid: "dedcf4f874fd4a5a91d5ba4d784c2af0" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 46085 } }
I20260808 04:40:40.614071 24147 ts_tablet_manager.cc:1428] T ee1cf10647d94253b27424960f7dd1b3 P dedcf4f874fd4a5a91d5ba4d784c2af0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 04:40:40.614071 24148 ts_tablet_manager.cc:1428] T ee1cf10647d94253b27424960f7dd1b3 P 6867e539dee64800a41f50fc525ffba2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 04:40:40.614883 24117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.613906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.12.148.67:45701)
0808 04:40:40.614748 (+ 842us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.614810 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":764}
I20260808 04:40:40.615242 24118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.614973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.12.148.65:59485)
0808 04:40:40.615111 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.615167 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260808 04:40:40.616060 24119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.615846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.12.148.66:53281)
0808 04:40:40.615941 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.615993 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260808 04:40:40.616633 23999 heartbeater.cc:503] Master 127.12.148.124:35345 was elected leader, sending a full tablet report...
I20260808 04:40:40.616935 24119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.616676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.12.148.66:52155)
0808 04:40:40.616808 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.616869 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260808 04:40:40.617497 23595 heartbeater.cc:503] Master 127.12.148.124:35345 was elected leader, sending a full tablet report...
I20260808 04:40:40.617923 24118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.616768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.12.148.65:39509)
0808 04:40:40.617807 (+ 1039us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.617858 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":974}
I20260808 04:40:40.619524 24117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.619287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.12.148.67:56547)
0808 04:40:40.619403 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.619455 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 04:40:40.619644 23800 heartbeater.cc:503] Master 127.12.148.124:35345 was elected leader, sending a full tablet report...
I20260808 04:40:40.653957 24162 raft_consensus.cc:482] T ee1cf10647d94253b27424960f7dd1b3 P dedcf4f874fd4a5a91d5ba4d784c2af0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:40:40.654119 24162 raft_consensus.cc:504] T ee1cf10647d94253b27424960f7dd1b3 P dedcf4f874fd4a5a91d5ba4d784c2af0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6867e539dee64800a41f50fc525ffba2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40203 } } peers { permanent_uuid: "48c5ece7716c44a4bf4e1491ec34eedd" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37211 } } peers { permanent_uuid: "dedcf4f874fd4a5a91d5ba4d784c2af0" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 46085 } }
I20260808 04:40:40.655171 24162 leader_election.cc:288] T ee1cf10647d94253b27424960f7dd1b3 P dedcf4f874fd4a5a91d5ba4d784c2af0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6867e539dee64800a41f50fc525ffba2 (127.12.148.65:40203), 48c5ece7716c44a4bf4e1491ec34eedd (127.12.148.67:37211)
I20260808 04:40:40.658667 24140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.655519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:39507 (local address 127.12.148.65:40203)
0808 04:40:40.655631 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:40.655635 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:40.655652 (+ 17us) server_negotiation.cc:407] Connection header received
0808 04:40:40.655710 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:40.655713 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:40.655761 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:40.655837 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:40.656144 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:40.656654 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:40.657741 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:40.658136 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:40.658241 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:40.658299 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:40.658473 (+ 174us) server_negotiation.cc:299] Negotiation successful
0808 04:40:40.658545 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 04:40:40.658667 24119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.655381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:40203 (local address 127.12.148.66:39507)
0808 04:40:40.655526 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.655539 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:40.655626 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:40.655912 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:40.655915 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:40.655935 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:40.656042 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:40.656048 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:40.656754 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:40.656757 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:40.657584 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:40.657594 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:40.658262 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:40.658266 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:40.658366 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:40.658384 (+ 18us) client_negotiation.cc:769] Sending connection context
0808 04:40:40.658449 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 04:40:40.658518 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260808 04:40:40.658875 24165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.655381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.67:37211 (local address 127.12.148.66:58973)
0808 04:40:40.655925 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.655938 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:40.656043 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:40.656256 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:40.656259 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:40.656273 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:40.656378 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:40.656383 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:40.657076 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:40.657079 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:40.657864 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:40.657873 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:40.658478 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:40.658481 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:40.658573 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:40.658591 (+ 18us) client_negotiation.cc:769] Sending connection context
0808 04:40:40.658655 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 04:40:40.658720 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":484,"mutex_wait_us":188,"thread_start_us":147,"threads_started":1}
I20260808 04:40:40.658859 24144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.655768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:58973 (local address 127.12.148.67:37211)
0808 04:40:40.655899 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:40.655903 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:40.656015 (+ 112us) server_negotiation.cc:407] Connection header received
0808 04:40:40.656137 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:40.656139 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:40.656179 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:40.656238 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:40.656474 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:40.656975 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:40.657985 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:40.658365 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:40.658471 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:40.658519 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:40.658679 (+ 160us) server_negotiation.cc:299] Negotiation successful
0808 04:40:40.658751 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 04:40:40.659323 23527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee1cf10647d94253b27424960f7dd1b3" candidate_uuid: "dedcf4f874fd4a5a91d5ba4d784c2af0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6867e539dee64800a41f50fc525ffba2" is_pre_election: true
I20260808 04:40:40.659571 23527 raft_consensus.cc:2454] T ee1cf10647d94253b27424960f7dd1b3 P 6867e539dee64800a41f50fc525ffba2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dedcf4f874fd4a5a91d5ba4d784c2af0 in term 0.
I20260808 04:40:40.659461 23929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee1cf10647d94253b27424960f7dd1b3" candidate_uuid: "dedcf4f874fd4a5a91d5ba4d784c2af0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48c5ece7716c44a4bf4e1491ec34eedd" is_pre_election: true
I20260808 04:40:40.659711 23929 raft_consensus.cc:2454] T ee1cf10647d94253b27424960f7dd1b3 P 48c5ece7716c44a4bf4e1491ec34eedd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dedcf4f874fd4a5a91d5ba4d784c2af0 in term 0.
I20260808 04:40:40.660006 23627 leader_election.cc:302] T ee1cf10647d94253b27424960f7dd1b3 P dedcf4f874fd4a5a91d5ba4d784c2af0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6867e539dee64800a41f50fc525ffba2, dedcf4f874fd4a5a91d5ba4d784c2af0; no voters:
I20260808 04:40:40.660298 24162 raft_consensus.cc:2781] T ee1cf10647d94253b27424960f7dd1b3 P dedcf4f874fd4a5a91d5ba4d784c2af0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:40:40.660367 24162 raft_consensus.cc:482] T ee1cf10647d94253b27424960f7dd1b3 P dedcf4f874fd4a5a91d5ba4d784c2af0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:40:40.660394 24162 raft_consensus.cc:3037] T ee1cf10647d94253b27424960f7dd1b3 P dedcf4f874fd4a5a91d5ba4d784c2af0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:40.661443 24162 raft_consensus.cc:504] T ee1cf10647d94253b27424960f7dd1b3 P dedcf4f874fd4a5a91d5ba4d784c2af0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6867e539dee64800a41f50fc525ffba2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40203 } } peers { permanent_uuid: "48c5ece7716c44a4bf4e1491ec34eedd" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37211 } } peers { permanent_uuid: "dedcf4f874fd4a5a91d5ba4d784c2af0" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 46085 } }
I20260808 04:40:40.661825 24162 leader_election.cc:288] T ee1cf10647d94253b27424960f7dd1b3 P dedcf4f874fd4a5a91d5ba4d784c2af0 [CANDIDATE]: Term 1 election: Requested vote from peers 6867e539dee64800a41f50fc525ffba2 (127.12.148.65:40203), 48c5ece7716c44a4bf4e1491ec34eedd (127.12.148.67:37211)
I20260808 04:40:40.662186 23929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee1cf10647d94253b27424960f7dd1b3" candidate_uuid: "dedcf4f874fd4a5a91d5ba4d784c2af0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48c5ece7716c44a4bf4e1491ec34eedd"
I20260808 04:40:40.662181 23527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee1cf10647d94253b27424960f7dd1b3" candidate_uuid: "dedcf4f874fd4a5a91d5ba4d784c2af0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6867e539dee64800a41f50fc525ffba2"
I20260808 04:40:40.662312 23527 raft_consensus.cc:3037] T ee1cf10647d94253b27424960f7dd1b3 P 6867e539dee64800a41f50fc525ffba2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:40.662308 23929 raft_consensus.cc:3037] T ee1cf10647d94253b27424960f7dd1b3 P 48c5ece7716c44a4bf4e1491ec34eedd [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:40.663425 23929 raft_consensus.cc:2454] T ee1cf10647d94253b27424960f7dd1b3 P 48c5ece7716c44a4bf4e1491ec34eedd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dedcf4f874fd4a5a91d5ba4d784c2af0 in term 1.
I20260808 04:40:40.663446 23527 raft_consensus.cc:2454] T ee1cf10647d94253b27424960f7dd1b3 P 6867e539dee64800a41f50fc525ffba2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dedcf4f874fd4a5a91d5ba4d784c2af0 in term 1.
I20260808 04:40:40.663715 23625 leader_election.cc:302] T ee1cf10647d94253b27424960f7dd1b3 P dedcf4f874fd4a5a91d5ba4d784c2af0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48c5ece7716c44a4bf4e1491ec34eedd, dedcf4f874fd4a5a91d5ba4d784c2af0; no voters:
I20260808 04:40:40.663869 24162 raft_consensus.cc:2781] T ee1cf10647d94253b27424960f7dd1b3 P dedcf4f874fd4a5a91d5ba4d784c2af0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:40.664089 24162 raft_consensus.cc:686] T ee1cf10647d94253b27424960f7dd1b3 P dedcf4f874fd4a5a91d5ba4d784c2af0 [term 1 LEADER]: Becoming Leader. State: Replica: dedcf4f874fd4a5a91d5ba4d784c2af0, State: Running, Role: LEADER
I20260808 04:40:40.664343 24162 consensus_queue.cc:237] T ee1cf10647d94253b27424960f7dd1b3 P dedcf4f874fd4a5a91d5ba4d784c2af0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6867e539dee64800a41f50fc525ffba2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40203 } } peers { permanent_uuid: "48c5ece7716c44a4bf4e1491ec34eedd" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37211 } } peers { permanent_uuid: "dedcf4f874fd4a5a91d5ba4d784c2af0" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 46085 } }
I20260808 04:40:40.665035 24165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.664828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.12.148.66:40491)
0808 04:40:40.664926 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.664975 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260808 04:40:40.666633 23336 catalog_manager.cc:5495] T ee1cf10647d94253b27424960f7dd1b3 P dedcf4f874fd4a5a91d5ba4d784c2af0 reported cstate change: term changed from 0 to 1, leader changed from <none> to dedcf4f874fd4a5a91d5ba4d784c2af0 (127.12.148.66). New cstate: current_term: 1 leader_uuid: "dedcf4f874fd4a5a91d5ba4d784c2af0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6867e539dee64800a41f50fc525ffba2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48c5ece7716c44a4bf4e1491ec34eedd" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dedcf4f874fd4a5a91d5ba4d784c2af0" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 46085 } health_report { overall_health: HEALTHY } } }
I20260808 04:40:40.688025 24145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.684631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48752 (local address 127.12.148.66:46085)
0808 04:40:40.684757 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:40.684761 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:40.684776 (+ 15us) server_negotiation.cc:407] Connection header received
0808 04:40:40.684858 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:40.684861 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:40.684914 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:40.685023 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:40.685263 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:40.685820 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:40.686639 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:40.686848 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:40.686936 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:40.687186 (+ 250us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:40.687639 (+ 453us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:40.687745 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:40.687815 (+ 70us) server_negotiation.cc:299] Negotiation successful
0808 04:40:40.687876 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 04:40:40.690865 23929 raft_consensus.cc:1261] T ee1cf10647d94253b27424960f7dd1b3 P 48c5ece7716c44a4bf4e1491ec34eedd [term 1 FOLLOWER]: Refusing update from remote peer dedcf4f874fd4a5a91d5ba4d784c2af0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:40.691069 23527 raft_consensus.cc:1261] T ee1cf10647d94253b27424960f7dd1b3 P 6867e539dee64800a41f50fc525ffba2 [term 1 FOLLOWER]: Refusing update from remote peer dedcf4f874fd4a5a91d5ba4d784c2af0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:40.691377 24162 consensus_queue.cc:1035] T ee1cf10647d94253b27424960f7dd1b3 P dedcf4f874fd4a5a91d5ba4d784c2af0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48c5ece7716c44a4bf4e1491ec34eedd" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:40.691627 24168 consensus_queue.cc:1035] T ee1cf10647d94253b27424960f7dd1b3 P dedcf4f874fd4a5a91d5ba4d784c2af0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6867e539dee64800a41f50fc525ffba2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:40.693781 24118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.693464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.12.148.65:53205)
0808 04:40:40.693618 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.693704 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260808 04:40:40.694860 24117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.694431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.12.148.67:40319)
0808 04:40:40.694731 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.694787 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":234}
I20260808 04:40:40.697304 24165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.696854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.12.148.66:46831)
0808 04:40:40.697181 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.697235 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":258}
I20260808 04:40:40.697324 24174 mvcc.cc:205] Tried to move back new op lower bound from 7316127910664466432 to 7316127910563852288. Current Snapshot: MvccSnapshot[applied={T|T < 7316127910664466432}]
I20260808 04:40:40.697768 24117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.696976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.12.148.67:34827)
0808 04:40:40.697624 (+ 648us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.697701 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":569}
I20260808 04:40:40.703172 24118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:40.702893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41335 (local address 127.12.148.65:50745)
0808 04:40:40.703031 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.703090 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:41335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260808 04:40:40.703811 24175 mvcc.cc:205] Tried to move back new op lower bound from 7316127910664466432 to 7316127910563852288. Current Snapshot: MvccSnapshot[applied={T|T < 7316127910664466432}]
I20260808 04:40:40.704908 23336 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43410:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:40.705082 23336 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43410:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:40.708987 23336 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4d013e883a6b4893b49cafa319d3eb20: Sending DeleteTablet for 3 replicas of tablet ee1cf10647d94253b27424960f7dd1b3
I20260808 04:40:40.709780 23694 tablet_service.cc:1514] Processing DeleteTablet for tablet ee1cf10647d94253b27424960f7dd1b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:40 UTC) from {username='oryx', principal='oryx/127.12.148.124@KRBTEST.COM'} at 127.0.0.1:48740
I20260808 04:40:40.709897 23501 tablet_service.cc:1514] Processing DeleteTablet for tablet ee1cf10647d94253b27424960f7dd1b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:40 UTC) from {username='oryx', principal='oryx/127.12.148.124@KRBTEST.COM'} at 127.0.0.1:55546
I20260808 04:40:40.710125 23902 tablet_service.cc:1514] Processing DeleteTablet for tablet ee1cf10647d94253b27424960f7dd1b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:40 UTC) from {username='oryx', principal='oryx/127.12.148.124@KRBTEST.COM'} at 127.0.0.1:40786
I20260808 04:40:40.710327 24189 tablet_replica.cc:330] T ee1cf10647d94253b27424960f7dd1b3 P 6867e539dee64800a41f50fc525ffba2: stopping tablet replica
I20260808 04:40:40.710500 24189 raft_consensus.cc:2229] T ee1cf10647d94253b27424960f7dd1b3 P 6867e539dee64800a41f50fc525ffba2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:40.710520 24190 tablet_replica.cc:330] T ee1cf10647d94253b27424960f7dd1b3 P 48c5ece7716c44a4bf4e1491ec34eedd: stopping tablet replica
I20260808 04:40:40.710598 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 23278
I20260808 04:40:40.711112 24190 raft_consensus.cc:2229] T ee1cf10647d94253b27424960f7dd1b3 P 48c5ece7716c44a4bf4e1491ec34eedd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:40.711252 24190 raft_consensus.cc:2258] T ee1cf10647d94253b27424960f7dd1b3 P 48c5ece7716c44a4bf4e1491ec34eedd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:40.713733 24190 ts_tablet_manager.cc:1905] T ee1cf10647d94253b27424960f7dd1b3 P 48c5ece7716c44a4bf4e1491ec34eedd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:40.716333 24190 ts_tablet_manager.cc:1918] T ee1cf10647d94253b27424960f7dd1b3 P 48c5ece7716c44a4bf4e1491ec34eedd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:40:40.716404 24190 log.cc:1196] T ee1cf10647d94253b27424960f7dd1b3 P 48c5ece7716c44a4bf4e1491ec34eedd: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-2/wal/wals/ee1cf10647d94253b27424960f7dd1b3
I20260808 04:40:40.716663 24190 ts_tablet_manager.cc:1939] T ee1cf10647d94253b27424960f7dd1b3 P 48c5ece7716c44a4bf4e1491ec34eedd: Deleting consensus metadata
I20260808 04:40:40.717383 23311 catalog_manager.cc:4841] TS 48c5ece7716c44a4bf4e1491ec34eedd (127.12.148.67:37211): tablet ee1cf10647d94253b27424960f7dd1b3 (table test-table [id=14c5328321114dbab25a1b044a08f63b]) successfully deleted
I20260808 04:40:40.720831 24188 tablet_replica.cc:330] T ee1cf10647d94253b27424960f7dd1b3 P dedcf4f874fd4a5a91d5ba4d784c2af0: stopping tablet replica
I20260808 04:40:40.720983 24188 raft_consensus.cc:2229] T ee1cf10647d94253b27424960f7dd1b3 P dedcf4f874fd4a5a91d5ba4d784c2af0 [term 1 LEADER]: Raft consensus shutting down.
I20260808 04:40:40.721312 24188 raft_consensus.cc:2258] T ee1cf10647d94253b27424960f7dd1b3 P dedcf4f874fd4a5a91d5ba4d784c2af0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:40.722049 24188 ts_tablet_manager.cc:1905] T ee1cf10647d94253b27424960f7dd1b3 P dedcf4f874fd4a5a91d5ba4d784c2af0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:40.724624 24188 ts_tablet_manager.cc:1918] T ee1cf10647d94253b27424960f7dd1b3 P dedcf4f874fd4a5a91d5ba4d784c2af0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:40:40.724704 24188 log.cc:1196] T ee1cf10647d94253b27424960f7dd1b3 P dedcf4f874fd4a5a91d5ba4d784c2af0: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786164004017495-12881-0/minicluster-data/ts-1/wal/wals/ee1cf10647d94253b27424960f7dd1b3
I20260808 04:40:40.725023 24188 ts_tablet_manager.cc:1939] T ee1cf10647d94253b27424960f7dd1b3 P dedcf4f874fd4a5a91d5ba4d784c2af0: Deleting consensus metadata
I20260808 04:40:40.725773 23315 catalog_manager.cc:4841] TS dedcf4f874fd4a5a91d5ba4d784c2af0 (127.12.148.66:46085): tablet ee1cf10647d94253b27424960f7dd1b3 (table test-table [id=14c5328321114dbab25a1b044a08f63b]) successfully deleted
W20260808 04:40:40.728967 24143 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:40.728648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:40203 (local address 127.0.0.1:55552)
0808 04:40:40.728779 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:40.728843 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.65:40203: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":45}
I20260808 04:40:40.728998 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 23605
W20260808 04:40:40.735242 23315 catalog_manager.cc:4584] TS 6867e539dee64800a41f50fc525ffba2 (127.12.148.65:40203): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ee1cf10647d94253b27424960f7dd1b3: Network error: Client connection negotiation failed: client connection to 127.12.148.65:40203: connect: Connection reset by peer (error 104)
I20260808 04:40:40.741674 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 23810
I20260808 04:40:40.757035 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 22865
I20260808 04:40:40.770183 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 23019
2026-08-08T04:40:40Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (6920 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:40:40 dist-test-slave-t7g5 krb5kdc[24193](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:40:40 dist-test-slave-t7g5 krb5kdc[24193](info): set up 2 sockets
Aug 08 04:40:40 dist-test-slave-t7g5 krb5kdc[24193](info): commencing operation
krb5kdc: starting...
W20260808 04:40:41.932919 12881 mini_kdc.cc:121] Time spent starting KDC: real 1.133s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Aug 08 04:40:42 dist-test-slave-t7g5 krb5kdc[24193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164042, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:40:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:40:42Z Disabled control of system clock
WARNING: no policy specified for oryx/127.12.148.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.148.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.148.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.126.keytab.
Entry for principal oryx/127.12.148.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.126.keytab.
I20260808 04:40:42.054253 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:33701
--webserver_interface=127.12.148.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.126.keytab
--principal=oryx/127.12.148.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:35415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:33701
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:42.163825 24209 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:42.164076 24209 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:42.164115 24209 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:42.167979 24209 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:40:42.168030 24209 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 04:40:42.168046 24209 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:42.168077 24209 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:42.168104 24209 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:40:42.168129 24209 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:40:42.173259 24209 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:35415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:33701
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.126.keytab
--principal=oryx/127.12.148.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:33701
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24209
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:42.174224 24209 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:42.175176 24209 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:42.183233 24221 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:42.183259 24220 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:42.183254 24224 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:42.183357 24209 server_base.cc:1034] running on GCE node
I20260808 04:40:42.183944 24209 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:42.184984 24209 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:42.186138 24209 hybrid_clock.cc:648] HybridClock initialized: now 1786164042186124 us; error 31 us; skew 500 ppm
Aug 08 04:40:42 dist-test-slave-t7g5 krb5kdc[24193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164042, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.148.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:42.188781 24209 init.cc:377] Logged in from keytab as oryx/127.12.148.126@KRBTEST.COM (short username oryx)
I20260808 04:40:42.189810 24209 webserver.cc:460] Webserver started at http://127.12.148.126:43275/ using document root <none> and password file <none>
I20260808 04:40:42.190537 24209 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:42.190623 24209 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:42.190860 24209 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:42.193339 24209 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "571fa95fbb5e45b0b6e9e7e8272adc11"
format_stamp: "Formatted at 2026-08-08 04:40:42 on dist-test-slave-t7g5"
server_key: "32b1c2190232afa3d0c51c3c7cc08c8f"
server_key_iv: "7ff4a9bd9512a7a809224302ffd112ff"
server_key_version: "encryptionkey@0"
I20260808 04:40:42.193976 24209 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "571fa95fbb5e45b0b6e9e7e8272adc11"
format_stamp: "Formatted at 2026-08-08 04:40:42 on dist-test-slave-t7g5"
server_key: "32b1c2190232afa3d0c51c3c7cc08c8f"
server_key_iv: "7ff4a9bd9512a7a809224302ffd112ff"
server_key_version: "encryptionkey@0"
I20260808 04:40:42.197576 24209 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:40:42.199853 24235 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:42.201020 24209 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:40:42.201134 24209 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "571fa95fbb5e45b0b6e9e7e8272adc11"
format_stamp: "Formatted at 2026-08-08 04:40:42 on dist-test-slave-t7g5"
server_key: "32b1c2190232afa3d0c51c3c7cc08c8f"
server_key_iv: "7ff4a9bd9512a7a809224302ffd112ff"
server_key_version: "encryptionkey@0"
I20260808 04:40:42.201231 24209 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:42.219527 24209 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:42.222586 24209 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:42.222769 24209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:42.230652 24209 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:33701
I20260808 04:40:42.230676 24325 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:33701 every 8 connection(s)
I20260808 04:40:42.231630 24209 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:40:42.234480 24326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:42.240017 24326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 571fa95fbb5e45b0b6e9e7e8272adc11: Bootstrap starting.
I20260808 04:40:42.240845 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 24209
I20260808 04:40:42.240986 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:40:42.241328 12881 external_mini_cluster.cc:1428] Setting key 189be83328188589faef361656eaa6a5
I20260808 04:40:42.242990 24326 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 571fa95fbb5e45b0b6e9e7e8272adc11: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:42.243705 24326 log.cc:824] T 00000000000000000000000000000000 P 571fa95fbb5e45b0b6e9e7e8272adc11: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:42.245864 24326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 571fa95fbb5e45b0b6e9e7e8272adc11: No bootstrap required, opened a new log
I20260808 04:40:42.249716 24326 raft_consensus.cc:348] T 00000000000000000000000000000000 P 571fa95fbb5e45b0b6e9e7e8272adc11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "571fa95fbb5e45b0b6e9e7e8272adc11" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 33701 } }
I20260808 04:40:42.249964 24326 raft_consensus.cc:374] T 00000000000000000000000000000000 P 571fa95fbb5e45b0b6e9e7e8272adc11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:42.250026 24326 raft_consensus.cc:729] T 00000000000000000000000000000000 P 571fa95fbb5e45b0b6e9e7e8272adc11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 571fa95fbb5e45b0b6e9e7e8272adc11, State: Initialized, Role: FOLLOWER
I20260808 04:40:42.250447 24326 consensus_queue.cc:260] T 00000000000000000000000000000000 P 571fa95fbb5e45b0b6e9e7e8272adc11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "571fa95fbb5e45b0b6e9e7e8272adc11" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 33701 } }
I20260808 04:40:42.250569 24326 raft_consensus.cc:388] T 00000000000000000000000000000000 P 571fa95fbb5e45b0b6e9e7e8272adc11 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:40:42.250629 24326 raft_consensus.cc:482] T 00000000000000000000000000000000 P 571fa95fbb5e45b0b6e9e7e8272adc11 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:40:42.250722 24326 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 571fa95fbb5e45b0b6e9e7e8272adc11 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:42.251783 24326 raft_consensus.cc:504] T 00000000000000000000000000000000 P 571fa95fbb5e45b0b6e9e7e8272adc11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "571fa95fbb5e45b0b6e9e7e8272adc11" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 33701 } }
I20260808 04:40:42.252166 24326 leader_election.cc:302] T 00000000000000000000000000000000 P 571fa95fbb5e45b0b6e9e7e8272adc11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 571fa95fbb5e45b0b6e9e7e8272adc11; no voters:
I20260808 04:40:42.252498 24326 leader_election.cc:288] T 00000000000000000000000000000000 P 571fa95fbb5e45b0b6e9e7e8272adc11 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:40:42.252625 24334 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 571fa95fbb5e45b0b6e9e7e8272adc11 [term 1 FOLLOWER]: Leader election won for term 1
Aug 08 04:40:42 dist-test-slave-t7g5 krb5kdc[24193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164042, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM
I20260808 04:40:42.252858 24334 raft_consensus.cc:686] T 00000000000000000000000000000000 P 571fa95fbb5e45b0b6e9e7e8272adc11 [term 1 LEADER]: Becoming Leader. State: Replica: 571fa95fbb5e45b0b6e9e7e8272adc11, State: Running, Role: LEADER
I20260808 04:40:42.253165 24334 consensus_queue.cc:237] T 00000000000000000000000000000000 P 571fa95fbb5e45b0b6e9e7e8272adc11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "571fa95fbb5e45b0b6e9e7e8272adc11" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 33701 } }
I20260808 04:40:42.253809 24326 sys_catalog.cc:564] T 00000000000000000000000000000000 P 571fa95fbb5e45b0b6e9e7e8272adc11 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:40:42.254737 24336 sys_catalog.cc:455] T 00000000000000000000000000000000 P 571fa95fbb5e45b0b6e9e7e8272adc11 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 571fa95fbb5e45b0b6e9e7e8272adc11. Latest consensus state: current_term: 1 leader_uuid: "571fa95fbb5e45b0b6e9e7e8272adc11" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "571fa95fbb5e45b0b6e9e7e8272adc11" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 33701 } } }
I20260808 04:40:42.254945 24336 sys_catalog.cc:458] T 00000000000000000000000000000000 P 571fa95fbb5e45b0b6e9e7e8272adc11 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:42.255064 24339 sys_catalog.cc:455] T 00000000000000000000000000000000 P 571fa95fbb5e45b0b6e9e7e8272adc11 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "571fa95fbb5e45b0b6e9e7e8272adc11" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "571fa95fbb5e45b0b6e9e7e8272adc11" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 33701 } } }
I20260808 04:40:42.255239 24339 sys_catalog.cc:458] T 00000000000000000000000000000000 P 571fa95fbb5e45b0b6e9e7e8272adc11 [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:42.255723 24344 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:40:42.258852 24329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:42.242522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39154 (local address 127.12.148.126:33701)
0808 04:40:42.242964 (+ 442us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:42.242981 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:42.243018 (+ 37us) server_negotiation.cc:407] Connection header received
0808 04:40:42.243682 (+ 664us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:42.243700 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:42.244087 (+ 387us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:42.244470 (+ 383us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:42.245297 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.246355 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.247480 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.247959 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.248082 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:42.253511 (+ 5429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:42.253517 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:42.253534 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:42.253568 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:42.255657 (+ 2089us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:42.256183 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:42.256189 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:42.256196 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:42.256346 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:42.256661 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:42.256665 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:42.256666 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:42.257092 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:42.257294 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:42.257606 (+ 312us) server_negotiation.cc:299] Negotiation successful
0808 04:40:42.257934 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":129,"threads_started":1}
I20260808 04:40:42.258876 24344 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:40:42.265424 24344 catalog_manager.cc:1347] Generated new cluster ID: 5011da0755e84a968da1d0a545cc87ac
I20260808 04:40:42.265497 24344 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:40:42.280460 24344 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:40:42.281559 24344 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:40:42.287309 24344 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 571fa95fbb5e45b0b6e9e7e8272adc11: Generated new TSK 0
I20260808 04:40:42.287981 24344 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.12.148.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.148.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.148.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.65.keytab.
Entry for principal oryx/127.12.148.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.65.keytab.
I20260808 04:40:42.317536 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.65:0
--local_ip_for_outbound_sockets=127.12.148.65
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:33701
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.65.keytab
--principal=oryx/127.12.148.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:35415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:42.431926 24369 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:42.432206 24369 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:42.432269 24369 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:42.436271 24369 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:42.436331 24369 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:42.436394 24369 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 04:40:42.436447 24369 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.65
I20260808 04:40:42.441521 24369 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:35415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.65.keytab
--principal=oryx/127.12.148.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.148.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.148.126:33701
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24369
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.65
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:42.442569 24369 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:42.443586 24369 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:42.452677 24376 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:42.452696 24379 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:42.452684 24377 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:42.452960 24369 server_base.cc:1034] running on GCE node
I20260808 04:40:42.453372 24369 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:42.454095 24369 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:42.455253 24369 hybrid_clock.cc:648] HybridClock initialized: now 1786164042455225 us; error 43 us; skew 500 ppm
Aug 08 04:40:42 dist-test-slave-t7g5 krb5kdc[24193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164042, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.148.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:42.458017 24369 init.cc:377] Logged in from keytab as oryx/127.12.148.65@KRBTEST.COM (short username oryx)
I20260808 04:40:42.458791 24369 webserver.cc:460] Webserver started at http://127.12.148.65:41861/ using document root <none> and password file <none>
I20260808 04:40:42.459298 24369 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:42.459365 24369 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:42.459534 24369 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:42.461488 24369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-0/data/instance:
uuid: "1290fe9c320c4a5bab2ea6198b8ba682"
format_stamp: "Formatted at 2026-08-08 04:40:42 on dist-test-slave-t7g5"
server_key: "828a148be319abeb844a3e01a672eec2"
server_key_iv: "abeca5b42fba122476f184051c7f60f0"
server_key_version: "encryptionkey@0"
I20260808 04:40:42.462038 24369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance:
uuid: "1290fe9c320c4a5bab2ea6198b8ba682"
format_stamp: "Formatted at 2026-08-08 04:40:42 on dist-test-slave-t7g5"
server_key: "828a148be319abeb844a3e01a672eec2"
server_key_iv: "abeca5b42fba122476f184051c7f60f0"
server_key_version: "encryptionkey@0"
I20260808 04:40:42.465520 24369 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:40:42.467916 24388 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:42.469064 24369 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:40:42.469162 24369 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-0/wal
uuid: "1290fe9c320c4a5bab2ea6198b8ba682"
format_stamp: "Formatted at 2026-08-08 04:40:42 on dist-test-slave-t7g5"
server_key: "828a148be319abeb844a3e01a672eec2"
server_key_iv: "abeca5b42fba122476f184051c7f60f0"
server_key_version: "encryptionkey@0"
I20260808 04:40:42.469267 24369 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:42.484413 24369 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:42.487357 24369 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:42.487519 24369 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:42.488864 24369 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:42.488912 24369 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:42.488951 24369 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:42.488978 24369 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 04:40:42 dist-test-slave-t7g5 krb5kdc[24193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164042, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.148.65@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM
I20260808 04:40:42.498895 24369 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.65:32879
I20260808 04:40:42.498919 24550 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.65:32879 every 8 connection(s)
I20260808 04:40:42.499969 24369 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
I20260808 04:40:42.502884 24329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:42.489722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:55451 (local address 127.12.148.126:33701)
0808 04:40:42.489834 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:42.489838 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:42.490856 (+ 1018us) server_negotiation.cc:407] Connection header received
0808 04:40:42.491890 (+ 1034us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:42.491893 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:42.491951 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:42.492008 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:42.493693 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.494530 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.496307 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.496674 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.496789 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:42.499630 (+ 2841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:42.499633 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:42.499635 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:42.499662 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:42.501124 (+ 1462us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:42.501560 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:42.501562 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:42.501564 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:42.501637 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:42.501975 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:42.501978 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:42.501979 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:42.502170 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:42.502247 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:42.502653 (+ 406us) server_negotiation.cc:299] Negotiation successful
0808 04:40:42.502760 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 04:40:42.503690 24401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:42.490241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:33701 (local address 127.12.148.65:55451)
0808 04:40:42.490703 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:42.490745 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:42.491636 (+ 891us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:42.492411 (+ 775us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:42.492419 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:42.492830 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:42.493483 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:42.493505 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.494726 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.494729 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:42.496159 (+ 1430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:42.496171 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.496842 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.496846 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:42.497032 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:42.497699 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:42.497721 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:42.499447 (+ 1726us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:42.501223 (+ 1776us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:42.501227 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:42.501237 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:42.501484 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:42.501742 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:42.501744 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:42.501746 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:42.501901 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:42.502245 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:42.502250 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:42.502474 (+ 224us) client_negotiation.cc:769] Sending connection context
0808 04:40:42.502622 (+ 148us) client_negotiation.cc:240] Negotiation successful
0808 04:40:42.502887 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":139,"threads_started":1}
I20260808 04:40:42.504983 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 24369
I20260808 04:40:42.505132 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance
I20260808 04:40:42.505127 24552 heartbeater.cc:347] Connected to a master server at 127.12.148.126:33701
I20260808 04:40:42.505264 24552 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:42.505491 12881 external_mini_cluster.cc:1428] Setting key a8a03ea1c93381c1ae60142b8c58c4e8
I20260808 04:40:42.505923 24552 heartbeater.cc:511] Master 127.12.148.126:33701 requested a full tablet report, sending...
I20260808 04:40:42.507555 24258 ts_manager.cc:194] Registered new tserver with Master: 1290fe9c320c4a5bab2ea6198b8ba682 (127.12.148.65:32879)
I20260808 04:40:42.508711 24258 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.148.65@KRBTEST.COM'} at 127.12.148.65:55451
I20260808 04:40:42.516078 24561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:42.507391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:33701 (local address 127.12.148.65:57389)
0808 04:40:42.507678 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:42.507692 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:42.507775 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:42.509705 (+ 1930us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:42.509709 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:42.509943 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:42.510073 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:42.510080 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.511061 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.511064 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:42.511611 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:42.511619 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.512132 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.512134 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:42.512203 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:42.512692 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:42.512703 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:42.513008 (+ 305us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:42.514768 (+ 1760us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:42.514770 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:42.514772 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:42.514964 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:42.515230 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:42.515232 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:42.515233 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:42.515296 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:42.515679 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:42.515681 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:42.515751 (+ 70us) client_negotiation.cc:769] Sending connection context
0808 04:40:42.515823 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 04:40:42.515944 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195,"mutex_wait_us":1,"thread_start_us":100,"threads_started":1}
I20260808 04:40:42.516178 24329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:42.509313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:57389 (local address 127.12.148.126:33701)
0808 04:40:42.509460 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:42.509465 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:42.509478 (+ 13us) server_negotiation.cc:407] Connection header received
0808 04:40:42.509512 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:42.509515 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:42.509557 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:42.509643 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:42.510200 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.510937 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.511725 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.512031 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.512134 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:42.513136 (+ 1002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:42.513140 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:42.513143 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:42.513169 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:42.514666 (+ 1497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:42.515052 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:42.515055 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:42.515057 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:42.515150 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:42.515368 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:42.515371 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:42.515373 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:42.515600 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:42.515699 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:42.515910 (+ 211us) server_negotiation.cc:299] Negotiation successful
0808 04:40:42.516025 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
WARNING: no policy specified for oryx/127.12.148.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.148.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.148.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.66.keytab.
Entry for principal oryx/127.12.148.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.66.keytab.
I20260808 04:40:42.534705 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.66:0
--local_ip_for_outbound_sockets=127.12.148.66
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:33701
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.66.keytab
--principal=oryx/127.12.148.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:35415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:42.645337 24566 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:42.645623 24566 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:42.645735 24566 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:42.649847 24566 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:42.649914 24566 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:42.649981 24566 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 04:40:42.650043 24566 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.66
I20260808 04:40:42.655335 24566 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:35415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.66.keytab
--principal=oryx/127.12.148.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.148.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.148.126:33701
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24566
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.66
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:42.656447 24566 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:42.657461 24566 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:42.666857 24574 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:42.666886 24578 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:42.666877 24575 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:42.667158 24566 server_base.cc:1034] running on GCE node
I20260808 04:40:42.667587 24566 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:42.668282 24566 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:42.669464 24566 hybrid_clock.cc:648] HybridClock initialized: now 1786164042669447 us; error 32 us; skew 500 ppm
Aug 08 04:40:42 dist-test-slave-t7g5 krb5kdc[24193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164042, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.148.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:42.672425 24566 init.cc:377] Logged in from keytab as oryx/127.12.148.66@KRBTEST.COM (short username oryx)
I20260808 04:40:42.673305 24566 webserver.cc:460] Webserver started at http://127.12.148.66:37551/ using document root <none> and password file <none>
I20260808 04:40:42.673905 24566 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:42.673980 24566 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:42.674185 24566 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:42.676199 24566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-1/data/instance:
uuid: "024908296986489cb8db33bd7cf59298"
format_stamp: "Formatted at 2026-08-08 04:40:42 on dist-test-slave-t7g5"
server_key: "fffad3c0e17274a66d7131ac97548ae3"
server_key_iv: "26c2a307ffcdd8f813102c9690ebaab5"
server_key_version: "encryptionkey@0"
I20260808 04:40:42.676736 24566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance:
uuid: "024908296986489cb8db33bd7cf59298"
format_stamp: "Formatted at 2026-08-08 04:40:42 on dist-test-slave-t7g5"
server_key: "fffad3c0e17274a66d7131ac97548ae3"
server_key_iv: "26c2a307ffcdd8f813102c9690ebaab5"
server_key_version: "encryptionkey@0"
I20260808 04:40:42.680359 24566 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260808 04:40:42.682775 24586 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:42.683938 24566 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 04:40:42.684046 24566 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-1/wal
uuid: "024908296986489cb8db33bd7cf59298"
format_stamp: "Formatted at 2026-08-08 04:40:42 on dist-test-slave-t7g5"
server_key: "fffad3c0e17274a66d7131ac97548ae3"
server_key_iv: "26c2a307ffcdd8f813102c9690ebaab5"
server_key_version: "encryptionkey@0"
I20260808 04:40:42.684136 24566 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:42.701853 24566 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:42.704567 24566 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:42.704735 24566 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:42.706370 24566 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:42.706421 24566 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:42.706473 24566 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:42.706501 24566 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 04:40:42 dist-test-slave-t7g5 krb5kdc[24193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164042, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.148.66@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM
I20260808 04:40:42.716878 24566 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.66:41953
I20260808 04:40:42.717135 24747 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.66:41953 every 8 connection(s)
I20260808 04:40:42.717864 24566 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
I20260808 04:40:42.719529 24329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:42.707008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:38573 (local address 127.12.148.126:33701)
0808 04:40:42.707150 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:42.707154 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:42.708099 (+ 945us) server_negotiation.cc:407] Connection header received
0808 04:40:42.709293 (+ 1194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:42.709297 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:42.709359 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:42.709459 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:42.710778 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.711486 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.712902 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.713160 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.713251 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:42.715997 (+ 2746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:42.716000 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:42.716002 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:42.716028 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:42.717537 (+ 1509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:42.718122 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:42.718125 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:42.718126 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:42.718218 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:42.718610 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:42.718613 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:42.718615 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:42.718811 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:42.718891 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:42.719313 (+ 422us) server_negotiation.cc:299] Negotiation successful
0808 04:40:42.719410 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 04:40:42.720229 24601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:42.707424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:33701 (local address 127.12.148.66:38573)
0808 04:40:42.707918 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:42.707978 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:42.709049 (+ 1071us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:42.709740 (+ 691us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:42.709749 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:42.710109 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:42.710588 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:42.710602 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.711612 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.711616 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:42.712783 (+ 1167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:42.712793 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.713329 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.713334 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:42.713497 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:42.714047 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:42.714066 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:42.715838 (+ 1772us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:42.717646 (+ 1808us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:42.717677 (+ 31us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:42.717690 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:42.718022 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:42.718329 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:42.718332 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:42.718334 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:42.718497 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:42.718905 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:42.718910 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:42.719119 (+ 209us) client_negotiation.cc:769] Sending connection context
0808 04:40:42.719264 (+ 145us) client_negotiation.cc:240] Negotiation successful
0808 04:40:42.719503 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":110,"threads_started":1}
I20260808 04:40:42.721361 24748 heartbeater.cc:347] Connected to a master server at 127.12.148.126:33701
I20260808 04:40:42.721508 24748 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:42.721498 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 24566
I20260808 04:40:42.721633 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance
I20260808 04:40:42.721999 12881 external_mini_cluster.cc:1428] Setting key d5d0f9eacb585e8c475b1b86bd7ea0c9
I20260808 04:40:42.722009 24748 heartbeater.cc:511] Master 127.12.148.126:33701 requested a full tablet report, sending...
I20260808 04:40:42.722954 24258 ts_manager.cc:194] Registered new tserver with Master: 024908296986489cb8db33bd7cf59298 (127.12.148.66:41953)
I20260808 04:40:42.723555 24258 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.148.66@KRBTEST.COM'} at 127.12.148.66:38573
I20260808 04:40:42.731024 24329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:42.724055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:49589 (local address 127.12.148.126:33701)
0808 04:40:42.724180 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:42.724184 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:42.724305 (+ 121us) server_negotiation.cc:407] Connection header received
0808 04:40:42.724482 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:42.724485 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:42.724534 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:42.724610 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:42.725090 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.725798 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.726788 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.727013 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.727098 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:42.728174 (+ 1076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:42.728177 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:42.728179 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:42.728200 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:42.729480 (+ 1280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:42.729952 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:42.729955 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:42.729956 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:42.730029 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:42.730291 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:42.730293 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:42.730294 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:42.730485 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:42.730556 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:42.730819 (+ 263us) server_negotiation.cc:299] Negotiation successful
0808 04:40:42.730914 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 04:40:42.731324 24759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:42.723977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:33701 (local address 127.12.148.66:49589)
0808 04:40:42.724235 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:42.724250 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:42.724365 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:42.724656 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:42.724659 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:42.724861 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:42.724980 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:42.724986 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.725930 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.725934 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:42.726678 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:42.726688 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.727111 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.727115 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:42.727202 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:42.727650 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:42.727660 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:42.728052 (+ 392us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:42.729587 (+ 1535us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:42.729590 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:42.729592 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:42.729865 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:42.730112 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:42.730116 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:42.730117 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:42.730216 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:42.730570 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:42.730572 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:42.730673 (+ 101us) client_negotiation.cc:769] Sending connection context
0808 04:40:42.730786 (+ 113us) client_negotiation.cc:240] Negotiation successful
0808 04:40:42.730930 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":90,"threads_started":1}
WARNING: no policy specified for oryx/127.12.148.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.148.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.148.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.67.keytab.
Entry for principal oryx/127.12.148.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.67.keytab.
I20260808 04:40:42.750082 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.67:0
--local_ip_for_outbound_sockets=127.12.148.67
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:33701
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.67.keytab
--principal=oryx/127.12.148.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:35415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:42.861768 24765 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:42.862064 24765 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:42.862114 24765 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:42.866071 24765 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:42.866132 24765 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:42.866170 24765 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 04:40:42.866222 24765 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.67
I20260808 04:40:42.871459 24765 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:35415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.67.keytab
--principal=oryx/127.12.148.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.148.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.148.126:33701
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24765
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.67
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:42.872545 24765 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:42.873622 24765 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:42.883023 24777 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:42.883037 24772 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:42.883070 24765 server_base.cc:1034] running on GCE node
W20260808 04:40:42.883023 24774 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:42.883648 24765 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:42.884246 24765 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:42.885409 24765 hybrid_clock.cc:648] HybridClock initialized: now 1786164042885388 us; error 34 us; skew 500 ppm
Aug 08 04:40:42 dist-test-slave-t7g5 krb5kdc[24193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164042, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.148.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:42.888145 24765 init.cc:377] Logged in from keytab as oryx/127.12.148.67@KRBTEST.COM (short username oryx)
I20260808 04:40:42.888963 24765 webserver.cc:460] Webserver started at http://127.12.148.67:45249/ using document root <none> and password file <none>
I20260808 04:40:42.889479 24765 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:42.889544 24765 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:42.889770 24765 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:42.891757 24765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-2/data/instance:
uuid: "6a7befd1873541e48410b6fa35c843e0"
format_stamp: "Formatted at 2026-08-08 04:40:42 on dist-test-slave-t7g5"
server_key: "bcc30919d2f2c4b82af9b15412c14342"
server_key_iv: "a5ab3a00350baa5826f01b7c7e4d3c2c"
server_key_version: "encryptionkey@0"
I20260808 04:40:42.892302 24765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance:
uuid: "6a7befd1873541e48410b6fa35c843e0"
format_stamp: "Formatted at 2026-08-08 04:40:42 on dist-test-slave-t7g5"
server_key: "bcc30919d2f2c4b82af9b15412c14342"
server_key_iv: "a5ab3a00350baa5826f01b7c7e4d3c2c"
server_key_version: "encryptionkey@0"
I20260808 04:40:42.896241 24765 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 04:40:42.898844 24789 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:42.900128 24765 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 04:40:42.900231 24765 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-2/wal
uuid: "6a7befd1873541e48410b6fa35c843e0"
format_stamp: "Formatted at 2026-08-08 04:40:42 on dist-test-slave-t7g5"
server_key: "bcc30919d2f2c4b82af9b15412c14342"
server_key_iv: "a5ab3a00350baa5826f01b7c7e4d3c2c"
server_key_version: "encryptionkey@0"
I20260808 04:40:42.900343 24765 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:42.911415 24765 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:42.914393 24765 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:42.914562 24765 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:42.915977 24765 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:42.916028 24765 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:42.916067 24765 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:42.916095 24765 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 04:40:42 dist-test-slave-t7g5 krb5kdc[24193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164042, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.148.67@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM
I20260808 04:40:42.925722 24765 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.67:36219
I20260808 04:40:42.925796 24954 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.67:36219 every 8 connection(s)
I20260808 04:40:42.926594 24765 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
I20260808 04:40:42.929760 24329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:42.916704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:37705 (local address 127.12.148.126:33701)
0808 04:40:42.916856 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:42.916861 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:42.917680 (+ 819us) server_negotiation.cc:407] Connection header received
0808 04:40:42.918688 (+ 1008us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:42.918692 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:42.918753 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:42.918812 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:42.920399 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.921203 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.922987 (+ 1784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.923210 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.923297 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:42.926249 (+ 2952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:42.926253 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:42.926256 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:42.926283 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:42.927755 (+ 1472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:42.928246 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:42.928248 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:42.928249 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:42.928332 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:42.928665 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:42.928667 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:42.928668 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:42.928853 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:42.928948 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:42.929436 (+ 488us) server_negotiation.cc:299] Negotiation successful
0808 04:40:42.929563 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 04:40:42.930521 24804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:42.917063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:33701 (local address 127.12.148.67:37705)
0808 04:40:42.917518 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:42.917566 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:42.918435 (+ 869us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:42.919241 (+ 806us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:42.919250 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:42.919635 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:42.920254 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:42.920275 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.921343 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.921348 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:42.922860 (+ 1512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:42.922873 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.923378 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.923382 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:42.923590 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:42.924261 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:42.924286 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:42.926078 (+ 1792us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:42.927864 (+ 1786us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:42.927870 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:42.927885 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:42.928135 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:42.928417 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:42.928420 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:42.928422 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:42.928564 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:42.928953 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:42.928960 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:42.929194 (+ 234us) client_negotiation.cc:769] Sending connection context
0808 04:40:42.929358 (+ 164us) client_negotiation.cc:240] Negotiation successful
0808 04:40:42.929715 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":110,"threads_started":1}
I20260808 04:40:42.931630 24956 heartbeater.cc:347] Connected to a master server at 127.12.148.126:33701
I20260808 04:40:42.931773 24956 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:42.932258 24956 heartbeater.cc:511] Master 127.12.148.126:33701 requested a full tablet report, sending...
I20260808 04:40:42.933298 24259 ts_manager.cc:194] Registered new tserver with Master: 6a7befd1873541e48410b6fa35c843e0 (127.12.148.67:36219)
I20260808 04:40:42.934078 24259 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.148.67@KRBTEST.COM'} at 127.12.148.67:37705
I20260808 04:40:42.936057 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 24765
I20260808 04:40:42.936169 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance
I20260808 04:40:42.936506 12881 external_mini_cluster.cc:1428] Setting key 96e92333f8d8ee9200d39b7e38eb6968
I20260808 04:40:42.938409 12881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 04:40:42.939992 24329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:42.933672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:34399 (local address 127.12.148.126:33701)
0808 04:40:42.933829 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:42.933833 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:42.933912 (+ 79us) server_negotiation.cc:407] Connection header received
0808 04:40:42.934008 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:42.934010 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:42.934044 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:42.934104 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:42.934565 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.935049 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.935870 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.936088 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.936182 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:42.937230 (+ 1048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:42.937234 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:42.937236 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:42.937266 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:42.938551 (+ 1285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:42.938935 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:42.938938 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:42.938940 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:42.939014 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:42.939262 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:42.939265 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:42.939267 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:42.939428 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:42.939511 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:42.939753 (+ 242us) server_negotiation.cc:299] Negotiation successful
0808 04:40:42.939849 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260808 04:40:42.940011 24968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:42.933548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:33701 (local address 127.12.148.67:34399)
0808 04:40:42.933834 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:42.933849 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:42.933942 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:42.934138 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:42.934141 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:42.934350 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:42.934469 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:42.934476 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.935176 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.935179 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:42.935748 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:42.935756 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.936211 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.936215 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:42.936309 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:42.936766 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:42.936781 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:42.937099 (+ 318us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:42.938652 (+ 1553us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:42.938654 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:42.938657 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:42.938849 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:42.939094 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:42.939096 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:42.939098 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:42.939175 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:42.939517 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:42.939520 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:42.939607 (+ 87us) client_negotiation.cc:769] Sending connection context
0808 04:40:42.939691 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 04:40:42.939833 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":115,"threads_started":1}
Aug 08 04:40:42 dist-test-slave-t7g5 krb5kdc[24193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164042, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 04:40:42 dist-test-slave-t7g5 krb5kdc[24193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:42 dist-test-slave-t7g5 krb5kdc[24193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
W20260808 04:40:42.963724 24329 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:42.957778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39166 (local address 127.12.148.126:33701)
0808 04:40:42.957919 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:42.957924 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:42.957946 (+ 22us) server_negotiation.cc:407] Connection header received
0808 04:40:42.957992 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:42.957995 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:42.958035 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:42.958101 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:42.958828 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.959358 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.960193 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.960422 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.960513 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:42.963564 (+ 3051us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39166: BlockingRecv error: recv got EOF from 127.0.0.1:39166 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 08 04:40:42 dist-test-slave-t7g5 krb5kdc[24193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164042, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM
I20260808 04:40:42.972016 24329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:42.965012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39176 (local address 127.12.148.126:33701)
0808 04:40:42.965114 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:42.965118 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:42.965231 (+ 113us) server_negotiation.cc:407] Connection header received
0808 04:40:42.965333 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:42.965335 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:42.965372 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:42.965435 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:42.966016 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.966497 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.967206 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.967402 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.967474 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:42.969616 (+ 2142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:42.969619 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:42.969621 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:42.969643 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:42.970746 (+ 1103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:42.971094 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:42.971097 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:42.971098 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:42.971165 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:42.971345 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:42.971347 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:42.971348 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:42.971505 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:42.971598 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:42.971769 (+ 171us) server_negotiation.cc:299] Negotiation successful
0808 04:40:42.971859 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 04:40:42.974790 24259 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39176:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:40:42.977711 24259 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:40:42.991671 24991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:42.985812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46700 (local address 127.12.148.66:41953)
0808 04:40:42.986847 (+ 1035us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:42.986859 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:42.986917 (+ 58us) server_negotiation.cc:407] Connection header received
0808 04:40:42.986998 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:42.987004 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:42.987212 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:42.987378 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:42.987657 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.988862 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.990452 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.991026 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.991124 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:42.991288 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:42.991426 (+ 138us) server_negotiation.cc:299] Negotiation successful
0808 04:40:42.991518 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":936,"thread_start_us":113,"threads_started":1}
I20260808 04:40:42.991662 24990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:42.985603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:41953 (local address 127.0.0.1:46700)
0808 04:40:42.985983 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:42.986037 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:42.986157 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:42.987372 (+ 1215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:42.987378 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:42.987400 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:42.987536 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:42.987543 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.988980 (+ 1437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.988983 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:42.990306 (+ 1323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:42.990317 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.991137 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.991141 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:42.991249 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:42.991288 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 04:40:42.991394 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 04:40:42.991534 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"mutex_wait_us":65,"thread_start_us":124,"threads_started":1}
I20260808 04:40:42.991858 24994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:42.986043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.67:36219 (local address 127.0.0.1:55116)
0808 04:40:42.986846 (+ 803us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:42.986859 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:42.987011 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:42.987551 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:42.987554 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:42.987572 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:42.987670 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:42.987677 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.989082 (+ 1405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.989086 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:42.990153 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:42.990163 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.991352 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.991356 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:42.991445 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:42.991468 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 04:40:42.991536 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 04:40:42.991603 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":750,"mutex_wait_us":19,"thread_start_us":95,"threads_started":1}
I20260808 04:40:42.991976 24993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:42.986299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37472 (local address 127.12.148.65:32879)
0808 04:40:42.986708 (+ 409us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:42.986726 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:42.987185 (+ 459us) server_negotiation.cc:407] Connection header received
0808 04:40:42.987373 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:42.987379 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:42.987575 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:42.987722 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:42.987876 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.988708 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.990458 (+ 1750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.991223 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.991320 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:42.991475 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:42.991763 (+ 288us) server_negotiation.cc:299] Negotiation successful
0808 04:40:42.991846 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":94,"threads_started":1}
I20260808 04:40:42.991976 24996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:42.986455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55116 (local address 127.12.148.67:36219)
0808 04:40:42.986907 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:42.986918 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:42.986941 (+ 23us) server_negotiation.cc:407] Connection header received
0808 04:40:42.987152 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:42.987158 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:42.987312 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:42.987433 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:42.987875 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.988963 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.990271 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.991029 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.991133 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:42.991289 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:42.991732 (+ 443us) server_negotiation.cc:299] Negotiation successful
0808 04:40:42.991825 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":359,"thread_start_us":106,"threads_started":1}
I20260808 04:40:42.992309 24992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:42.986469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:32879 (local address 127.0.0.1:37472)
0808 04:40:42.987080 (+ 611us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:42.987092 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:42.987250 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:42.987688 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:42.987691 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:42.987707 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:42.987785 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:42.987790 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.988817 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.988821 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:42.990348 (+ 1527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:42.990355 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:42.991534 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:42.991538 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:42.991622 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:42.991643 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 04:40:42.992118 (+ 475us) client_negotiation.cc:240] Negotiation successful
0808 04:40:42.992195 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":556,"mutex_wait_us":132,"thread_start_us":84,"threads_started":1}
I20260808 04:40:42.994830 24462 tablet_service.cc:1467] Processing CreateTablet for tablet 9f30903832154ed7a94d03d3f7d2b878 (DEFAULT_TABLE table=test-table [id=691f058df173482f8cf75b819b87fd5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:42.994995 24862 tablet_service.cc:1467] Processing CreateTablet for tablet 9f30903832154ed7a94d03d3f7d2b878 (DEFAULT_TABLE table=test-table [id=691f058df173482f8cf75b819b87fd5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:42.995152 24658 tablet_service.cc:1467] Processing CreateTablet for tablet 9f30903832154ed7a94d03d3f7d2b878 (DEFAULT_TABLE table=test-table [id=691f058df173482f8cf75b819b87fd5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:42.995859 24462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f30903832154ed7a94d03d3f7d2b878. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:42.996052 24862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f30903832154ed7a94d03d3f7d2b878. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:42.996044 24658 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f30903832154ed7a94d03d3f7d2b878. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:43.002395 24998 tablet_bootstrap.cc:492] T 9f30903832154ed7a94d03d3f7d2b878 P 1290fe9c320c4a5bab2ea6198b8ba682: Bootstrap starting.
I20260808 04:40:43.003847 24999 tablet_bootstrap.cc:492] T 9f30903832154ed7a94d03d3f7d2b878 P 6a7befd1873541e48410b6fa35c843e0: Bootstrap starting.
I20260808 04:40:43.005136 24998 tablet_bootstrap.cc:654] T 9f30903832154ed7a94d03d3f7d2b878 P 1290fe9c320c4a5bab2ea6198b8ba682: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:43.006165 24999 tablet_bootstrap.cc:654] T 9f30903832154ed7a94d03d3f7d2b878 P 6a7befd1873541e48410b6fa35c843e0: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:43.006191 24998 log.cc:824] T 9f30903832154ed7a94d03d3f7d2b878 P 1290fe9c320c4a5bab2ea6198b8ba682: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:43.006881 25000 tablet_bootstrap.cc:492] T 9f30903832154ed7a94d03d3f7d2b878 P 024908296986489cb8db33bd7cf59298: Bootstrap starting.
I20260808 04:40:43.007010 24999 log.cc:824] T 9f30903832154ed7a94d03d3f7d2b878 P 6a7befd1873541e48410b6fa35c843e0: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:43.008188 24998 tablet_bootstrap.cc:492] T 9f30903832154ed7a94d03d3f7d2b878 P 1290fe9c320c4a5bab2ea6198b8ba682: No bootstrap required, opened a new log
I20260808 04:40:43.008404 24998 ts_tablet_manager.cc:1397] T 9f30903832154ed7a94d03d3f7d2b878 P 1290fe9c320c4a5bab2ea6198b8ba682: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 04:40:43.008950 24999 tablet_bootstrap.cc:492] T 9f30903832154ed7a94d03d3f7d2b878 P 6a7befd1873541e48410b6fa35c843e0: No bootstrap required, opened a new log
I20260808 04:40:43.008991 25000 tablet_bootstrap.cc:654] T 9f30903832154ed7a94d03d3f7d2b878 P 024908296986489cb8db33bd7cf59298: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:43.009130 24999 ts_tablet_manager.cc:1397] T 9f30903832154ed7a94d03d3f7d2b878 P 6a7befd1873541e48410b6fa35c843e0: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 04:40:43.009785 25000 log.cc:824] T 9f30903832154ed7a94d03d3f7d2b878 P 024908296986489cb8db33bd7cf59298: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:43.011740 25000 tablet_bootstrap.cc:492] T 9f30903832154ed7a94d03d3f7d2b878 P 024908296986489cb8db33bd7cf59298: No bootstrap required, opened a new log
I20260808 04:40:43.011590 24998 raft_consensus.cc:348] T 9f30903832154ed7a94d03d3f7d2b878 P 1290fe9c320c4a5bab2ea6198b8ba682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } }
I20260808 04:40:43.011857 24998 raft_consensus.cc:374] T 9f30903832154ed7a94d03d3f7d2b878 P 1290fe9c320c4a5bab2ea6198b8ba682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:43.011967 25000 ts_tablet_manager.cc:1397] T 9f30903832154ed7a94d03d3f7d2b878 P 024908296986489cb8db33bd7cf59298: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260808 04:40:43.011960 24998 raft_consensus.cc:729] T 9f30903832154ed7a94d03d3f7d2b878 P 1290fe9c320c4a5bab2ea6198b8ba682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1290fe9c320c4a5bab2ea6198b8ba682, State: Initialized, Role: FOLLOWER
I20260808 04:40:43.012442 24998 consensus_queue.cc:260] T 9f30903832154ed7a94d03d3f7d2b878 P 1290fe9c320c4a5bab2ea6198b8ba682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } }
I20260808 04:40:43.012521 24999 raft_consensus.cc:348] T 9f30903832154ed7a94d03d3f7d2b878 P 6a7befd1873541e48410b6fa35c843e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } }
I20260808 04:40:43.012810 24999 raft_consensus.cc:374] T 9f30903832154ed7a94d03d3f7d2b878 P 6a7befd1873541e48410b6fa35c843e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:43.012916 24999 raft_consensus.cc:729] T 9f30903832154ed7a94d03d3f7d2b878 P 6a7befd1873541e48410b6fa35c843e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a7befd1873541e48410b6fa35c843e0, State: Initialized, Role: FOLLOWER
I20260808 04:40:43.013346 24999 consensus_queue.cc:260] T 9f30903832154ed7a94d03d3f7d2b878 P 6a7befd1873541e48410b6fa35c843e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } }
I20260808 04:40:43.013459 24998 ts_tablet_manager.cc:1428] T 9f30903832154ed7a94d03d3f7d2b878 P 1290fe9c320c4a5bab2ea6198b8ba682: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260808 04:40:43.013803 24552 heartbeater.cc:503] Master 127.12.148.126:33701 was elected leader, sending a full tablet report...
I20260808 04:40:43.013984 24956 heartbeater.cc:503] Master 127.12.148.126:33701 was elected leader, sending a full tablet report...
I20260808 04:40:43.014216 24999 ts_tablet_manager.cc:1428] T 9f30903832154ed7a94d03d3f7d2b878 P 6a7befd1873541e48410b6fa35c843e0: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260808 04:40:43.016341 25000 raft_consensus.cc:348] T 9f30903832154ed7a94d03d3f7d2b878 P 024908296986489cb8db33bd7cf59298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } }
I20260808 04:40:43.016621 25000 raft_consensus.cc:374] T 9f30903832154ed7a94d03d3f7d2b878 P 024908296986489cb8db33bd7cf59298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:43.016902 25000 raft_consensus.cc:729] T 9f30903832154ed7a94d03d3f7d2b878 P 024908296986489cb8db33bd7cf59298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 024908296986489cb8db33bd7cf59298, State: Initialized, Role: FOLLOWER
I20260808 04:40:43.017311 25000 consensus_queue.cc:260] T 9f30903832154ed7a94d03d3f7d2b878 P 024908296986489cb8db33bd7cf59298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } }
I20260808 04:40:43.017973 24748 heartbeater.cc:503] Master 127.12.148.126:33701 was elected leader, sending a full tablet report...
I20260808 04:40:43.018245 25000 ts_tablet_manager.cc:1428] T 9f30903832154ed7a94d03d3f7d2b878 P 024908296986489cb8db33bd7cf59298: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260808 04:40:43.032564 25006 raft_consensus.cc:482] T 9f30903832154ed7a94d03d3f7d2b878 P 024908296986489cb8db33bd7cf59298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:40:43.032788 25006 raft_consensus.cc:504] T 9f30903832154ed7a94d03d3f7d2b878 P 024908296986489cb8db33bd7cf59298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } }
I20260808 04:40:43.033952 25006 leader_election.cc:288] T 9f30903832154ed7a94d03d3f7d2b878 P 024908296986489cb8db33bd7cf59298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1290fe9c320c4a5bab2ea6198b8ba682 (127.12.148.65:32879), 6a7befd1873541e48410b6fa35c843e0 (127.12.148.67:36219)
I20260808 04:40:43.037472 24601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:43.034172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:32879 (local address 127.12.148.66:48313)
0808 04:40:43.034356 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:43.034371 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:43.034462 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:43.034695 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:43.034698 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:43.034718 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:43.034845 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:43.034850 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.035672 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.035675 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:43.036461 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:43.036469 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.037078 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.037081 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:43.037189 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:43.037207 (+ 18us) client_negotiation.cc:769] Sending connection context
0808 04:40:43.037272 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 04:40:43.037344 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110}
I20260808 04:40:43.037472 24993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:43.034251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:48313 (local address 127.12.148.65:32879)
0808 04:40:43.034376 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:43.034380 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:43.034471 (+ 91us) server_negotiation.cc:407] Connection header received
0808 04:40:43.034539 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:43.034542 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:43.034592 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:43.034669 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:43.034956 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.035568 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.036581 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.036969 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.037072 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:43.037127 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:43.037296 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 04:40:43.037362 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 04:40:43.038089 25007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:43.034201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.67:36219 (local address 127.12.148.66:34901)
0808 04:40:43.034585 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:43.034597 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:43.034681 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:43.035069 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:43.035072 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:43.035089 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:43.035215 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:43.035222 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.035929 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.035932 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:43.037025 (+ 1093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:43.037035 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.037721 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.037725 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:43.037815 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:43.037838 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 04:40:43.037905 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 04:40:43.037963 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":116,"threads_started":1}
I20260808 04:40:43.038098 24996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:43.034294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:34901 (local address 127.12.148.67:36219)
0808 04:40:43.034419 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:43.034423 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:43.034756 (+ 333us) server_negotiation.cc:407] Connection header received
0808 04:40:43.034811 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:43.034814 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:43.034894 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:43.034963 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:43.035329 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.035828 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.037148 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.037532 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.037642 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:43.037707 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:43.037926 (+ 219us) server_negotiation.cc:299] Negotiation successful
0808 04:40:43.037998 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 04:40:43.038132 24487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f30903832154ed7a94d03d3f7d2b878" candidate_uuid: "024908296986489cb8db33bd7cf59298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" is_pre_election: true
I20260808 04:40:43.038470 24487 raft_consensus.cc:2454] T 9f30903832154ed7a94d03d3f7d2b878 P 1290fe9c320c4a5bab2ea6198b8ba682 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 024908296986489cb8db33bd7cf59298 in term 0.
I20260808 04:40:43.038668 24886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f30903832154ed7a94d03d3f7d2b878" candidate_uuid: "024908296986489cb8db33bd7cf59298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a7befd1873541e48410b6fa35c843e0" is_pre_election: true
I20260808 04:40:43.038937 24886 raft_consensus.cc:2454] T 9f30903832154ed7a94d03d3f7d2b878 P 6a7befd1873541e48410b6fa35c843e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 024908296986489cb8db33bd7cf59298 in term 0.
I20260808 04:40:43.038972 24588 leader_election.cc:302] T 9f30903832154ed7a94d03d3f7d2b878 P 024908296986489cb8db33bd7cf59298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024908296986489cb8db33bd7cf59298, 1290fe9c320c4a5bab2ea6198b8ba682; no voters:
I20260808 04:40:43.039232 25006 raft_consensus.cc:2781] T 9f30903832154ed7a94d03d3f7d2b878 P 024908296986489cb8db33bd7cf59298 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:40:43.039335 25006 raft_consensus.cc:482] T 9f30903832154ed7a94d03d3f7d2b878 P 024908296986489cb8db33bd7cf59298 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:40:43.039386 25006 raft_consensus.cc:3037] T 9f30903832154ed7a94d03d3f7d2b878 P 024908296986489cb8db33bd7cf59298 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:43.040381 25006 raft_consensus.cc:504] T 9f30903832154ed7a94d03d3f7d2b878 P 024908296986489cb8db33bd7cf59298 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } }
I20260808 04:40:43.040731 25006 leader_election.cc:288] T 9f30903832154ed7a94d03d3f7d2b878 P 024908296986489cb8db33bd7cf59298 [CANDIDATE]: Term 1 election: Requested vote from peers 1290fe9c320c4a5bab2ea6198b8ba682 (127.12.148.65:32879), 6a7befd1873541e48410b6fa35c843e0 (127.12.148.67:36219)
I20260808 04:40:43.041059 24487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f30903832154ed7a94d03d3f7d2b878" candidate_uuid: "024908296986489cb8db33bd7cf59298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1290fe9c320c4a5bab2ea6198b8ba682"
I20260808 04:40:43.041107 24886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f30903832154ed7a94d03d3f7d2b878" candidate_uuid: "024908296986489cb8db33bd7cf59298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a7befd1873541e48410b6fa35c843e0"
I20260808 04:40:43.041188 24487 raft_consensus.cc:3037] T 9f30903832154ed7a94d03d3f7d2b878 P 1290fe9c320c4a5bab2ea6198b8ba682 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:43.041216 24886 raft_consensus.cc:3037] T 9f30903832154ed7a94d03d3f7d2b878 P 6a7befd1873541e48410b6fa35c843e0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:43.042291 24487 raft_consensus.cc:2454] T 9f30903832154ed7a94d03d3f7d2b878 P 1290fe9c320c4a5bab2ea6198b8ba682 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024908296986489cb8db33bd7cf59298 in term 1.
I20260808 04:40:43.042294 24886 raft_consensus.cc:2454] T 9f30903832154ed7a94d03d3f7d2b878 P 6a7befd1873541e48410b6fa35c843e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024908296986489cb8db33bd7cf59298 in term 1.
I20260808 04:40:43.042613 24587 leader_election.cc:302] T 9f30903832154ed7a94d03d3f7d2b878 P 024908296986489cb8db33bd7cf59298 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 024908296986489cb8db33bd7cf59298, 1290fe9c320c4a5bab2ea6198b8ba682, 6a7befd1873541e48410b6fa35c843e0; no voters:
I20260808 04:40:43.042817 25006 raft_consensus.cc:2781] T 9f30903832154ed7a94d03d3f7d2b878 P 024908296986489cb8db33bd7cf59298 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:43.043021 25006 raft_consensus.cc:686] T 9f30903832154ed7a94d03d3f7d2b878 P 024908296986489cb8db33bd7cf59298 [term 1 LEADER]: Becoming Leader. State: Replica: 024908296986489cb8db33bd7cf59298, State: Running, Role: LEADER
I20260808 04:40:43.043315 25006 consensus_queue.cc:237] T 9f30903832154ed7a94d03d3f7d2b878 P 024908296986489cb8db33bd7cf59298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } }
I20260808 04:40:43.046375 24259 catalog_manager.cc:5495] T 9f30903832154ed7a94d03d3f7d2b878 P 024908296986489cb8db33bd7cf59298 reported cstate change: term changed from 0 to 1, leader changed from <none> to 024908296986489cb8db33bd7cf59298 (127.12.148.66). New cstate: current_term: 1 leader_uuid: "024908296986489cb8db33bd7cf59298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } health_report { overall_health: UNKNOWN } } }
I20260808 04:40:43.070439 24991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:43.067407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46706 (local address 127.12.148.66:41953)
0808 04:40:43.067513 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:43.067516 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:43.067528 (+ 12us) server_negotiation.cc:407] Connection header received
0808 04:40:43.067657 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:43.067660 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:43.067713 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:43.067798 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:43.067977 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.068465 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.069226 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.069434 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.069503 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:43.069717 (+ 214us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:43.070148 (+ 431us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:43.070232 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:43.070282 (+ 50us) server_negotiation.cc:299] Negotiation successful
0808 04:40:43.070330 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 04:40:43.076033 24487 raft_consensus.cc:1261] T 9f30903832154ed7a94d03d3f7d2b878 P 1290fe9c320c4a5bab2ea6198b8ba682 [term 1 FOLLOWER]: Refusing update from remote peer 024908296986489cb8db33bd7cf59298: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:43.076326 24886 raft_consensus.cc:1261] T 9f30903832154ed7a94d03d3f7d2b878 P 6a7befd1873541e48410b6fa35c843e0 [term 1 FOLLOWER]: Refusing update from remote peer 024908296986489cb8db33bd7cf59298: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:43.076706 25008 consensus_queue.cc:1035] T 9f30903832154ed7a94d03d3f7d2b878 P 024908296986489cb8db33bd7cf59298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:43.076905 25006 consensus_queue.cc:1035] T 9f30903832154ed7a94d03d3f7d2b878 P 024908296986489cb8db33bd7cf59298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:43.085076 25011 mvcc.cc:205] Tried to move back new op lower bound from 7316127920432947200 to 7316127920307863552. Current Snapshot: MvccSnapshot[applied={T|T < 7316127920432947200}]
I20260808 04:40:43.085254 25012 mvcc.cc:205] Tried to move back new op lower bound from 7316127920432947200 to 7316127920307863552. Current Snapshot: MvccSnapshot[applied={T|T < 7316127920432947200}]
I20260808 04:40:43.093784 24258 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39176:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:43.093946 24258 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39176:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:43.096306 24258 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 571fa95fbb5e45b0b6e9e7e8272adc11: Sending DeleteTablet for 3 replicas of tablet 9f30903832154ed7a94d03d3f7d2b878
I20260808 04:40:43.097090 24658 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f30903832154ed7a94d03d3f7d2b878 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:43 UTC) from {username='oryx', principal='oryx/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:46700
I20260808 04:40:43.097079 24462 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f30903832154ed7a94d03d3f7d2b878 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:43 UTC) from {username='oryx', principal='oryx/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:37472
I20260808 04:40:43.097159 24862 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f30903832154ed7a94d03d3f7d2b878 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:43 UTC) from {username='oryx', principal='oryx/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:55116
I20260808 04:40:43.097537 25021 tablet_replica.cc:330] T 9f30903832154ed7a94d03d3f7d2b878 P 024908296986489cb8db33bd7cf59298: stopping tablet replica
I20260808 04:40:43.097728 25023 tablet_replica.cc:330] T 9f30903832154ed7a94d03d3f7d2b878 P 1290fe9c320c4a5bab2ea6198b8ba682: stopping tablet replica
I20260808 04:40:43.097972 25021 raft_consensus.cc:2229] T 9f30903832154ed7a94d03d3f7d2b878 P 024908296986489cb8db33bd7cf59298 [term 1 LEADER]: Raft consensus shutting down.
I20260808 04:40:43.098335 25021 raft_consensus.cc:2258] T 9f30903832154ed7a94d03d3f7d2b878 P 024908296986489cb8db33bd7cf59298 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:43.098320 24258 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39176:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:40:43.098724 24258 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:40:43.098143 25023 raft_consensus.cc:2229] T 9f30903832154ed7a94d03d3f7d2b878 P 1290fe9c320c4a5bab2ea6198b8ba682 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:43.099632 25023 raft_consensus.cc:2258] T 9f30903832154ed7a94d03d3f7d2b878 P 1290fe9c320c4a5bab2ea6198b8ba682 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:43.099740 25021 ts_tablet_manager.cc:1905] T 9f30903832154ed7a94d03d3f7d2b878 P 024908296986489cb8db33bd7cf59298: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:43.102223 25023 ts_tablet_manager.cc:1905] T 9f30903832154ed7a94d03d3f7d2b878 P 1290fe9c320c4a5bab2ea6198b8ba682: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:43.103494 24462 tablet_service.cc:1467] Processing CreateTablet for tablet 34204dfa47c3415e8b95e2b893c68b44 (DEFAULT_TABLE table=test-table [id=9772128dd9504995b11308f93b22a890]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:43.103538 24862 tablet_service.cc:1467] Processing CreateTablet for tablet 34204dfa47c3415e8b95e2b893c68b44 (DEFAULT_TABLE table=test-table [id=9772128dd9504995b11308f93b22a890]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:43.103538 24658 tablet_service.cc:1467] Processing CreateTablet for tablet 34204dfa47c3415e8b95e2b893c68b44 (DEFAULT_TABLE table=test-table [id=9772128dd9504995b11308f93b22a890]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:43.103767 24862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34204dfa47c3415e8b95e2b893c68b44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:43.103767 24462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34204dfa47c3415e8b95e2b893c68b44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:43.103783 24658 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34204dfa47c3415e8b95e2b893c68b44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:43.104941 25022 tablet_replica.cc:330] T 9f30903832154ed7a94d03d3f7d2b878 P 6a7befd1873541e48410b6fa35c843e0: stopping tablet replica
I20260808 04:40:43.105325 25022 raft_consensus.cc:2229] T 9f30903832154ed7a94d03d3f7d2b878 P 6a7befd1873541e48410b6fa35c843e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:43.106042 24999 tablet_bootstrap.cc:492] T 34204dfa47c3415e8b95e2b893c68b44 P 6a7befd1873541e48410b6fa35c843e0: Bootstrap starting.
I20260808 04:40:43.106173 24998 tablet_bootstrap.cc:492] T 34204dfa47c3415e8b95e2b893c68b44 P 1290fe9c320c4a5bab2ea6198b8ba682: Bootstrap starting.
I20260808 04:40:43.106889 24999 tablet_bootstrap.cc:654] T 34204dfa47c3415e8b95e2b893c68b44 P 6a7befd1873541e48410b6fa35c843e0: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:43.107084 24998 tablet_bootstrap.cc:654] T 34204dfa47c3415e8b95e2b893c68b44 P 1290fe9c320c4a5bab2ea6198b8ba682: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:43.107167 25023 ts_tablet_manager.cc:1918] T 9f30903832154ed7a94d03d3f7d2b878 P 1290fe9c320c4a5bab2ea6198b8ba682: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:40:43.107257 25023 log.cc:1196] T 9f30903832154ed7a94d03d3f7d2b878 P 1290fe9c320c4a5bab2ea6198b8ba682: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-0/wal/wals/9f30903832154ed7a94d03d3f7d2b878
I20260808 04:40:43.107738 25000 tablet_bootstrap.cc:492] T 34204dfa47c3415e8b95e2b893c68b44 P 024908296986489cb8db33bd7cf59298: Bootstrap starting.
I20260808 04:40:43.107968 25023 ts_tablet_manager.cc:1939] T 9f30903832154ed7a94d03d3f7d2b878 P 1290fe9c320c4a5bab2ea6198b8ba682: Deleting consensus metadata
I20260808 04:40:43.108036 24999 tablet_bootstrap.cc:492] T 34204dfa47c3415e8b95e2b893c68b44 P 6a7befd1873541e48410b6fa35c843e0: No bootstrap required, opened a new log
I20260808 04:40:43.108119 24999 ts_tablet_manager.cc:1397] T 34204dfa47c3415e8b95e2b893c68b44 P 6a7befd1873541e48410b6fa35c843e0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 04:40:43.108572 24999 raft_consensus.cc:348] T 34204dfa47c3415e8b95e2b893c68b44 P 6a7befd1873541e48410b6fa35c843e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } }
I20260808 04:40:43.108649 25000 tablet_bootstrap.cc:654] T 34204dfa47c3415e8b95e2b893c68b44 P 024908296986489cb8db33bd7cf59298: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:43.108695 24999 raft_consensus.cc:374] T 34204dfa47c3415e8b95e2b893c68b44 P 6a7befd1873541e48410b6fa35c843e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:43.108733 24999 raft_consensus.cc:729] T 34204dfa47c3415e8b95e2b893c68b44 P 6a7befd1873541e48410b6fa35c843e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a7befd1873541e48410b6fa35c843e0, State: Initialized, Role: FOLLOWER
I20260808 04:40:43.108850 24999 consensus_queue.cc:260] T 34204dfa47c3415e8b95e2b893c68b44 P 6a7befd1873541e48410b6fa35c843e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } }
I20260808 04:40:43.109043 25022 raft_consensus.cc:2258] T 9f30903832154ed7a94d03d3f7d2b878 P 6a7befd1873541e48410b6fa35c843e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:43.109125 24999 ts_tablet_manager.cc:1428] T 34204dfa47c3415e8b95e2b893c68b44 P 6a7befd1873541e48410b6fa35c843e0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 04:40:43.110334 25021 ts_tablet_manager.cc:1918] T 9f30903832154ed7a94d03d3f7d2b878 P 024908296986489cb8db33bd7cf59298: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:40:43.110436 25021 log.cc:1196] T 9f30903832154ed7a94d03d3f7d2b878 P 024908296986489cb8db33bd7cf59298: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-1/wal/wals/9f30903832154ed7a94d03d3f7d2b878
I20260808 04:40:43.110766 25021 ts_tablet_manager.cc:1939] T 9f30903832154ed7a94d03d3f7d2b878 P 024908296986489cb8db33bd7cf59298: Deleting consensus metadata
I20260808 04:40:43.111892 24239 catalog_manager.cc:4841] TS 024908296986489cb8db33bd7cf59298 (127.12.148.66:41953): tablet 9f30903832154ed7a94d03d3f7d2b878 (table test-table [id=691f058df173482f8cf75b819b87fd5e]) successfully deleted
I20260808 04:40:43.112457 25022 ts_tablet_manager.cc:1905] T 9f30903832154ed7a94d03d3f7d2b878 P 6a7befd1873541e48410b6fa35c843e0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:43.112773 25000 tablet_bootstrap.cc:492] T 34204dfa47c3415e8b95e2b893c68b44 P 024908296986489cb8db33bd7cf59298: No bootstrap required, opened a new log
I20260808 04:40:43.112862 25000 ts_tablet_manager.cc:1397] T 34204dfa47c3415e8b95e2b893c68b44 P 024908296986489cb8db33bd7cf59298: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260808 04:40:43.113291 25000 raft_consensus.cc:348] T 34204dfa47c3415e8b95e2b893c68b44 P 024908296986489cb8db33bd7cf59298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } }
I20260808 04:40:43.113404 25000 raft_consensus.cc:374] T 34204dfa47c3415e8b95e2b893c68b44 P 024908296986489cb8db33bd7cf59298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:43.113435 25000 raft_consensus.cc:729] T 34204dfa47c3415e8b95e2b893c68b44 P 024908296986489cb8db33bd7cf59298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 024908296986489cb8db33bd7cf59298, State: Initialized, Role: FOLLOWER
I20260808 04:40:43.113555 25000 consensus_queue.cc:260] T 34204dfa47c3415e8b95e2b893c68b44 P 024908296986489cb8db33bd7cf59298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } }
I20260808 04:40:43.113833 25000 ts_tablet_manager.cc:1428] T 34204dfa47c3415e8b95e2b893c68b44 P 024908296986489cb8db33bd7cf59298: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 04:40:43.114650 25022 ts_tablet_manager.cc:1918] T 9f30903832154ed7a94d03d3f7d2b878 P 6a7befd1873541e48410b6fa35c843e0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:40:43.114743 25022 log.cc:1196] T 9f30903832154ed7a94d03d3f7d2b878 P 6a7befd1873541e48410b6fa35c843e0: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-2/wal/wals/9f30903832154ed7a94d03d3f7d2b878
I20260808 04:40:43.115034 25022 ts_tablet_manager.cc:1939] T 9f30903832154ed7a94d03d3f7d2b878 P 6a7befd1873541e48410b6fa35c843e0: Deleting consensus metadata
I20260808 04:40:43.116577 24237 catalog_manager.cc:4841] TS 1290fe9c320c4a5bab2ea6198b8ba682 (127.12.148.65:32879): tablet 9f30903832154ed7a94d03d3f7d2b878 (table test-table [id=691f058df173482f8cf75b819b87fd5e]) successfully deleted
I20260808 04:40:43.117147 24998 tablet_bootstrap.cc:492] T 34204dfa47c3415e8b95e2b893c68b44 P 1290fe9c320c4a5bab2ea6198b8ba682: No bootstrap required, opened a new log
I20260808 04:40:43.117245 24998 ts_tablet_manager.cc:1397] T 34204dfa47c3415e8b95e2b893c68b44 P 1290fe9c320c4a5bab2ea6198b8ba682: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20260808 04:40:43.117291 24236 catalog_manager.cc:4841] TS 6a7befd1873541e48410b6fa35c843e0 (127.12.148.67:36219): tablet 9f30903832154ed7a94d03d3f7d2b878 (table test-table [id=691f058df173482f8cf75b819b87fd5e]) successfully deleted
I20260808 04:40:43.117632 24998 raft_consensus.cc:348] T 34204dfa47c3415e8b95e2b893c68b44 P 1290fe9c320c4a5bab2ea6198b8ba682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } }
I20260808 04:40:43.117760 24998 raft_consensus.cc:374] T 34204dfa47c3415e8b95e2b893c68b44 P 1290fe9c320c4a5bab2ea6198b8ba682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:43.117785 24998 raft_consensus.cc:729] T 34204dfa47c3415e8b95e2b893c68b44 P 1290fe9c320c4a5bab2ea6198b8ba682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1290fe9c320c4a5bab2ea6198b8ba682, State: Initialized, Role: FOLLOWER
I20260808 04:40:43.117901 24998 consensus_queue.cc:260] T 34204dfa47c3415e8b95e2b893c68b44 P 1290fe9c320c4a5bab2ea6198b8ba682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } }
I20260808 04:40:43.118112 24998 ts_tablet_manager.cc:1428] T 34204dfa47c3415e8b95e2b893c68b44 P 1290fe9c320c4a5bab2ea6198b8ba682: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
W20260808 04:40:43.177778 24957 tablet.cc:2369] T 34204dfa47c3415e8b95e2b893c68b44 P 6a7befd1873541e48410b6fa35c843e0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 04:40:43.219102 24750 tablet.cc:2369] T 34204dfa47c3415e8b95e2b893c68b44 P 024908296986489cb8db33bd7cf59298: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 04:40:43.251466 24554 tablet.cc:2369] T 34204dfa47c3415e8b95e2b893c68b44 P 1290fe9c320c4a5bab2ea6198b8ba682: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:40:43.572058 25005 raft_consensus.cc:482] T 34204dfa47c3415e8b95e2b893c68b44 P 6a7befd1873541e48410b6fa35c843e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:40:43.572230 25005 raft_consensus.cc:504] T 34204dfa47c3415e8b95e2b893c68b44 P 6a7befd1873541e48410b6fa35c843e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } }
I20260808 04:40:43.573375 25005 leader_election.cc:288] T 34204dfa47c3415e8b95e2b893c68b44 P 6a7befd1873541e48410b6fa35c843e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1290fe9c320c4a5bab2ea6198b8ba682 (127.12.148.65:32879), 024908296986489cb8db33bd7cf59298 (127.12.148.66:41953)
I20260808 04:40:43.577342 25030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:43.573754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:54153 (local address 127.12.148.65:32879)
0808 04:40:43.574064 (+ 310us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:43.574069 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:43.574107 (+ 38us) server_negotiation.cc:407] Connection header received
0808 04:40:43.574260 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:43.574263 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:43.574315 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:43.574388 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:43.574675 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.575192 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.576352 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.576753 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.576856 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:43.576914 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:43.577121 (+ 207us) server_negotiation.cc:299] Negotiation successful
0808 04:40:43.577197 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":230,"thread_start_us":62,"threads_started":1}
I20260808 04:40:43.577342 25031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:43.573810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:58733 (local address 127.12.148.66:41953)
0808 04:40:43.574057 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:43.574061 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:43.574209 (+ 148us) server_negotiation.cc:407] Connection header received
0808 04:40:43.574334 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:43.574337 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:43.574382 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:43.574471 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:40:43.574692 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.575191 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.576355 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.576764 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.576869 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:43.576922 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:43.577123 (+ 201us) server_negotiation.cc:299] Negotiation successful
0808 04:40:43.577203 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":60,"threads_started":1}
I20260808 04:40:43.577343 25029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:43.573676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:41953 (local address 127.12.148.67:58733)
0808 04:40:43.574128 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:43.574141 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:43.574245 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:43.574492 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:43.574495 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:43.574510 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:43.574595 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:43.574600 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.575304 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.575307 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:43.576229 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:43.576245 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.576871 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.576875 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:43.576992 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:43.577031 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 04:40:43.577095 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 04:40:43.577197 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":389,"mutex_wait_us":124,"thread_start_us":77,"threads_started":1}
I20260808 04:40:43.577355 25028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:43.573677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:32879 (local address 127.12.148.67:54153)
0808 04:40:43.574030 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:43.574045 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:43.574159 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:43.574416 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:43.574419 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:43.574435 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:40:43.574567 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:43.574574 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.575302 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.575305 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:43.576228 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:43.576238 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.576870 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.576873 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:43.576991 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:43.577027 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 04:40:43.577091 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 04:40:43.577204 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"mutex_wait_us":103,"thread_start_us":85,"threads_started":1}
I20260808 04:40:43.577883 24686 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34204dfa47c3415e8b95e2b893c68b44" candidate_uuid: "6a7befd1873541e48410b6fa35c843e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024908296986489cb8db33bd7cf59298" is_pre_election: true
I20260808 04:40:43.578140 24686 raft_consensus.cc:2454] T 34204dfa47c3415e8b95e2b893c68b44 P 024908296986489cb8db33bd7cf59298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a7befd1873541e48410b6fa35c843e0 in term 0.
I20260808 04:40:43.578275 24487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34204dfa47c3415e8b95e2b893c68b44" candidate_uuid: "6a7befd1873541e48410b6fa35c843e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" is_pre_election: true
I20260808 04:40:43.578423 24487 raft_consensus.cc:2454] T 34204dfa47c3415e8b95e2b893c68b44 P 1290fe9c320c4a5bab2ea6198b8ba682 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a7befd1873541e48410b6fa35c843e0 in term 0.
I20260808 04:40:43.578565 24795 leader_election.cc:302] T 34204dfa47c3415e8b95e2b893c68b44 P 6a7befd1873541e48410b6fa35c843e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024908296986489cb8db33bd7cf59298, 6a7befd1873541e48410b6fa35c843e0; no voters:
I20260808 04:40:43.578845 25005 raft_consensus.cc:2781] T 34204dfa47c3415e8b95e2b893c68b44 P 6a7befd1873541e48410b6fa35c843e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:40:43.578907 25005 raft_consensus.cc:482] T 34204dfa47c3415e8b95e2b893c68b44 P 6a7befd1873541e48410b6fa35c843e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:40:43.578949 25005 raft_consensus.cc:3037] T 34204dfa47c3415e8b95e2b893c68b44 P 6a7befd1873541e48410b6fa35c843e0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:43.579875 25005 raft_consensus.cc:504] T 34204dfa47c3415e8b95e2b893c68b44 P 6a7befd1873541e48410b6fa35c843e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } }
I20260808 04:40:43.580178 25005 leader_election.cc:288] T 34204dfa47c3415e8b95e2b893c68b44 P 6a7befd1873541e48410b6fa35c843e0 [CANDIDATE]: Term 1 election: Requested vote from peers 1290fe9c320c4a5bab2ea6198b8ba682 (127.12.148.65:32879), 024908296986489cb8db33bd7cf59298 (127.12.148.66:41953)
I20260808 04:40:43.580485 24487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34204dfa47c3415e8b95e2b893c68b44" candidate_uuid: "6a7befd1873541e48410b6fa35c843e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1290fe9c320c4a5bab2ea6198b8ba682"
I20260808 04:40:43.580528 24686 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34204dfa47c3415e8b95e2b893c68b44" candidate_uuid: "6a7befd1873541e48410b6fa35c843e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024908296986489cb8db33bd7cf59298"
I20260808 04:40:43.580592 24487 raft_consensus.cc:3037] T 34204dfa47c3415e8b95e2b893c68b44 P 1290fe9c320c4a5bab2ea6198b8ba682 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:43.580622 24686 raft_consensus.cc:3037] T 34204dfa47c3415e8b95e2b893c68b44 P 024908296986489cb8db33bd7cf59298 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:43.581454 24487 raft_consensus.cc:2454] T 34204dfa47c3415e8b95e2b893c68b44 P 1290fe9c320c4a5bab2ea6198b8ba682 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a7befd1873541e48410b6fa35c843e0 in term 1.
I20260808 04:40:43.581502 24686 raft_consensus.cc:2454] T 34204dfa47c3415e8b95e2b893c68b44 P 024908296986489cb8db33bd7cf59298 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a7befd1873541e48410b6fa35c843e0 in term 1.
I20260808 04:40:43.581785 24792 leader_election.cc:302] T 34204dfa47c3415e8b95e2b893c68b44 P 6a7befd1873541e48410b6fa35c843e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1290fe9c320c4a5bab2ea6198b8ba682, 6a7befd1873541e48410b6fa35c843e0; no voters:
I20260808 04:40:43.581962 25005 raft_consensus.cc:2781] T 34204dfa47c3415e8b95e2b893c68b44 P 6a7befd1873541e48410b6fa35c843e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:43.582115 25005 raft_consensus.cc:686] T 34204dfa47c3415e8b95e2b893c68b44 P 6a7befd1873541e48410b6fa35c843e0 [term 1 LEADER]: Becoming Leader. State: Replica: 6a7befd1873541e48410b6fa35c843e0, State: Running, Role: LEADER
I20260808 04:40:43.582335 25005 consensus_queue.cc:237] T 34204dfa47c3415e8b95e2b893c68b44 P 6a7befd1873541e48410b6fa35c843e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } }
I20260808 04:40:43.584450 24258 catalog_manager.cc:5495] T 34204dfa47c3415e8b95e2b893c68b44 P 6a7befd1873541e48410b6fa35c843e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a7befd1873541e48410b6fa35c843e0 (127.12.148.67). New cstate: current_term: 1 leader_uuid: "6a7befd1873541e48410b6fa35c843e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } health_report { overall_health: HEALTHY } } }
Aug 08 04:40:43 dist-test-slave-t7g5 krb5kdc[24193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164042, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.148.126@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM
I20260808 04:40:43.691176 25044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:43.683326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:33701 (local address 127.0.0.1:59190)
0808 04:40:43.683632 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:43.683646 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:43.683791 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:43.684017 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:43.684020 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:43.684447 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:43.684537 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:43.684543 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.685266 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.685269 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:43.685874 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:43.685884 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.686291 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.686295 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:43.686371 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:43.686876 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:43.686893 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:43.688350 (+ 1457us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:43.689860 (+ 1510us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:43.689869 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:43.689874 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:43.690099 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:43.690314 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:43.690316 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:43.690317 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:43.690387 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:43.690685 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:43.690689 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:43.690790 (+ 101us) client_negotiation.cc:769] Sending connection context
0808 04:40:43.690900 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 04:40:43.691018 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":112,"threads_started":1}
I20260808 04:40:43.691206 25046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:43.683390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59190 (local address 127.12.148.126:33701)
0808 04:40:43.683610 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:43.683620 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:43.683715 (+ 95us) server_negotiation.cc:407] Connection header received
0808 04:40:43.683879 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:43.683882 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:43.683919 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:43.683989 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:43.684648 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.685172 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.685974 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:43.686196 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:43.686289 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:43.688492 (+ 2203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:43.688496 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:43.688499 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:43.688527 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:43.689738 (+ 1211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:43.690174 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:43.690177 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:43.690178 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:43.690256 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:43.690453 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:43.690455 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:43.690456 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:43.690615 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:43.690684 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:43.690941 (+ 257us) server_negotiation.cc:299] Negotiation successful
0808 04:40:43.691075 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":32,"server-negotiator.queue_time_us":149,"thread_start_us":87,"threads_started":1}
I20260808 04:40:43.694895 24258 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:59190:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 04:40:43.695619 24258 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:40:43.700002 24658 tablet_service.cc:1467] Processing CreateTablet for tablet 952c21ea03064b4495325a1ae9f62802 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2a3a71c9596141aeba9009ab03050444]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 04:40:43.700002 24462 tablet_service.cc:1467] Processing CreateTablet for tablet 952c21ea03064b4495325a1ae9f62802 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2a3a71c9596141aeba9009ab03050444]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 04:40:43.700093 24862 tablet_service.cc:1467] Processing CreateTablet for tablet 952c21ea03064b4495325a1ae9f62802 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2a3a71c9596141aeba9009ab03050444]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 04:40:43.700397 24462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 952c21ea03064b4495325a1ae9f62802. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:43.700397 24658 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 952c21ea03064b4495325a1ae9f62802. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:43.700522 24862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 952c21ea03064b4495325a1ae9f62802. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:43.702975 25048 tablet_bootstrap.cc:492] T 952c21ea03064b4495325a1ae9f62802 P 6a7befd1873541e48410b6fa35c843e0: Bootstrap starting.
I20260808 04:40:43.703433 25049 tablet_bootstrap.cc:492] T 952c21ea03064b4495325a1ae9f62802 P 1290fe9c320c4a5bab2ea6198b8ba682: Bootstrap starting.
I20260808 04:40:43.703545 25050 tablet_bootstrap.cc:492] T 952c21ea03064b4495325a1ae9f62802 P 024908296986489cb8db33bd7cf59298: Bootstrap starting.
I20260808 04:40:43.704041 25048 tablet_bootstrap.cc:654] T 952c21ea03064b4495325a1ae9f62802 P 6a7befd1873541e48410b6fa35c843e0: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:43.704366 25050 tablet_bootstrap.cc:654] T 952c21ea03064b4495325a1ae9f62802 P 024908296986489cb8db33bd7cf59298: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:43.704366 25049 tablet_bootstrap.cc:654] T 952c21ea03064b4495325a1ae9f62802 P 1290fe9c320c4a5bab2ea6198b8ba682: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:43.705302 25048 tablet_bootstrap.cc:492] T 952c21ea03064b4495325a1ae9f62802 P 6a7befd1873541e48410b6fa35c843e0: No bootstrap required, opened a new log
I20260808 04:40:43.705399 25048 ts_tablet_manager.cc:1397] T 952c21ea03064b4495325a1ae9f62802 P 6a7befd1873541e48410b6fa35c843e0: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 04:40:43.705497 25049 tablet_bootstrap.cc:492] T 952c21ea03064b4495325a1ae9f62802 P 1290fe9c320c4a5bab2ea6198b8ba682: No bootstrap required, opened a new log
I20260808 04:40:43.705585 25049 ts_tablet_manager.cc:1397] T 952c21ea03064b4495325a1ae9f62802 P 1290fe9c320c4a5bab2ea6198b8ba682: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 04:40:43.705906 25048 raft_consensus.cc:348] T 952c21ea03064b4495325a1ae9f62802 P 6a7befd1873541e48410b6fa35c843e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } }
I20260808 04:40:43.706036 25048 raft_consensus.cc:374] T 952c21ea03064b4495325a1ae9f62802 P 6a7befd1873541e48410b6fa35c843e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:43.705978 25049 raft_consensus.cc:348] T 952c21ea03064b4495325a1ae9f62802 P 1290fe9c320c4a5bab2ea6198b8ba682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } }
I20260808 04:40:43.706059 25048 raft_consensus.cc:729] T 952c21ea03064b4495325a1ae9f62802 P 6a7befd1873541e48410b6fa35c843e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a7befd1873541e48410b6fa35c843e0, State: Initialized, Role: FOLLOWER
I20260808 04:40:43.706069 25049 raft_consensus.cc:374] T 952c21ea03064b4495325a1ae9f62802 P 1290fe9c320c4a5bab2ea6198b8ba682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:43.706110 25049 raft_consensus.cc:729] T 952c21ea03064b4495325a1ae9f62802 P 1290fe9c320c4a5bab2ea6198b8ba682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1290fe9c320c4a5bab2ea6198b8ba682, State: Initialized, Role: FOLLOWER
I20260808 04:40:43.706171 25048 consensus_queue.cc:260] T 952c21ea03064b4495325a1ae9f62802 P 6a7befd1873541e48410b6fa35c843e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } }
I20260808 04:40:43.706251 25049 consensus_queue.cc:260] T 952c21ea03064b4495325a1ae9f62802 P 1290fe9c320c4a5bab2ea6198b8ba682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } }
I20260808 04:40:43.706421 25048 ts_tablet_manager.cc:1428] T 952c21ea03064b4495325a1ae9f62802 P 6a7befd1873541e48410b6fa35c843e0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 04:40:43.706588 25049 ts_tablet_manager.cc:1428] T 952c21ea03064b4495325a1ae9f62802 P 1290fe9c320c4a5bab2ea6198b8ba682: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 04:40:43.706584 25055 tablet_replica.cc:439] T 952c21ea03064b4495325a1ae9f62802 P 1290fe9c320c4a5bab2ea6198b8ba682: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } } }
I20260808 04:40:43.706640 25005 tablet_replica.cc:439] T 952c21ea03064b4495325a1ae9f62802 P 6a7befd1873541e48410b6fa35c843e0: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } } }
I20260808 04:40:43.706744 25055 tablet_replica.cc:442] T 952c21ea03064b4495325a1ae9f62802 P 1290fe9c320c4a5bab2ea6198b8ba682: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 04:40:43.706756 25005 tablet_replica.cc:442] T 952c21ea03064b4495325a1ae9f62802 P 6a7befd1873541e48410b6fa35c843e0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 04:40:43.707731 25050 tablet_bootstrap.cc:492] T 952c21ea03064b4495325a1ae9f62802 P 024908296986489cb8db33bd7cf59298: No bootstrap required, opened a new log
I20260808 04:40:43.707825 25050 ts_tablet_manager.cc:1397] T 952c21ea03064b4495325a1ae9f62802 P 024908296986489cb8db33bd7cf59298: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260808 04:40:43.708226 25050 raft_consensus.cc:348] T 952c21ea03064b4495325a1ae9f62802 P 024908296986489cb8db33bd7cf59298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } }
I20260808 04:40:43.708343 25050 raft_consensus.cc:374] T 952c21ea03064b4495325a1ae9f62802 P 024908296986489cb8db33bd7cf59298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:43.708386 25050 raft_consensus.cc:729] T 952c21ea03064b4495325a1ae9f62802 P 024908296986489cb8db33bd7cf59298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 024908296986489cb8db33bd7cf59298, State: Initialized, Role: FOLLOWER
I20260808 04:40:43.708505 25050 consensus_queue.cc:260] T 952c21ea03064b4495325a1ae9f62802 P 024908296986489cb8db33bd7cf59298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } }
I20260808 04:40:43.708837 25050 ts_tablet_manager.cc:1428] T 952c21ea03064b4495325a1ae9f62802 P 024908296986489cb8db33bd7cf59298: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 04:40:43.708828 25057 tablet_replica.cc:439] T 952c21ea03064b4495325a1ae9f62802 P 024908296986489cb8db33bd7cf59298: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } } }
I20260808 04:40:43.709064 25057 tablet_replica.cc:442] T 952c21ea03064b4495325a1ae9f62802 P 024908296986489cb8db33bd7cf59298: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 04:40:43.996644 25005 consensus_queue.cc:1035] T 34204dfa47c3415e8b95e2b893c68b44 P 6a7befd1873541e48410b6fa35c843e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:44.000502 25005 consensus_queue.cc:1035] T 34204dfa47c3415e8b95e2b893c68b44 P 6a7befd1873541e48410b6fa35c843e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:44.052934 25057 raft_consensus.cc:482] T 952c21ea03064b4495325a1ae9f62802 P 024908296986489cb8db33bd7cf59298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:40:44.053076 25057 raft_consensus.cc:504] T 952c21ea03064b4495325a1ae9f62802 P 024908296986489cb8db33bd7cf59298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } }
I20260808 04:40:44.053488 25057 leader_election.cc:288] T 952c21ea03064b4495325a1ae9f62802 P 024908296986489cb8db33bd7cf59298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1290fe9c320c4a5bab2ea6198b8ba682 (127.12.148.65:32879), 6a7befd1873541e48410b6fa35c843e0 (127.12.148.67:36219)
I20260808 04:40:44.053969 24487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "952c21ea03064b4495325a1ae9f62802" candidate_uuid: "024908296986489cb8db33bd7cf59298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" is_pre_election: true
I20260808 04:40:44.053987 24886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "952c21ea03064b4495325a1ae9f62802" candidate_uuid: "024908296986489cb8db33bd7cf59298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a7befd1873541e48410b6fa35c843e0" is_pre_election: true
I20260808 04:40:44.054105 24487 raft_consensus.cc:2454] T 952c21ea03064b4495325a1ae9f62802 P 1290fe9c320c4a5bab2ea6198b8ba682 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 024908296986489cb8db33bd7cf59298 in term 0.
I20260808 04:40:44.054169 24886 raft_consensus.cc:2454] T 952c21ea03064b4495325a1ae9f62802 P 6a7befd1873541e48410b6fa35c843e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 024908296986489cb8db33bd7cf59298 in term 0.
I20260808 04:40:44.054457 24588 leader_election.cc:302] T 952c21ea03064b4495325a1ae9f62802 P 024908296986489cb8db33bd7cf59298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024908296986489cb8db33bd7cf59298, 1290fe9c320c4a5bab2ea6198b8ba682; no voters:
I20260808 04:40:44.054625 25057 raft_consensus.cc:2781] T 952c21ea03064b4495325a1ae9f62802 P 024908296986489cb8db33bd7cf59298 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:40:44.054811 25057 raft_consensus.cc:482] T 952c21ea03064b4495325a1ae9f62802 P 024908296986489cb8db33bd7cf59298 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:40:44.054854 25057 raft_consensus.cc:3037] T 952c21ea03064b4495325a1ae9f62802 P 024908296986489cb8db33bd7cf59298 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:44.055961 25057 raft_consensus.cc:504] T 952c21ea03064b4495325a1ae9f62802 P 024908296986489cb8db33bd7cf59298 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } }
I20260808 04:40:44.056289 25057 leader_election.cc:288] T 952c21ea03064b4495325a1ae9f62802 P 024908296986489cb8db33bd7cf59298 [CANDIDATE]: Term 1 election: Requested vote from peers 1290fe9c320c4a5bab2ea6198b8ba682 (127.12.148.65:32879), 6a7befd1873541e48410b6fa35c843e0 (127.12.148.67:36219)
I20260808 04:40:44.056625 24886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "952c21ea03064b4495325a1ae9f62802" candidate_uuid: "024908296986489cb8db33bd7cf59298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a7befd1873541e48410b6fa35c843e0"
I20260808 04:40:44.056655 24487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "952c21ea03064b4495325a1ae9f62802" candidate_uuid: "024908296986489cb8db33bd7cf59298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1290fe9c320c4a5bab2ea6198b8ba682"
I20260808 04:40:44.056749 24886 raft_consensus.cc:3037] T 952c21ea03064b4495325a1ae9f62802 P 6a7befd1873541e48410b6fa35c843e0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:44.056752 24487 raft_consensus.cc:3037] T 952c21ea03064b4495325a1ae9f62802 P 1290fe9c320c4a5bab2ea6198b8ba682 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:44.057857 24487 raft_consensus.cc:2454] T 952c21ea03064b4495325a1ae9f62802 P 1290fe9c320c4a5bab2ea6198b8ba682 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024908296986489cb8db33bd7cf59298 in term 1.
I20260808 04:40:44.057888 24886 raft_consensus.cc:2454] T 952c21ea03064b4495325a1ae9f62802 P 6a7befd1873541e48410b6fa35c843e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024908296986489cb8db33bd7cf59298 in term 1.
I20260808 04:40:44.058152 24587 leader_election.cc:302] T 952c21ea03064b4495325a1ae9f62802 P 024908296986489cb8db33bd7cf59298 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024908296986489cb8db33bd7cf59298, 6a7befd1873541e48410b6fa35c843e0; no voters:
I20260808 04:40:44.058296 25057 raft_consensus.cc:2781] T 952c21ea03064b4495325a1ae9f62802 P 024908296986489cb8db33bd7cf59298 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:44.058501 25057 raft_consensus.cc:686] T 952c21ea03064b4495325a1ae9f62802 P 024908296986489cb8db33bd7cf59298 [term 1 LEADER]: Becoming Leader. State: Replica: 024908296986489cb8db33bd7cf59298, State: Running, Role: LEADER
I20260808 04:40:44.058632 25057 consensus_queue.cc:237] T 952c21ea03064b4495325a1ae9f62802 P 024908296986489cb8db33bd7cf59298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } }
I20260808 04:40:44.059258 25068 tablet_replica.cc:439] T 952c21ea03064b4495325a1ae9f62802 P 024908296986489cb8db33bd7cf59298: TxnStatusTablet state changed. Reason: New leader 024908296986489cb8db33bd7cf59298. Latest consensus state: current_term: 1 leader_uuid: "024908296986489cb8db33bd7cf59298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } } }
I20260808 04:40:44.059386 25068 tablet_replica.cc:442] T 952c21ea03064b4495325a1ae9f62802 P 024908296986489cb8db33bd7cf59298: This TxnStatusTablet replica's current role is: LEADER
I20260808 04:40:44.059648 25071 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 04:40:44.059824 25071 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 04:40:44.060264 24258 catalog_manager.cc:5495] T 952c21ea03064b4495325a1ae9f62802 P 024908296986489cb8db33bd7cf59298 reported cstate change: term changed from 0 to 1, leader changed from <none> to 024908296986489cb8db33bd7cf59298 (127.12.148.66). New cstate: current_term: 1 leader_uuid: "024908296986489cb8db33bd7cf59298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } health_report { overall_health: UNKNOWN } } }
I20260808 04:40:44.158317 25044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:44.154885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:41953 (local address 127.0.0.1:43556)
0808 04:40:44.155056 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:44.155073 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:44.155188 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:44.155532 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:44.155535 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:44.155544 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 04:40:44.155648 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:44.155653 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:44.156438 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:44.156449 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:44.157096 (+ 647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:44.157106 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:44.157554 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:44.157558 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:44.157639 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:44.157715 (+ 76us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 04:40:44.158016 (+ 301us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 04:40:44.158032 (+ 16us) client_negotiation.cc:769] Sending connection context
0808 04:40:44.158094 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 04:40:44.158183 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260808 04:40:44.158335 25075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:44.154973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43556 (local address 127.12.148.66:41953)
0808 04:40:44.155256 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:44.155261 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:44.155274 (+ 13us) server_negotiation.cc:407] Connection header received
0808 04:40:44.155324 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:44.155327 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:44.155372 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:44.155498 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:44.155772 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:44.156329 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:44.157216 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:44.157450 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:44.157540 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:44.157847 (+ 307us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:44.157925 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:44.157994 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:44.158119 (+ 125us) server_negotiation.cc:299] Negotiation successful
0808 04:40:44.158173 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":211,"thread_start_us":110,"threads_started":1}
I20260808 04:40:44.161227 24487 raft_consensus.cc:1261] T 952c21ea03064b4495325a1ae9f62802 P 1290fe9c320c4a5bab2ea6198b8ba682 [term 1 FOLLOWER]: Refusing update from remote peer 024908296986489cb8db33bd7cf59298: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:44.161227 24886 raft_consensus.cc:1261] T 952c21ea03064b4495325a1ae9f62802 P 6a7befd1873541e48410b6fa35c843e0 [term 1 FOLLOWER]: Refusing update from remote peer 024908296986489cb8db33bd7cf59298: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:44.161726 25057 consensus_queue.cc:1035] T 952c21ea03064b4495325a1ae9f62802 P 024908296986489cb8db33bd7cf59298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:44.161913 25068 consensus_queue.cc:1035] T 952c21ea03064b4495325a1ae9f62802 P 024908296986489cb8db33bd7cf59298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:44.163388 25005 tablet_replica.cc:439] T 952c21ea03064b4495325a1ae9f62802 P 6a7befd1873541e48410b6fa35c843e0: TxnStatusTablet state changed. Reason: New leader 024908296986489cb8db33bd7cf59298. Latest consensus state: current_term: 1 leader_uuid: "024908296986489cb8db33bd7cf59298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } } }
I20260808 04:40:44.163542 25005 tablet_replica.cc:442] T 952c21ea03064b4495325a1ae9f62802 P 6a7befd1873541e48410b6fa35c843e0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 04:40:44.163496 25055 tablet_replica.cc:439] T 952c21ea03064b4495325a1ae9f62802 P 1290fe9c320c4a5bab2ea6198b8ba682: TxnStatusTablet state changed. Reason: New leader 024908296986489cb8db33bd7cf59298. Latest consensus state: current_term: 1 leader_uuid: "024908296986489cb8db33bd7cf59298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } } }
I20260808 04:40:44.163607 25055 tablet_replica.cc:442] T 952c21ea03064b4495325a1ae9f62802 P 1290fe9c320c4a5bab2ea6198b8ba682: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 04:40:44.165607 25068 tablet_replica.cc:439] T 952c21ea03064b4495325a1ae9f62802 P 024908296986489cb8db33bd7cf59298: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "024908296986489cb8db33bd7cf59298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } } }
I20260808 04:40:44.165745 25068 tablet_replica.cc:442] T 952c21ea03064b4495325a1ae9f62802 P 024908296986489cb8db33bd7cf59298: This TxnStatusTablet replica's current role is: LEADER
I20260808 04:40:44.167340 25055 tablet_replica.cc:439] T 952c21ea03064b4495325a1ae9f62802 P 1290fe9c320c4a5bab2ea6198b8ba682: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "024908296986489cb8db33bd7cf59298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } } }
I20260808 04:40:44.167454 25055 tablet_replica.cc:442] T 952c21ea03064b4495325a1ae9f62802 P 1290fe9c320c4a5bab2ea6198b8ba682: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 04:40:44.171272 25057 tablet_replica.cc:439] T 952c21ea03064b4495325a1ae9f62802 P 024908296986489cb8db33bd7cf59298: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "024908296986489cb8db33bd7cf59298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } } }
I20260808 04:40:44.171391 25057 tablet_replica.cc:442] T 952c21ea03064b4495325a1ae9f62802 P 024908296986489cb8db33bd7cf59298: This TxnStatusTablet replica's current role is: LEADER
I20260808 04:40:44.171875 25060 mvcc.cc:205] Tried to move back new op lower bound from 7316127924880314368 to 7316127924465393664. Current Snapshot: MvccSnapshot[applied={T|T < 7316127924880314368}]
I20260808 04:40:44.172019 25005 tablet_replica.cc:439] T 952c21ea03064b4495325a1ae9f62802 P 6a7befd1873541e48410b6fa35c843e0: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "024908296986489cb8db33bd7cf59298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } } }
I20260808 04:40:44.172128 25005 tablet_replica.cc:442] T 952c21ea03064b4495325a1ae9f62802 P 6a7befd1873541e48410b6fa35c843e0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 04:40:44.175297 25088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:44.170832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51214 (local address 127.12.148.67:36219)
0808 04:40:44.171058 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:44.171063 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:44.171076 (+ 13us) server_negotiation.cc:407] Connection header received
0808 04:40:44.171185 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:44.171188 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:44.171255 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:44.171361 (+ 106us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:44.171758 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:44.172512 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:44.173643 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:44.173914 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:44.174010 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:44.174307 (+ 297us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:44.174801 (+ 494us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:44.174911 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:44.175005 (+ 94us) server_negotiation.cc:299] Negotiation successful
0808 04:40:44.175059 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":85,"threads_started":1}
I20260808 04:40:44.185473 25093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:44.182144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:41953 (local address 127.12.148.67:45367)
0808 04:40:44.182456 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:44.182471 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:44.182576 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:44.182794 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:44.182796 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:44.182802 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 04:40:44.182888 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:44.182892 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:44.183804 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:44.183806 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:44.184394 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:44.184401 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:44.184885 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:44.184888 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:44.184953 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:44.184996 (+ 43us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 04:40:44.185249 (+ 253us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 04:40:44.185252 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 04:40:44.185293 (+ 41us) client_negotiation.cc:240] Negotiation successful
0808 04:40:44.185353 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":86,"threads_started":1}
I20260808 04:40:44.185480 25075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:44.182224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:45367 (local address 127.12.148.66:41953)
0808 04:40:44.182342 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:44.182346 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:44.182549 (+ 203us) server_negotiation.cc:407] Connection header received
0808 04:40:44.182657 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:44.182660 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:44.182713 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:44.182785 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:44.182961 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:44.183701 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:44.184500 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:44.184783 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:44.184886 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:44.185104 (+ 218us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:44.185181 (+ 77us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:44.185245 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:44.185305 (+ 60us) server_negotiation.cc:299] Negotiation successful
0808 04:40:44.185359 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 04:40:44.209779 25088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:44.206379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:38105 (local address 127.12.148.67:36219)
0808 04:40:44.206516 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:44.206520 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:44.206787 (+ 267us) server_negotiation.cc:407] Connection header received
0808 04:40:44.206901 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:44.206903 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:44.206960 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:44.207017 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:44.207268 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:44.207992 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:44.208853 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:44.209105 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:44.209204 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:44.209402 (+ 198us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:44.209471 (+ 69us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:44.209520 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:44.209580 (+ 60us) server_negotiation.cc:299] Negotiation successful
0808 04:40:44.209623 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 04:40:44.209808 25097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:44.206303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.67:36219 (local address 127.12.148.66:38105)
0808 04:40:44.206698 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:44.206714 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:44.206820 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:44.207043 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:44.207045 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:44.207053 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 04:40:44.207166 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:44.207171 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:44.208078 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:44.208081 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:44.208746 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:44.208756 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:44.209199 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:44.209201 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:44.209261 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:44.209304 (+ 43us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 04:40:44.209529 (+ 225us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 04:40:44.209532 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 04:40:44.209573 (+ 41us) client_negotiation.cc:240] Negotiation successful
0808 04:40:44.209643 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":87,"threads_started":1}
I20260808 04:40:44.230434 24258 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39176:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:44.230651 24258 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39176:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:44.232847 24258 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 571fa95fbb5e45b0b6e9e7e8272adc11: Sending DeleteTablet for 3 replicas of tablet 34204dfa47c3415e8b95e2b893c68b44
I20260808 04:40:44.233533 24658 tablet_service.cc:1514] Processing DeleteTablet for tablet 34204dfa47c3415e8b95e2b893c68b44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:44 UTC) from {username='oryx', principal='oryx/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:46700
I20260808 04:40:44.233537 24462 tablet_service.cc:1514] Processing DeleteTablet for tablet 34204dfa47c3415e8b95e2b893c68b44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:44 UTC) from {username='oryx', principal='oryx/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:37472
I20260808 04:40:44.234193 24862 tablet_service.cc:1514] Processing DeleteTablet for tablet 34204dfa47c3415e8b95e2b893c68b44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:44 UTC) from {username='oryx', principal='oryx/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:55116
I20260808 04:40:44.234515 25101 tablet_replica.cc:330] T 34204dfa47c3415e8b95e2b893c68b44 P 024908296986489cb8db33bd7cf59298: stopping tablet replica
I20260808 04:40:44.234684 25101 raft_consensus.cc:2229] T 34204dfa47c3415e8b95e2b893c68b44 P 024908296986489cb8db33bd7cf59298 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:44.234834 25101 raft_consensus.cc:2258] T 34204dfa47c3415e8b95e2b893c68b44 P 024908296986489cb8db33bd7cf59298 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:44.235528 25101 ts_tablet_manager.cc:1905] T 34204dfa47c3415e8b95e2b893c68b44 P 024908296986489cb8db33bd7cf59298: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:44.238548 25101 ts_tablet_manager.cc:1918] T 34204dfa47c3415e8b95e2b893c68b44 P 024908296986489cb8db33bd7cf59298: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 04:40:44.238694 25101 log.cc:1196] T 34204dfa47c3415e8b95e2b893c68b44 P 024908296986489cb8db33bd7cf59298: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-1/wal/wals/34204dfa47c3415e8b95e2b893c68b44
I20260808 04:40:44.239005 25101 ts_tablet_manager.cc:1939] T 34204dfa47c3415e8b95e2b893c68b44 P 024908296986489cb8db33bd7cf59298: Deleting consensus metadata
I20260808 04:40:44.239699 24239 catalog_manager.cc:4841] TS 024908296986489cb8db33bd7cf59298 (127.12.148.66:41953): tablet 34204dfa47c3415e8b95e2b893c68b44 (table test-table [id=9772128dd9504995b11308f93b22a890]) successfully deleted
I20260808 04:40:44.239924 25102 tablet_replica.cc:330] T 34204dfa47c3415e8b95e2b893c68b44 P 6a7befd1873541e48410b6fa35c843e0: stopping tablet replica
I20260808 04:40:44.240073 25100 tablet_replica.cc:330] T 34204dfa47c3415e8b95e2b893c68b44 P 1290fe9c320c4a5bab2ea6198b8ba682: stopping tablet replica
I20260808 04:40:44.240125 25102 raft_consensus.cc:2229] T 34204dfa47c3415e8b95e2b893c68b44 P 6a7befd1873541e48410b6fa35c843e0 [term 1 LEADER]: Raft consensus shutting down.
I20260808 04:40:44.240229 25100 raft_consensus.cc:2229] T 34204dfa47c3415e8b95e2b893c68b44 P 1290fe9c320c4a5bab2ea6198b8ba682 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:44.240375 25100 raft_consensus.cc:2258] T 34204dfa47c3415e8b95e2b893c68b44 P 1290fe9c320c4a5bab2ea6198b8ba682 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:44.240562 25102 raft_consensus.cc:2258] T 34204dfa47c3415e8b95e2b893c68b44 P 6a7befd1873541e48410b6fa35c843e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:44.241003 25100 ts_tablet_manager.cc:1905] T 34204dfa47c3415e8b95e2b893c68b44 P 1290fe9c320c4a5bab2ea6198b8ba682: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:44.241285 25102 ts_tablet_manager.cc:1905] T 34204dfa47c3415e8b95e2b893c68b44 P 6a7befd1873541e48410b6fa35c843e0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:44.243736 25100 ts_tablet_manager.cc:1918] T 34204dfa47c3415e8b95e2b893c68b44 P 1290fe9c320c4a5bab2ea6198b8ba682: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 04:40:44.243871 25100 log.cc:1196] T 34204dfa47c3415e8b95e2b893c68b44 P 1290fe9c320c4a5bab2ea6198b8ba682: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-0/wal/wals/34204dfa47c3415e8b95e2b893c68b44
I20260808 04:40:44.244032 25102 ts_tablet_manager.cc:1918] T 34204dfa47c3415e8b95e2b893c68b44 P 6a7befd1873541e48410b6fa35c843e0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 04:40:44.244160 25102 log.cc:1196] T 34204dfa47c3415e8b95e2b893c68b44 P 6a7befd1873541e48410b6fa35c843e0: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-2/wal/wals/34204dfa47c3415e8b95e2b893c68b44
I20260808 04:40:44.244199 25100 ts_tablet_manager.cc:1939] T 34204dfa47c3415e8b95e2b893c68b44 P 1290fe9c320c4a5bab2ea6198b8ba682: Deleting consensus metadata
I20260808 04:40:44.244481 25102 ts_tablet_manager.cc:1939] T 34204dfa47c3415e8b95e2b893c68b44 P 6a7befd1873541e48410b6fa35c843e0: Deleting consensus metadata
I20260808 04:40:44.244931 24237 catalog_manager.cc:4841] TS 1290fe9c320c4a5bab2ea6198b8ba682 (127.12.148.65:32879): tablet 34204dfa47c3415e8b95e2b893c68b44 (table test-table [id=9772128dd9504995b11308f93b22a890]) successfully deleted
I20260808 04:40:44.245551 24236 catalog_manager.cc:4841] TS 6a7befd1873541e48410b6fa35c843e0 (127.12.148.67:36219): tablet 34204dfa47c3415e8b95e2b893c68b44 (table test-table [id=9772128dd9504995b11308f93b22a890]) successfully deleted
Aug 08 04:40:44 dist-test-slave-t7g5 krb5kdc[24193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164044, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 04:40:44 dist-test-slave-t7g5 krb5kdc[24193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:44 dist-test-slave-t7g5 krb5kdc[24193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
W20260808 04:40:44.266294 25118 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:44.259140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59194 (local address 127.12.148.126:33701)
0808 04:40:44.259380 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:44.259383 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:44.259441 (+ 58us) server_negotiation.cc:407] Connection header received
0808 04:40:44.259595 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:44.259597 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:44.259641 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:44.259707 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:44.260603 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:44.261201 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:44.262546 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:44.262777 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:44.262857 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:44.266157 (+ 3300us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59194: BlockingRecv error: recv got EOF from 127.0.0.1:59194 (error 108)
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":58,"threads_started":1}
Aug 08 04:40:44 dist-test-slave-t7g5 krb5kdc[24193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164044, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM
I20260808 04:40:44.275966 25118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:44.267696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59196 (local address 127.12.148.126:33701)
0808 04:40:44.267805 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:44.267808 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:44.267872 (+ 64us) server_negotiation.cc:407] Connection header received
0808 04:40:44.267977 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:44.267979 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:44.268017 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:44.268079 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:44.268724 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:44.269195 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:44.270289 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:44.270504 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:44.270578 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:44.272992 (+ 2414us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:44.272995 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:44.272997 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:44.273038 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:44.274485 (+ 1447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:44.274918 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:44.274921 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:44.274922 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:44.274997 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:44.275237 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:44.275240 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:44.275241 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:44.275421 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:44.275533 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:44.275737 (+ 204us) server_negotiation.cc:299] Negotiation successful
0808 04:40:44.275836 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 04:40:44.278570 24258 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59196:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:40:44.279031 24258 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:40:44.283802 24462 tablet_service.cc:1467] Processing CreateTablet for tablet 6935fd06ae364c9ca4a3f46a006bf5ed (DEFAULT_TABLE table=test-table [id=1a8d0a0c4dc741fbb7b748a52d4cf551]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:44.283907 24658 tablet_service.cc:1467] Processing CreateTablet for tablet 6935fd06ae364c9ca4a3f46a006bf5ed (DEFAULT_TABLE table=test-table [id=1a8d0a0c4dc741fbb7b748a52d4cf551]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:44.284118 24462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6935fd06ae364c9ca4a3f46a006bf5ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:44.284137 24658 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6935fd06ae364c9ca4a3f46a006bf5ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:44.285965 24862 tablet_service.cc:1467] Processing CreateTablet for tablet 6935fd06ae364c9ca4a3f46a006bf5ed (DEFAULT_TABLE table=test-table [id=1a8d0a0c4dc741fbb7b748a52d4cf551]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:44.286243 24862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6935fd06ae364c9ca4a3f46a006bf5ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:44.286877 25126 tablet_bootstrap.cc:492] T 6935fd06ae364c9ca4a3f46a006bf5ed P 1290fe9c320c4a5bab2ea6198b8ba682: Bootstrap starting.
I20260808 04:40:44.287423 25127 tablet_bootstrap.cc:492] T 6935fd06ae364c9ca4a3f46a006bf5ed P 024908296986489cb8db33bd7cf59298: Bootstrap starting.
I20260808 04:40:44.288259 25127 tablet_bootstrap.cc:654] T 6935fd06ae364c9ca4a3f46a006bf5ed P 024908296986489cb8db33bd7cf59298: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:44.288807 25126 tablet_bootstrap.cc:654] T 6935fd06ae364c9ca4a3f46a006bf5ed P 1290fe9c320c4a5bab2ea6198b8ba682: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:44.289628 25127 tablet_bootstrap.cc:492] T 6935fd06ae364c9ca4a3f46a006bf5ed P 024908296986489cb8db33bd7cf59298: No bootstrap required, opened a new log
I20260808 04:40:44.289826 25127 ts_tablet_manager.cc:1397] T 6935fd06ae364c9ca4a3f46a006bf5ed P 024908296986489cb8db33bd7cf59298: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 04:40:44.289835 25128 tablet_bootstrap.cc:492] T 6935fd06ae364c9ca4a3f46a006bf5ed P 6a7befd1873541e48410b6fa35c843e0: Bootstrap starting.
I20260808 04:40:44.290189 25127 raft_consensus.cc:348] T 6935fd06ae364c9ca4a3f46a006bf5ed P 024908296986489cb8db33bd7cf59298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } }
I20260808 04:40:44.290287 25127 raft_consensus.cc:374] T 6935fd06ae364c9ca4a3f46a006bf5ed P 024908296986489cb8db33bd7cf59298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:44.290315 25127 raft_consensus.cc:729] T 6935fd06ae364c9ca4a3f46a006bf5ed P 024908296986489cb8db33bd7cf59298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 024908296986489cb8db33bd7cf59298, State: Initialized, Role: FOLLOWER
I20260808 04:40:44.290460 25127 consensus_queue.cc:260] T 6935fd06ae364c9ca4a3f46a006bf5ed P 024908296986489cb8db33bd7cf59298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } }
I20260808 04:40:44.290755 25128 tablet_bootstrap.cc:654] T 6935fd06ae364c9ca4a3f46a006bf5ed P 6a7befd1873541e48410b6fa35c843e0: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:44.291109 25127 ts_tablet_manager.cc:1428] T 6935fd06ae364c9ca4a3f46a006bf5ed P 024908296986489cb8db33bd7cf59298: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 04:40:44.291893 25128 tablet_bootstrap.cc:492] T 6935fd06ae364c9ca4a3f46a006bf5ed P 6a7befd1873541e48410b6fa35c843e0: No bootstrap required, opened a new log
I20260808 04:40:44.291945 25126 tablet_bootstrap.cc:492] T 6935fd06ae364c9ca4a3f46a006bf5ed P 1290fe9c320c4a5bab2ea6198b8ba682: No bootstrap required, opened a new log
I20260808 04:40:44.291976 25128 ts_tablet_manager.cc:1397] T 6935fd06ae364c9ca4a3f46a006bf5ed P 6a7befd1873541e48410b6fa35c843e0: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 04:40:44.292027 25126 ts_tablet_manager.cc:1397] T 6935fd06ae364c9ca4a3f46a006bf5ed P 1290fe9c320c4a5bab2ea6198b8ba682: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260808 04:40:44.292402 25128 raft_consensus.cc:348] T 6935fd06ae364c9ca4a3f46a006bf5ed P 6a7befd1873541e48410b6fa35c843e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } }
I20260808 04:40:44.292513 25128 raft_consensus.cc:374] T 6935fd06ae364c9ca4a3f46a006bf5ed P 6a7befd1873541e48410b6fa35c843e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:44.292543 25128 raft_consensus.cc:729] T 6935fd06ae364c9ca4a3f46a006bf5ed P 6a7befd1873541e48410b6fa35c843e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a7befd1873541e48410b6fa35c843e0, State: Initialized, Role: FOLLOWER
I20260808 04:40:44.292652 25128 consensus_queue.cc:260] T 6935fd06ae364c9ca4a3f46a006bf5ed P 6a7befd1873541e48410b6fa35c843e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } }
I20260808 04:40:44.292903 25128 ts_tablet_manager.cc:1428] T 6935fd06ae364c9ca4a3f46a006bf5ed P 6a7befd1873541e48410b6fa35c843e0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 04:40:44.294278 25126 raft_consensus.cc:348] T 6935fd06ae364c9ca4a3f46a006bf5ed P 1290fe9c320c4a5bab2ea6198b8ba682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } }
I20260808 04:40:44.294396 25126 raft_consensus.cc:374] T 6935fd06ae364c9ca4a3f46a006bf5ed P 1290fe9c320c4a5bab2ea6198b8ba682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:44.294468 25126 raft_consensus.cc:729] T 6935fd06ae364c9ca4a3f46a006bf5ed P 1290fe9c320c4a5bab2ea6198b8ba682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1290fe9c320c4a5bab2ea6198b8ba682, State: Initialized, Role: FOLLOWER
I20260808 04:40:44.294605 25126 consensus_queue.cc:260] T 6935fd06ae364c9ca4a3f46a006bf5ed P 1290fe9c320c4a5bab2ea6198b8ba682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } }
I20260808 04:40:44.294911 25126 ts_tablet_manager.cc:1428] T 6935fd06ae364c9ca4a3f46a006bf5ed P 1290fe9c320c4a5bab2ea6198b8ba682: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260808 04:40:44.304394 25005 raft_consensus.cc:482] T 6935fd06ae364c9ca4a3f46a006bf5ed P 6a7befd1873541e48410b6fa35c843e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:40:44.304529 25005 raft_consensus.cc:504] T 6935fd06ae364c9ca4a3f46a006bf5ed P 6a7befd1873541e48410b6fa35c843e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } }
I20260808 04:40:44.304916 25005 leader_election.cc:288] T 6935fd06ae364c9ca4a3f46a006bf5ed P 6a7befd1873541e48410b6fa35c843e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1290fe9c320c4a5bab2ea6198b8ba682 (127.12.148.65:32879), 024908296986489cb8db33bd7cf59298 (127.12.148.66:41953)
I20260808 04:40:44.305433 24487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6935fd06ae364c9ca4a3f46a006bf5ed" candidate_uuid: "6a7befd1873541e48410b6fa35c843e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" is_pre_election: true
I20260808 04:40:44.305599 24487 raft_consensus.cc:2454] T 6935fd06ae364c9ca4a3f46a006bf5ed P 1290fe9c320c4a5bab2ea6198b8ba682 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a7befd1873541e48410b6fa35c843e0 in term 0.
I20260808 04:40:44.305820 24686 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6935fd06ae364c9ca4a3f46a006bf5ed" candidate_uuid: "6a7befd1873541e48410b6fa35c843e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024908296986489cb8db33bd7cf59298" is_pre_election: true
I20260808 04:40:44.305918 24792 leader_election.cc:302] T 6935fd06ae364c9ca4a3f46a006bf5ed P 6a7befd1873541e48410b6fa35c843e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1290fe9c320c4a5bab2ea6198b8ba682, 6a7befd1873541e48410b6fa35c843e0; no voters:
I20260808 04:40:44.305975 24686 raft_consensus.cc:2454] T 6935fd06ae364c9ca4a3f46a006bf5ed P 024908296986489cb8db33bd7cf59298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a7befd1873541e48410b6fa35c843e0 in term 0.
I20260808 04:40:44.306087 25005 raft_consensus.cc:2781] T 6935fd06ae364c9ca4a3f46a006bf5ed P 6a7befd1873541e48410b6fa35c843e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:40:44.306140 25005 raft_consensus.cc:482] T 6935fd06ae364c9ca4a3f46a006bf5ed P 6a7befd1873541e48410b6fa35c843e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:40:44.306180 25005 raft_consensus.cc:3037] T 6935fd06ae364c9ca4a3f46a006bf5ed P 6a7befd1873541e48410b6fa35c843e0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:44.307374 25005 raft_consensus.cc:504] T 6935fd06ae364c9ca4a3f46a006bf5ed P 6a7befd1873541e48410b6fa35c843e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } }
I20260808 04:40:44.307744 25005 leader_election.cc:288] T 6935fd06ae364c9ca4a3f46a006bf5ed P 6a7befd1873541e48410b6fa35c843e0 [CANDIDATE]: Term 1 election: Requested vote from peers 1290fe9c320c4a5bab2ea6198b8ba682 (127.12.148.65:32879), 024908296986489cb8db33bd7cf59298 (127.12.148.66:41953)
I20260808 04:40:44.308080 24487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6935fd06ae364c9ca4a3f46a006bf5ed" candidate_uuid: "6a7befd1873541e48410b6fa35c843e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1290fe9c320c4a5bab2ea6198b8ba682"
I20260808 04:40:44.308084 24686 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6935fd06ae364c9ca4a3f46a006bf5ed" candidate_uuid: "6a7befd1873541e48410b6fa35c843e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024908296986489cb8db33bd7cf59298"
I20260808 04:40:44.308200 24686 raft_consensus.cc:3037] T 6935fd06ae364c9ca4a3f46a006bf5ed P 024908296986489cb8db33bd7cf59298 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:44.308200 24487 raft_consensus.cc:3037] T 6935fd06ae364c9ca4a3f46a006bf5ed P 1290fe9c320c4a5bab2ea6198b8ba682 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:44.309312 24686 raft_consensus.cc:2454] T 6935fd06ae364c9ca4a3f46a006bf5ed P 024908296986489cb8db33bd7cf59298 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a7befd1873541e48410b6fa35c843e0 in term 1.
I20260808 04:40:44.309302 24487 raft_consensus.cc:2454] T 6935fd06ae364c9ca4a3f46a006bf5ed P 1290fe9c320c4a5bab2ea6198b8ba682 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a7befd1873541e48410b6fa35c843e0 in term 1.
I20260808 04:40:44.309595 24795 leader_election.cc:302] T 6935fd06ae364c9ca4a3f46a006bf5ed P 6a7befd1873541e48410b6fa35c843e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024908296986489cb8db33bd7cf59298, 6a7befd1873541e48410b6fa35c843e0; no voters:
I20260808 04:40:44.309885 25005 raft_consensus.cc:2781] T 6935fd06ae364c9ca4a3f46a006bf5ed P 6a7befd1873541e48410b6fa35c843e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:44.309971 25005 raft_consensus.cc:686] T 6935fd06ae364c9ca4a3f46a006bf5ed P 6a7befd1873541e48410b6fa35c843e0 [term 1 LEADER]: Becoming Leader. State: Replica: 6a7befd1873541e48410b6fa35c843e0, State: Running, Role: LEADER
I20260808 04:40:44.310105 25005 consensus_queue.cc:237] T 6935fd06ae364c9ca4a3f46a006bf5ed P 6a7befd1873541e48410b6fa35c843e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } }
I20260808 04:40:44.311903 24258 catalog_manager.cc:5495] T 6935fd06ae364c9ca4a3f46a006bf5ed P 6a7befd1873541e48410b6fa35c843e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a7befd1873541e48410b6fa35c843e0 (127.12.148.67). New cstate: current_term: 1 leader_uuid: "6a7befd1873541e48410b6fa35c843e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } health_report { overall_health: HEALTHY } } }
I20260808 04:40:44.323408 25088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:44.320307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51220 (local address 127.12.148.67:36219)
0808 04:40:44.320412 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:44.320416 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:44.320455 (+ 39us) server_negotiation.cc:407] Connection header received
0808 04:40:44.320623 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:44.320625 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:44.320676 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:44.320766 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:40:44.321014 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:44.321517 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:44.322420 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:44.322643 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:44.322727 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:44.322997 (+ 270us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:40:44.323071 (+ 74us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:40:44.323126 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:44.323221 (+ 95us) server_negotiation.cc:299] Negotiation successful
0808 04:40:44.323274 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 04:40:44.325287 24686 raft_consensus.cc:1261] T 6935fd06ae364c9ca4a3f46a006bf5ed P 024908296986489cb8db33bd7cf59298 [term 1 FOLLOWER]: Refusing update from remote peer 6a7befd1873541e48410b6fa35c843e0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:44.325357 24487 raft_consensus.cc:1261] T 6935fd06ae364c9ca4a3f46a006bf5ed P 1290fe9c320c4a5bab2ea6198b8ba682 [term 1 FOLLOWER]: Refusing update from remote peer 6a7befd1873541e48410b6fa35c843e0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:44.326090 25005 consensus_queue.cc:1035] T 6935fd06ae364c9ca4a3f46a006bf5ed P 6a7befd1873541e48410b6fa35c843e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:44.326247 25061 consensus_queue.cc:1035] T 6935fd06ae364c9ca4a3f46a006bf5ed P 6a7befd1873541e48410b6fa35c843e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:44.333992 24259 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59196:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:44.334131 24259 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59196:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:44.336521 24259 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 571fa95fbb5e45b0b6e9e7e8272adc11: Sending DeleteTablet for 3 replicas of tablet 6935fd06ae364c9ca4a3f46a006bf5ed
I20260808 04:40:44.337031 24462 tablet_service.cc:1514] Processing DeleteTablet for tablet 6935fd06ae364c9ca4a3f46a006bf5ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:44 UTC) from {username='oryx', principal='oryx/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:37472
I20260808 04:40:44.337240 25100 tablet_replica.cc:330] T 6935fd06ae364c9ca4a3f46a006bf5ed P 1290fe9c320c4a5bab2ea6198b8ba682: stopping tablet replica
I20260808 04:40:44.337291 24658 tablet_service.cc:1514] Processing DeleteTablet for tablet 6935fd06ae364c9ca4a3f46a006bf5ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:44 UTC) from {username='oryx', principal='oryx/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:46700
I20260808 04:40:44.337358 25100 raft_consensus.cc:2229] T 6935fd06ae364c9ca4a3f46a006bf5ed P 1290fe9c320c4a5bab2ea6198b8ba682 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:44.337491 25100 raft_consensus.cc:2258] T 6935fd06ae364c9ca4a3f46a006bf5ed P 1290fe9c320c4a5bab2ea6198b8ba682 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:44.337548 24862 tablet_service.cc:1514] Processing DeleteTablet for tablet 6935fd06ae364c9ca4a3f46a006bf5ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:44 UTC) from {username='oryx', principal='oryx/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:55116
I20260808 04:40:44.337672 25101 tablet_replica.cc:330] T 6935fd06ae364c9ca4a3f46a006bf5ed P 024908296986489cb8db33bd7cf59298: stopping tablet replica
I20260808 04:40:44.337728 25102 tablet_replica.cc:330] T 6935fd06ae364c9ca4a3f46a006bf5ed P 6a7befd1873541e48410b6fa35c843e0: stopping tablet replica
I20260808 04:40:44.337797 25101 raft_consensus.cc:2229] T 6935fd06ae364c9ca4a3f46a006bf5ed P 024908296986489cb8db33bd7cf59298 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:44.337828 25102 raft_consensus.cc:2229] T 6935fd06ae364c9ca4a3f46a006bf5ed P 6a7befd1873541e48410b6fa35c843e0 [term 1 LEADER]: Raft consensus shutting down.
I20260808 04:40:44.337918 25101 raft_consensus.cc:2258] T 6935fd06ae364c9ca4a3f46a006bf5ed P 024908296986489cb8db33bd7cf59298 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:44.337993 25102 raft_consensus.cc:2258] T 6935fd06ae364c9ca4a3f46a006bf5ed P 6a7befd1873541e48410b6fa35c843e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:44.338203 25100 ts_tablet_manager.cc:1905] T 6935fd06ae364c9ca4a3f46a006bf5ed P 1290fe9c320c4a5bab2ea6198b8ba682: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:44.338689 25102 ts_tablet_manager.cc:1905] T 6935fd06ae364c9ca4a3f46a006bf5ed P 6a7befd1873541e48410b6fa35c843e0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:44.340298 25100 ts_tablet_manager.cc:1918] T 6935fd06ae364c9ca4a3f46a006bf5ed P 1290fe9c320c4a5bab2ea6198b8ba682: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:40:44.340370 25100 log.cc:1196] T 6935fd06ae364c9ca4a3f46a006bf5ed P 1290fe9c320c4a5bab2ea6198b8ba682: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-0/wal/wals/6935fd06ae364c9ca4a3f46a006bf5ed
I20260808 04:40:44.340602 25100 ts_tablet_manager.cc:1939] T 6935fd06ae364c9ca4a3f46a006bf5ed P 1290fe9c320c4a5bab2ea6198b8ba682: Deleting consensus metadata
I20260808 04:40:44.341056 25102 ts_tablet_manager.cc:1918] T 6935fd06ae364c9ca4a3f46a006bf5ed P 6a7befd1873541e48410b6fa35c843e0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:40:44.341147 25102 log.cc:1196] T 6935fd06ae364c9ca4a3f46a006bf5ed P 6a7befd1873541e48410b6fa35c843e0: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-2/wal/wals/6935fd06ae364c9ca4a3f46a006bf5ed
I20260808 04:40:44.341271 24237 catalog_manager.cc:4841] TS 1290fe9c320c4a5bab2ea6198b8ba682 (127.12.148.65:32879): tablet 6935fd06ae364c9ca4a3f46a006bf5ed (table test-table [id=1a8d0a0c4dc741fbb7b748a52d4cf551]) successfully deleted
I20260808 04:40:44.341380 25102 ts_tablet_manager.cc:1939] T 6935fd06ae364c9ca4a3f46a006bf5ed P 6a7befd1873541e48410b6fa35c843e0: Deleting consensus metadata
I20260808 04:40:44.342053 24236 catalog_manager.cc:4841] TS 6a7befd1873541e48410b6fa35c843e0 (127.12.148.67:36219): tablet 6935fd06ae364c9ca4a3f46a006bf5ed (table test-table [id=1a8d0a0c4dc741fbb7b748a52d4cf551]) successfully deleted
I20260808 04:40:44.342306 25101 ts_tablet_manager.cc:1905] T 6935fd06ae364c9ca4a3f46a006bf5ed P 024908296986489cb8db33bd7cf59298: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:44.344187 25101 ts_tablet_manager.cc:1918] T 6935fd06ae364c9ca4a3f46a006bf5ed P 024908296986489cb8db33bd7cf59298: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:40:44.344259 25101 log.cc:1196] T 6935fd06ae364c9ca4a3f46a006bf5ed P 024908296986489cb8db33bd7cf59298: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-1/wal/wals/6935fd06ae364c9ca4a3f46a006bf5ed
I20260808 04:40:44.344444 25101 ts_tablet_manager.cc:1939] T 6935fd06ae364c9ca4a3f46a006bf5ed P 024908296986489cb8db33bd7cf59298: Deleting consensus metadata
I20260808 04:40:44.345049 24239 catalog_manager.cc:4841] TS 024908296986489cb8db33bd7cf59298 (127.12.148.66:41953): tablet 6935fd06ae364c9ca4a3f46a006bf5ed (table test-table [id=1a8d0a0c4dc741fbb7b748a52d4cf551]) successfully deleted
I20260808 04:40:44.345079 24259 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59196:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:40:44.345503 24259 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:40:44.350168 24462 tablet_service.cc:1467] Processing CreateTablet for tablet 9173e9458cd94ffbb7722f966baf27ed (DEFAULT_TABLE table=test-table [id=4d3f8dbfc132422f88f3ae0f37f5a09a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:44.350481 24462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9173e9458cd94ffbb7722f966baf27ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:44.350517 24658 tablet_service.cc:1467] Processing CreateTablet for tablet 9173e9458cd94ffbb7722f966baf27ed (DEFAULT_TABLE table=test-table [id=4d3f8dbfc132422f88f3ae0f37f5a09a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:44.350787 24658 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9173e9458cd94ffbb7722f966baf27ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:44.352382 25126 tablet_bootstrap.cc:492] T 9173e9458cd94ffbb7722f966baf27ed P 1290fe9c320c4a5bab2ea6198b8ba682: Bootstrap starting.
I20260808 04:40:44.352977 24862 tablet_service.cc:1467] Processing CreateTablet for tablet 9173e9458cd94ffbb7722f966baf27ed (DEFAULT_TABLE table=test-table [id=4d3f8dbfc132422f88f3ae0f37f5a09a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:40:44.353248 24862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9173e9458cd94ffbb7722f966baf27ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:44.353600 25126 tablet_bootstrap.cc:654] T 9173e9458cd94ffbb7722f966baf27ed P 1290fe9c320c4a5bab2ea6198b8ba682: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:44.354300 25127 tablet_bootstrap.cc:492] T 9173e9458cd94ffbb7722f966baf27ed P 024908296986489cb8db33bd7cf59298: Bootstrap starting.
I20260808 04:40:44.355099 25127 tablet_bootstrap.cc:654] T 9173e9458cd94ffbb7722f966baf27ed P 024908296986489cb8db33bd7cf59298: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:44.355580 25128 tablet_bootstrap.cc:492] T 9173e9458cd94ffbb7722f966baf27ed P 6a7befd1873541e48410b6fa35c843e0: Bootstrap starting.
I20260808 04:40:44.356523 25127 tablet_bootstrap.cc:492] T 9173e9458cd94ffbb7722f966baf27ed P 024908296986489cb8db33bd7cf59298: No bootstrap required, opened a new log
I20260808 04:40:44.356561 25128 tablet_bootstrap.cc:654] T 9173e9458cd94ffbb7722f966baf27ed P 6a7befd1873541e48410b6fa35c843e0: Neither blocks nor log segments found. Creating new log.
I20260808 04:40:44.356585 25127 ts_tablet_manager.cc:1397] T 9173e9458cd94ffbb7722f966baf27ed P 024908296986489cb8db33bd7cf59298: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 04:40:44.356928 25127 raft_consensus.cc:348] T 9173e9458cd94ffbb7722f966baf27ed P 024908296986489cb8db33bd7cf59298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } }
I20260808 04:40:44.357012 25127 raft_consensus.cc:374] T 9173e9458cd94ffbb7722f966baf27ed P 024908296986489cb8db33bd7cf59298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:44.357030 25127 raft_consensus.cc:729] T 9173e9458cd94ffbb7722f966baf27ed P 024908296986489cb8db33bd7cf59298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 024908296986489cb8db33bd7cf59298, State: Initialized, Role: FOLLOWER
I20260808 04:40:44.357131 25127 consensus_queue.cc:260] T 9173e9458cd94ffbb7722f966baf27ed P 024908296986489cb8db33bd7cf59298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } }
I20260808 04:40:44.357404 25127 ts_tablet_manager.cc:1428] T 9173e9458cd94ffbb7722f966baf27ed P 024908296986489cb8db33bd7cf59298: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 04:40:44.357807 25128 tablet_bootstrap.cc:492] T 9173e9458cd94ffbb7722f966baf27ed P 6a7befd1873541e48410b6fa35c843e0: No bootstrap required, opened a new log
I20260808 04:40:44.357908 25128 ts_tablet_manager.cc:1397] T 9173e9458cd94ffbb7722f966baf27ed P 6a7befd1873541e48410b6fa35c843e0: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 04:40:44.358408 25126 tablet_bootstrap.cc:492] T 9173e9458cd94ffbb7722f966baf27ed P 1290fe9c320c4a5bab2ea6198b8ba682: No bootstrap required, opened a new log
I20260808 04:40:44.358358 25128 raft_consensus.cc:348] T 9173e9458cd94ffbb7722f966baf27ed P 6a7befd1873541e48410b6fa35c843e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } }
I20260808 04:40:44.358480 25128 raft_consensus.cc:374] T 9173e9458cd94ffbb7722f966baf27ed P 6a7befd1873541e48410b6fa35c843e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:44.358491 25126 ts_tablet_manager.cc:1397] T 9173e9458cd94ffbb7722f966baf27ed P 1290fe9c320c4a5bab2ea6198b8ba682: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260808 04:40:44.358527 25128 raft_consensus.cc:729] T 9173e9458cd94ffbb7722f966baf27ed P 6a7befd1873541e48410b6fa35c843e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a7befd1873541e48410b6fa35c843e0, State: Initialized, Role: FOLLOWER
I20260808 04:40:44.358669 25128 consensus_queue.cc:260] T 9173e9458cd94ffbb7722f966baf27ed P 6a7befd1873541e48410b6fa35c843e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } }
I20260808 04:40:44.358907 25126 raft_consensus.cc:348] T 9173e9458cd94ffbb7722f966baf27ed P 1290fe9c320c4a5bab2ea6198b8ba682 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } }
I20260808 04:40:44.359014 25126 raft_consensus.cc:374] T 9173e9458cd94ffbb7722f966baf27ed P 1290fe9c320c4a5bab2ea6198b8ba682 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:44.359046 25126 raft_consensus.cc:729] T 9173e9458cd94ffbb7722f966baf27ed P 1290fe9c320c4a5bab2ea6198b8ba682 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1290fe9c320c4a5bab2ea6198b8ba682, State: Initialized, Role: FOLLOWER
I20260808 04:40:44.359156 25126 consensus_queue.cc:260] T 9173e9458cd94ffbb7722f966baf27ed P 1290fe9c320c4a5bab2ea6198b8ba682 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } }
I20260808 04:40:44.359412 25126 ts_tablet_manager.cc:1428] T 9173e9458cd94ffbb7722f966baf27ed P 1290fe9c320c4a5bab2ea6198b8ba682: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 04:40:44.360250 25128 ts_tablet_manager.cc:1428] T 9173e9458cd94ffbb7722f966baf27ed P 6a7befd1873541e48410b6fa35c843e0: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260808 04:40:44.501363 25036 raft_consensus.cc:482] T 9173e9458cd94ffbb7722f966baf27ed P 6a7befd1873541e48410b6fa35c843e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:40:44.501516 25036 raft_consensus.cc:504] T 9173e9458cd94ffbb7722f966baf27ed P 6a7befd1873541e48410b6fa35c843e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } }
I20260808 04:40:44.501965 25036 leader_election.cc:288] T 9173e9458cd94ffbb7722f966baf27ed P 6a7befd1873541e48410b6fa35c843e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1290fe9c320c4a5bab2ea6198b8ba682 (127.12.148.65:32879), 024908296986489cb8db33bd7cf59298 (127.12.148.66:41953)
I20260808 04:40:44.502463 24487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9173e9458cd94ffbb7722f966baf27ed" candidate_uuid: "6a7befd1873541e48410b6fa35c843e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" is_pre_election: true
I20260808 04:40:44.502465 24686 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9173e9458cd94ffbb7722f966baf27ed" candidate_uuid: "6a7befd1873541e48410b6fa35c843e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024908296986489cb8db33bd7cf59298" is_pre_election: true
I20260808 04:40:44.502619 24487 raft_consensus.cc:2454] T 9173e9458cd94ffbb7722f966baf27ed P 1290fe9c320c4a5bab2ea6198b8ba682 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a7befd1873541e48410b6fa35c843e0 in term 0.
I20260808 04:40:44.502632 24686 raft_consensus.cc:2454] T 9173e9458cd94ffbb7722f966baf27ed P 024908296986489cb8db33bd7cf59298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a7befd1873541e48410b6fa35c843e0 in term 0.
I20260808 04:40:44.502945 24792 leader_election.cc:302] T 9173e9458cd94ffbb7722f966baf27ed P 6a7befd1873541e48410b6fa35c843e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1290fe9c320c4a5bab2ea6198b8ba682, 6a7befd1873541e48410b6fa35c843e0; no voters:
I20260808 04:40:44.503140 25036 raft_consensus.cc:2781] T 9173e9458cd94ffbb7722f966baf27ed P 6a7befd1873541e48410b6fa35c843e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:40:44.503213 25036 raft_consensus.cc:482] T 9173e9458cd94ffbb7722f966baf27ed P 6a7befd1873541e48410b6fa35c843e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:40:44.503250 25036 raft_consensus.cc:3037] T 9173e9458cd94ffbb7722f966baf27ed P 6a7befd1873541e48410b6fa35c843e0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:44.504513 25036 raft_consensus.cc:504] T 9173e9458cd94ffbb7722f966baf27ed P 6a7befd1873541e48410b6fa35c843e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } }
I20260808 04:40:44.504884 25036 leader_election.cc:288] T 9173e9458cd94ffbb7722f966baf27ed P 6a7befd1873541e48410b6fa35c843e0 [CANDIDATE]: Term 1 election: Requested vote from peers 1290fe9c320c4a5bab2ea6198b8ba682 (127.12.148.65:32879), 024908296986489cb8db33bd7cf59298 (127.12.148.66:41953)
I20260808 04:40:44.505276 24487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9173e9458cd94ffbb7722f966baf27ed" candidate_uuid: "6a7befd1873541e48410b6fa35c843e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1290fe9c320c4a5bab2ea6198b8ba682"
I20260808 04:40:44.505410 24487 raft_consensus.cc:3037] T 9173e9458cd94ffbb7722f966baf27ed P 1290fe9c320c4a5bab2ea6198b8ba682 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:44.505511 24686 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9173e9458cd94ffbb7722f966baf27ed" candidate_uuid: "6a7befd1873541e48410b6fa35c843e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024908296986489cb8db33bd7cf59298"
I20260808 04:40:44.505626 24686 raft_consensus.cc:3037] T 9173e9458cd94ffbb7722f966baf27ed P 024908296986489cb8db33bd7cf59298 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:44.506512 24487 raft_consensus.cc:2454] T 9173e9458cd94ffbb7722f966baf27ed P 1290fe9c320c4a5bab2ea6198b8ba682 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a7befd1873541e48410b6fa35c843e0 in term 1.
I20260808 04:40:44.506726 24686 raft_consensus.cc:2454] T 9173e9458cd94ffbb7722f966baf27ed P 024908296986489cb8db33bd7cf59298 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a7befd1873541e48410b6fa35c843e0 in term 1.
I20260808 04:40:44.506855 24792 leader_election.cc:302] T 9173e9458cd94ffbb7722f966baf27ed P 6a7befd1873541e48410b6fa35c843e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1290fe9c320c4a5bab2ea6198b8ba682, 6a7befd1873541e48410b6fa35c843e0; no voters:
I20260808 04:40:44.507025 25036 raft_consensus.cc:2781] T 9173e9458cd94ffbb7722f966baf27ed P 6a7befd1873541e48410b6fa35c843e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:44.507119 25036 raft_consensus.cc:686] T 9173e9458cd94ffbb7722f966baf27ed P 6a7befd1873541e48410b6fa35c843e0 [term 1 LEADER]: Becoming Leader. State: Replica: 6a7befd1873541e48410b6fa35c843e0, State: Running, Role: LEADER
I20260808 04:40:44.507246 25036 consensus_queue.cc:237] T 9173e9458cd94ffbb7722f966baf27ed P 6a7befd1873541e48410b6fa35c843e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } }
I20260808 04:40:44.508827 24259 catalog_manager.cc:5495] T 9173e9458cd94ffbb7722f966baf27ed P 6a7befd1873541e48410b6fa35c843e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a7befd1873541e48410b6fa35c843e0 (127.12.148.67). New cstate: current_term: 1 leader_uuid: "6a7befd1873541e48410b6fa35c843e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a7befd1873541e48410b6fa35c843e0" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36219 } health_report { overall_health: HEALTHY } } }
I20260808 04:40:44.556414 24686 raft_consensus.cc:1261] T 9173e9458cd94ffbb7722f966baf27ed P 024908296986489cb8db33bd7cf59298 [term 1 FOLLOWER]: Refusing update from remote peer 6a7befd1873541e48410b6fa35c843e0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:44.556537 24487 raft_consensus.cc:1261] T 9173e9458cd94ffbb7722f966baf27ed P 1290fe9c320c4a5bab2ea6198b8ba682 [term 1 FOLLOWER]: Refusing update from remote peer 6a7befd1873541e48410b6fa35c843e0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:40:44.556841 25036 consensus_queue.cc:1035] T 9173e9458cd94ffbb7722f966baf27ed P 6a7befd1873541e48410b6fa35c843e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "024908296986489cb8db33bd7cf59298" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:44.557008 25005 consensus_queue.cc:1035] T 9173e9458cd94ffbb7722f966baf27ed P 6a7befd1873541e48410b6fa35c843e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1290fe9c320c4a5bab2ea6198b8ba682" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 32879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:40:44.583928 24257 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59196:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:44.584077 24257 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59196:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:40:44.585973 24257 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 571fa95fbb5e45b0b6e9e7e8272adc11: Sending DeleteTablet for 3 replicas of tablet 9173e9458cd94ffbb7722f966baf27ed
I20260808 04:40:44.586480 24462 tablet_service.cc:1514] Processing DeleteTablet for tablet 9173e9458cd94ffbb7722f966baf27ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:44 UTC) from {username='oryx', principal='oryx/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:37472
I20260808 04:40:44.586506 24658 tablet_service.cc:1514] Processing DeleteTablet for tablet 9173e9458cd94ffbb7722f966baf27ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:44 UTC) from {username='oryx', principal='oryx/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:46700
I20260808 04:40:44.586525 24862 tablet_service.cc:1514] Processing DeleteTablet for tablet 9173e9458cd94ffbb7722f966baf27ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:40:44 UTC) from {username='oryx', principal='oryx/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:55116
I20260808 04:40:44.586688 25100 tablet_replica.cc:330] T 9173e9458cd94ffbb7722f966baf27ed P 1290fe9c320c4a5bab2ea6198b8ba682: stopping tablet replica
I20260808 04:40:44.586804 25100 raft_consensus.cc:2229] T 9173e9458cd94ffbb7722f966baf27ed P 1290fe9c320c4a5bab2ea6198b8ba682 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:44.586906 25101 tablet_replica.cc:330] T 9173e9458cd94ffbb7722f966baf27ed P 024908296986489cb8db33bd7cf59298: stopping tablet replica
I20260808 04:40:44.586944 25100 raft_consensus.cc:2258] T 9173e9458cd94ffbb7722f966baf27ed P 1290fe9c320c4a5bab2ea6198b8ba682 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:44.587029 25101 raft_consensus.cc:2229] T 9173e9458cd94ffbb7722f966baf27ed P 024908296986489cb8db33bd7cf59298 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:40:44.587131 25101 raft_consensus.cc:2258] T 9173e9458cd94ffbb7722f966baf27ed P 024908296986489cb8db33bd7cf59298 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:44.587157 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 24369
I20260808 04:40:44.589820 25102 tablet_replica.cc:330] T 9173e9458cd94ffbb7722f966baf27ed P 6a7befd1873541e48410b6fa35c843e0: stopping tablet replica
I20260808 04:40:44.589929 25102 raft_consensus.cc:2229] T 9173e9458cd94ffbb7722f966baf27ed P 6a7befd1873541e48410b6fa35c843e0 [term 1 LEADER]: Raft consensus shutting down.
I20260808 04:40:44.590081 25102 raft_consensus.cc:2258] T 9173e9458cd94ffbb7722f966baf27ed P 6a7befd1873541e48410b6fa35c843e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:40:44.591929 25102 ts_tablet_manager.cc:1905] T 9173e9458cd94ffbb7722f966baf27ed P 6a7befd1873541e48410b6fa35c843e0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:44.593129 25101 ts_tablet_manager.cc:1905] T 9173e9458cd94ffbb7722f966baf27ed P 024908296986489cb8db33bd7cf59298: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:40:44.594213 25102 ts_tablet_manager.cc:1918] T 9173e9458cd94ffbb7722f966baf27ed P 6a7befd1873541e48410b6fa35c843e0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 04:40:44.594274 25102 log.cc:1196] T 9173e9458cd94ffbb7722f966baf27ed P 6a7befd1873541e48410b6fa35c843e0: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-2/wal/wals/9173e9458cd94ffbb7722f966baf27ed
I20260808 04:40:44.594475 25102 ts_tablet_manager.cc:1939] T 9173e9458cd94ffbb7722f966baf27ed P 6a7befd1873541e48410b6fa35c843e0: Deleting consensus metadata
I20260808 04:40:44.595489 24236 catalog_manager.cc:4841] TS 6a7befd1873541e48410b6fa35c843e0 (127.12.148.67:36219): tablet 9173e9458cd94ffbb7722f966baf27ed (table test-table [id=4d3f8dbfc132422f88f3ae0f37f5a09a]) successfully deleted
I20260808 04:40:44.596169 25101 ts_tablet_manager.cc:1918] T 9173e9458cd94ffbb7722f966baf27ed P 024908296986489cb8db33bd7cf59298: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 04:40:44.596230 25101 log.cc:1196] T 9173e9458cd94ffbb7722f966baf27ed P 024908296986489cb8db33bd7cf59298: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786164004017495-12881-0/minicluster-data/ts-1/wal/wals/9173e9458cd94ffbb7722f966baf27ed
I20260808 04:40:44.596413 25101 ts_tablet_manager.cc:1939] T 9173e9458cd94ffbb7722f966baf27ed P 024908296986489cb8db33bd7cf59298: Deleting consensus metadata
I20260808 04:40:44.597270 24239 catalog_manager.cc:4841] TS 024908296986489cb8db33bd7cf59298 (127.12.148.66:41953): tablet 9173e9458cd94ffbb7722f966baf27ed (table test-table [id=4d3f8dbfc132422f88f3ae0f37f5a09a]) successfully deleted
W20260808 04:40:44.603936 24237 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.148.65:32879 (error 108)
I20260808 04:40:44.604041 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 24566
I20260808 04:40:44.614800 25152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:44.611491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:32879 (local address 127.0.0.1:40532)
0808 04:40:44.614600 (+ 3109us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:44.614695 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.65:32879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3021,"thread_start_us":1274,"threads_started":1}
W20260808 04:40:44.614966 24237 catalog_manager.cc:4584] TS 1290fe9c320c4a5bab2ea6198b8ba682 (127.12.148.65:32879): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9173e9458cd94ffbb7722f966baf27ed: Network error: Client connection negotiation failed: client connection to 127.12.148.65:32879: connect: Connection refused (error 111)
I20260808 04:40:44.624029 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 24765
I20260808 04:40:44.635434 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 24209
2026-08-08T04:40:44Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3863 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786164004017495-12881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:40:44 dist-test-slave-t7g5 krb5kdc[25155](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:40:44 dist-test-slave-t7g5 krb5kdc[25155](info): set up 2 sockets
Aug 08 04:40:44 dist-test-slave-t7g5 krb5kdc[25155](info): commencing operation
krb5kdc: starting...
W20260808 04:40:45.785236 12881 mini_kdc.cc:121] Time spent starting KDC: real 1.122s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Aug 08 04:40:45 dist-test-slave-t7g5 krb5kdc[25155](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164045, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:40:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:40:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.148.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
I20260808 04:40:45.912279 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:34977
--webserver_interface=127.12.148.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:43137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:34977
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:46.025795 25175 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:46.026077 25175 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:46.026120 25175 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:46.030161 25175 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:40:46.030217 25175 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:46.030237 25175 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:46.030267 25175 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:40:46.030293 25175 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:40:46.035648 25175 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:43137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:34977
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:34977
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25175
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:46.036691 25175 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:46.037753 25175 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:46.045964 25182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:46.045976 25181 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:46.046005 25187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:46.046344 25175 server_base.cc:1034] running on GCE node
I20260808 04:40:46.046882 25175 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:46.047957 25175 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:46.049120 25175 hybrid_clock.cc:648] HybridClock initialized: now 1786164046049104 us; error 27 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-08T04:40:46Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1419 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:40:46 dist-test-slave-t7g5 krb5kdc[25193](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:40:46 dist-test-slave-t7g5 krb5kdc[25193](info): set up 2 sockets
Aug 08 04:40:46 dist-test-slave-t7g5 krb5kdc[25193](info): commencing operation
krb5kdc: starting...
W20260808 04:40:47.204131 12881 mini_kdc.cc:121] Time spent starting KDC: real 1.121s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Aug 08 04:40:47 dist-test-slave-t7g5 krb5kdc[25193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:40:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:40:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.148.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
I20260808 04:40:47.339512 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:46689
--webserver_interface=127.12.148.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:41633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:46689
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:47.450918 25208 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:47.451184 25208 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:47.451238 25208 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:47.455155 25208 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:40:47.455211 25208 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:47.455237 25208 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:47.455260 25208 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:40:47.455288 25208 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:40:47.460476 25208 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:41633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:46689
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:46689
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25208
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:47.461548 25208 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:47.462608 25208 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:47.471119 25216 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:47.471184 25214 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:47.471119 25219 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:47.471518 25208 server_base.cc:1034] running on GCE node
I20260808 04:40:47.472118 25208 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:47.473202 25208 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:47.474354 25208 hybrid_clock.cc:648] HybridClock initialized: now 1786164047474332 us; error 37 us; skew 500 ppm
Aug 08 04:40:47 dist-test-slave-t7g5 krb5kdc[25193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164047, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:47.479986 25208 init.cc:377] Logged in from keytab as kudu/127.12.148.126@KRBTEST.COM (short username kudu)
I20260808 04:40:47.480921 25208 webserver.cc:460] Webserver started at http://127.12.148.126:33585/ using document root <none> and password file <none>
I20260808 04:40:47.481496 25208 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:47.481565 25208 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:47.481806 25208 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:47.483932 25208 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "b0dd948737f748b48c09bfcea221c9db"
format_stamp: "Formatted at 2026-08-08 04:40:47 on dist-test-slave-t7g5"
server_key: "c121c1f7df7e79f3500084b7a44aad7b"
server_key_iv: "2bc0590d7e934d50946dda5835e155af"
server_key_version: "encryptionkey@0"
I20260808 04:40:47.484488 25208 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "b0dd948737f748b48c09bfcea221c9db"
format_stamp: "Formatted at 2026-08-08 04:40:47 on dist-test-slave-t7g5"
server_key: "c121c1f7df7e79f3500084b7a44aad7b"
server_key_iv: "2bc0590d7e934d50946dda5835e155af"
server_key_version: "encryptionkey@0"
I20260808 04:40:47.488291 25208 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 04:40:47.490731 25229 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:47.491955 25208 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:40:47.492074 25208 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "b0dd948737f748b48c09bfcea221c9db"
format_stamp: "Formatted at 2026-08-08 04:40:47 on dist-test-slave-t7g5"
server_key: "c121c1f7df7e79f3500084b7a44aad7b"
server_key_iv: "2bc0590d7e934d50946dda5835e155af"
server_key_version: "encryptionkey@0"
I20260808 04:40:47.492172 25208 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:47.511332 25208 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:47.514657 25208 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:47.514853 25208 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:47.521852 25208 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:46689
I20260808 04:40:47.521880 25306 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:46689 every 8 connection(s)
I20260808 04:40:47.522819 25208 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:40:47.525609 25307 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:40:47.525722 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 25208
I20260808 04:40:47.525856 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:40:47.526190 12881 external_mini_cluster.cc:1428] Setting key eb0bebddf55453d97a2aae9d8e608751
I20260808 04:40:47.532121 25307 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0dd948737f748b48c09bfcea221c9db: Bootstrap starting.
I20260808 04:40:47.534752 25307 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b0dd948737f748b48c09bfcea221c9db: Neither blocks nor log segments found. Creating new log.
Aug 08 04:40:47 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:40:47.535513 25307 log.cc:824] T 00000000000000000000000000000000 P b0dd948737f748b48c09bfcea221c9db: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:47.537850 25307 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0dd948737f748b48c09bfcea221c9db: No bootstrap required, opened a new log
I20260808 04:40:47.540896 25313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:47.527720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52338 (local address 127.12.148.126:46689)
0808 04:40:47.528146 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:47.528161 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:47.528197 (+ 36us) server_negotiation.cc:407] Connection header received
0808 04:40:47.528910 (+ 713us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:47.528930 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:47.529256 (+ 326us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:47.529561 (+ 305us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:47.530394 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:47.531422 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:47.532295 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:47.532761 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:47.532885 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:47.535709 (+ 2824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:47.535715 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:47.535732 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:47.535763 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:47.537789 (+ 2026us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:47.538228 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:47.538234 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:47.538240 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:47.538383 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:47.538639 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:47.538642 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:47.538644 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:47.539150 (+ 506us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:47.539342 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:47.539600 (+ 258us) server_negotiation.cc:299] Negotiation successful
0808 04:40:47.539909 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":285,"thread_start_us":117,"threads_started":1}
I20260808 04:40:47.542325 25307 raft_consensus.cc:348] T 00000000000000000000000000000000 P b0dd948737f748b48c09bfcea221c9db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0dd948737f748b48c09bfcea221c9db" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 46689 } }
I20260808 04:40:47.542554 25307 raft_consensus.cc:374] T 00000000000000000000000000000000 P b0dd948737f748b48c09bfcea221c9db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:40:47.542623 25307 raft_consensus.cc:729] T 00000000000000000000000000000000 P b0dd948737f748b48c09bfcea221c9db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0dd948737f748b48c09bfcea221c9db, State: Initialized, Role: FOLLOWER
I20260808 04:40:47.543088 25307 consensus_queue.cc:260] T 00000000000000000000000000000000 P b0dd948737f748b48c09bfcea221c9db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0dd948737f748b48c09bfcea221c9db" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 46689 } }
I20260808 04:40:47.543256 25307 raft_consensus.cc:388] T 00000000000000000000000000000000 P b0dd948737f748b48c09bfcea221c9db [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:40:47.543327 25307 raft_consensus.cc:482] T 00000000000000000000000000000000 P b0dd948737f748b48c09bfcea221c9db [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:40:47.543406 25307 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b0dd948737f748b48c09bfcea221c9db [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:40:47.544222 25307 raft_consensus.cc:504] T 00000000000000000000000000000000 P b0dd948737f748b48c09bfcea221c9db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0dd948737f748b48c09bfcea221c9db" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 46689 } }
I20260808 04:40:47.544539 25307 leader_election.cc:302] T 00000000000000000000000000000000 P b0dd948737f748b48c09bfcea221c9db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b0dd948737f748b48c09bfcea221c9db; no voters:
I20260808 04:40:47.544806 25307 leader_election.cc:288] T 00000000000000000000000000000000 P b0dd948737f748b48c09bfcea221c9db [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:40:47.544934 25317 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b0dd948737f748b48c09bfcea221c9db [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:40:47.545142 25317 raft_consensus.cc:686] T 00000000000000000000000000000000 P b0dd948737f748b48c09bfcea221c9db [term 1 LEADER]: Becoming Leader. State: Replica: b0dd948737f748b48c09bfcea221c9db, State: Running, Role: LEADER
I20260808 04:40:47.545439 25317 consensus_queue.cc:237] T 00000000000000000000000000000000 P b0dd948737f748b48c09bfcea221c9db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0dd948737f748b48c09bfcea221c9db" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 46689 } }
I20260808 04:40:47.546053 25307 sys_catalog.cc:564] T 00000000000000000000000000000000 P b0dd948737f748b48c09bfcea221c9db [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:40:47.547127 25321 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0dd948737f748b48c09bfcea221c9db [sys.catalog]: SysCatalogTable state changed. Reason: New leader b0dd948737f748b48c09bfcea221c9db. Latest consensus state: current_term: 1 leader_uuid: "b0dd948737f748b48c09bfcea221c9db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0dd948737f748b48c09bfcea221c9db" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 46689 } } }
I20260808 04:40:47.547291 25321 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0dd948737f748b48c09bfcea221c9db [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:47.547125 25319 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0dd948737f748b48c09bfcea221c9db [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b0dd948737f748b48c09bfcea221c9db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0dd948737f748b48c09bfcea221c9db" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 46689 } } }
I20260808 04:40:47.547533 25319 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0dd948737f748b48c09bfcea221c9db [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:47.548218 25337 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:40:47.551035 25337 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:40:47.555894 25337 catalog_manager.cc:1347] Generated new cluster ID: 70cc23f6bd19409d82bbe1fd1c401e2d
I20260808 04:40:47.555974 25337 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:40:47.562575 25337 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:40:47.563710 25337 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:40:47.569271 25337 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b0dd948737f748b48c09bfcea221c9db: Generated new TSK 0
I20260808 04:40:47.570043 25337 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.148.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab.
Entry for principal kudu/127.12.148.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab.
I20260808 04:40:47.598201 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.65:0
--local_ip_for_outbound_sockets=127.12.148.65
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:46689
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:41633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:47.709838 25354 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:47.710090 25354 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:47.710134 25354 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:47.714079 25354 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:47.714133 25354 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:47.714203 25354 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.65
I20260808 04:40:47.719295 25354 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:41633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:46689
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25354
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.65
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:47.720265 25354 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:47.721311 25354 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:47.730366 25361 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:47.730383 25359 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:47.730432 25363 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:47.730611 25354 server_base.cc:1034] running on GCE node
I20260808 04:40:47.731079 25354 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:47.731670 25354 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:47.732839 25354 hybrid_clock.cc:648] HybridClock initialized: now 1786164047732794 us; error 38 us; skew 500 ppm
Aug 08 04:40:47 dist-test-slave-t7g5 krb5kdc[25193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164047, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:47.735409 25354 init.cc:377] Logged in from keytab as kudu/127.12.148.65@KRBTEST.COM (short username kudu)
I20260808 04:40:47.736249 25354 webserver.cc:460] Webserver started at http://127.12.148.65:43873/ using document root <none> and password file <none>
I20260808 04:40:47.736760 25354 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:47.736835 25354 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:47.737035 25354 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:47.739044 25354 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-0/data/instance:
uuid: "4ad994cdb87f45269a8723d15606ecfa"
format_stamp: "Formatted at 2026-08-08 04:40:47 on dist-test-slave-t7g5"
server_key: "b0098c0642f39d35f73d79579de7adfb"
server_key_iv: "857b1a4fd0634bfcc162f1c93defd241"
server_key_version: "encryptionkey@0"
I20260808 04:40:47.739575 25354 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance:
uuid: "4ad994cdb87f45269a8723d15606ecfa"
format_stamp: "Formatted at 2026-08-08 04:40:47 on dist-test-slave-t7g5"
server_key: "b0098c0642f39d35f73d79579de7adfb"
server_key_iv: "857b1a4fd0634bfcc162f1c93defd241"
server_key_version: "encryptionkey@0"
I20260808 04:40:47.743120 25354 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 04:40:47.745419 25376 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:47.746722 25354 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:40:47.746845 25354 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-0/wal
uuid: "4ad994cdb87f45269a8723d15606ecfa"
format_stamp: "Formatted at 2026-08-08 04:40:47 on dist-test-slave-t7g5"
server_key: "b0098c0642f39d35f73d79579de7adfb"
server_key_iv: "857b1a4fd0634bfcc162f1c93defd241"
server_key_version: "encryptionkey@0"
I20260808 04:40:47.746937 25354 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:47.766731 25354 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:47.769414 25354 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:47.769595 25354 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:47.770185 25354 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:47.770988 25354 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:47.771036 25354 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:47.771090 25354 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:47.771121 25354 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:47.779412 25354 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.65:46615
I20260808 04:40:47.779433 25538 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.65:46615 every 8 connection(s)
I20260808 04:40:47.780268 25354 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
I20260808 04:40:47.784440 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 25354
I20260808 04:40:47.784582 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance
I20260808 04:40:47.784874 12881 external_mini_cluster.cc:1428] Setting key 9a23a62c68d9b71fdd17537db7cd87d1
Aug 08 04:40:47 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164047, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:40:47.794720 25313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:47.782019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:46153 (local address 127.12.148.126:46689)
0808 04:40:47.782160 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:47.782165 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:47.783225 (+ 1060us) server_negotiation.cc:407] Connection header received
0808 04:40:47.784283 (+ 1058us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:47.784286 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:47.784353 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:47.784448 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:47.785739 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:47.786445 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:47.787958 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:47.788183 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:47.788275 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:47.790757 (+ 2482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:47.790761 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:47.790764 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:47.790794 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:47.792452 (+ 1658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:47.792990 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:47.792993 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:47.792995 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:47.793098 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:47.793498 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:47.793501 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:47.793503 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:47.793784 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:47.793889 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:47.794407 (+ 518us) server_negotiation.cc:299] Negotiation successful
0808 04:40:47.794546 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 04:40:47.795526 25542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:47.782427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.65:46153)
0808 04:40:47.783042 (+ 615us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:47.783106 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:47.784052 (+ 946us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:47.784626 (+ 574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:47.784635 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:47.785021 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:47.785583 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:47.785601 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:47.786573 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:47.786577 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:47.787838 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:47.787850 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:47.788333 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:47.788337 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:47.788530 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:47.789104 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:47.789120 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:47.790578 (+ 1458us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:47.792583 (+ 2005us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:47.792589 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:47.792603 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:47.792891 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:47.793219 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:47.793221 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:47.793223 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:47.793399 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:47.793893 (+ 494us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:47.793899 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:47.794155 (+ 256us) client_negotiation.cc:769] Sending connection context
0808 04:40:47.794325 (+ 170us) client_negotiation.cc:240] Negotiation successful
0808 04:40:47.794601 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":104,"threads_started":1}
WARNING: no policy specified for kudu/127.12.148.66@KRBTEST.COM; defaulting to no policy
I20260808 04:40:47.796761 25539 heartbeater.cc:347] Connected to a master server at 127.12.148.126:46689
I20260808 04:40:47.797041 25539 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:47.797550 25539 heartbeater.cc:511] Master 127.12.148.126:46689 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.66@KRBTEST.COM" created.
I20260808 04:40:47.799227 25259 ts_manager.cc:194] Registered new tserver with Master: 4ad994cdb87f45269a8723d15606ecfa (127.12.148.65:46615)
I20260808 04:40:47.800625 25259 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.65@KRBTEST.COM'} at 127.12.148.65:46153
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab.
Entry for principal kudu/127.12.148.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab.
I20260808 04:40:47.812392 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.66:0
--local_ip_for_outbound_sockets=127.12.148.66
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:46689
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:41633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:47.922726 25546 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:47.922993 25546 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:47.923041 25546 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:47.927018 25546 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:47.927071 25546 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:47.927130 25546 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.66
I20260808 04:40:47.932199 25546 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:41633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:46689
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25546
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.66
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:47.933154 25546 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:47.934167 25546 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:47.943493 25557 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:47.943571 25555 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:47.943496 25553 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:47.943841 25546 server_base.cc:1034] running on GCE node
I20260808 04:40:47.944216 25546 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:47.944851 25546 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:47.946007 25546 hybrid_clock.cc:648] HybridClock initialized: now 1786164047945993 us; error 26 us; skew 500 ppm
Aug 08 04:40:47 dist-test-slave-t7g5 krb5kdc[25193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164047, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:47.948762 25546 init.cc:377] Logged in from keytab as kudu/127.12.148.66@KRBTEST.COM (short username kudu)
I20260808 04:40:47.949628 25546 webserver.cc:460] Webserver started at http://127.12.148.66:33143/ using document root <none> and password file <none>
I20260808 04:40:47.950192 25546 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:47.950271 25546 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:47.950479 25546 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:47.952530 25546 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-1/data/instance:
uuid: "cd650240c9224bbf80473c96a80711d3"
format_stamp: "Formatted at 2026-08-08 04:40:47 on dist-test-slave-t7g5"
server_key: "11275627808536908442ee0f2e893690"
server_key_iv: "433d7d672a0d05c7341a687e9bb9e45f"
server_key_version: "encryptionkey@0"
I20260808 04:40:47.953066 25546 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance:
uuid: "cd650240c9224bbf80473c96a80711d3"
format_stamp: "Formatted at 2026-08-08 04:40:47 on dist-test-slave-t7g5"
server_key: "11275627808536908442ee0f2e893690"
server_key_iv: "433d7d672a0d05c7341a687e9bb9e45f"
server_key_version: "encryptionkey@0"
I20260808 04:40:47.956734 25546 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 04:40:47.959169 25573 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:47.960376 25546 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 04:40:47.960510 25546 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-1/wal
uuid: "cd650240c9224bbf80473c96a80711d3"
format_stamp: "Formatted at 2026-08-08 04:40:47 on dist-test-slave-t7g5"
server_key: "11275627808536908442ee0f2e893690"
server_key_iv: "433d7d672a0d05c7341a687e9bb9e45f"
server_key_version: "encryptionkey@0"
I20260808 04:40:47.960609 25546 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:47.970806 25546 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:47.973361 25546 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:47.973539 25546 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:47.974131 25546 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:47.974941 25546 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:47.974992 25546 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:47.975044 25546 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:47.975073 25546 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:47.983352 25546 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.66:44461
I20260808 04:40:47.983377 25744 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.66:44461 every 8 connection(s)
I20260808 04:40:47.984198 25546 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
I20260808 04:40:47.988162 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 25546
I20260808 04:40:47.988289 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance
I20260808 04:40:47.988557 12881 external_mini_cluster.cc:1428] Setting key 3b0d7c0daaaf1cbaae68c42504a31cba
Aug 08 04:40:47 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164047, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:40:47.997954 25313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:47.985896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:34325 (local address 127.12.148.126:46689)
0808 04:40:47.986018 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:47.986021 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:47.987106 (+ 1085us) server_negotiation.cc:407] Connection header received
0808 04:40:47.987993 (+ 887us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:47.987997 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:47.988056 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:47.988127 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:47.989469 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:47.990116 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:47.991278 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:47.991516 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:47.991608 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:47.994311 (+ 2703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:47.994315 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:47.994317 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:47.994342 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:47.995715 (+ 1373us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:47.996311 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:47.996314 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:47.996315 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:47.996398 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:47.996793 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:47.996795 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:47.996797 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:47.996981 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:47.997056 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:47.997712 (+ 656us) server_negotiation.cc:299] Negotiation successful
0808 04:40:47.997818 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 04:40:47.999257 25747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:47.986323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.66:34325)
0808 04:40:47.986966 (+ 643us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:47.987007 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:47.987768 (+ 761us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:47.988322 (+ 554us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:47.988330 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:47.988735 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:47.989313 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:47.989329 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:47.990247 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:47.990251 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:47.991153 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:47.991163 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:47.991661 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:47.991666 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:47.991881 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:47.992477 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:47.992498 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:47.994146 (+ 1648us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:47.995827 (+ 1681us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:47.995834 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:47.995851 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:47.996214 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:47.996481 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:47.996484 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:47.996486 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:47.996681 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:47.997082 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:47.997089 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:47.997425 (+ 336us) client_negotiation.cc:769] Sending connection context
0808 04:40:47.997684 (+ 259us) client_negotiation.cc:240] Negotiation successful
0808 04:40:47.998046 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":111,"threads_started":1}
WARNING: no policy specified for kudu/127.12.148.67@KRBTEST.COM; defaulting to no policy
I20260808 04:40:48.000466 25745 heartbeater.cc:347] Connected to a master server at 127.12.148.126:46689
I20260808 04:40:48.000703 25745 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:48.001176 25745 heartbeater.cc:511] Master 127.12.148.126:46689 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.67@KRBTEST.COM" created.
I20260808 04:40:48.002279 25259 ts_manager.cc:194] Registered new tserver with Master: cd650240c9224bbf80473c96a80711d3 (127.12.148.66:44461)
I20260808 04:40:48.002873 25259 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.66@KRBTEST.COM'} at 127.12.148.66:34325
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab.
Entry for principal kudu/127.12.148.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab.
I20260808 04:40:48.017282 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.67:0
--local_ip_for_outbound_sockets=127.12.148.67
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:46689
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:41633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:48.128937 25751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:48.129189 25751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:48.129233 25751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:48.133162 25751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:48.133217 25751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:48.133289 25751 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.67
I20260808 04:40:48.138413 25751 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:41633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:46689
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25751
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.67
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:48.139379 25751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:48.140353 25751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:48.149531 25763 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:48.149515 25762 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:48.149514 25767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:48.149559 25751 server_base.cc:1034] running on GCE node
I20260808 04:40:48.150221 25751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:48.150811 25751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:48.151973 25751 hybrid_clock.cc:648] HybridClock initialized: now 1786164048151955 us; error 48 us; skew 500 ppm
Aug 08 04:40:48 dist-test-slave-t7g5 krb5kdc[25193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164048, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:48.154623 25751 init.cc:377] Logged in from keytab as kudu/127.12.148.67@KRBTEST.COM (short username kudu)
I20260808 04:40:48.155418 25751 webserver.cc:460] Webserver started at http://127.12.148.67:35765/ using document root <none> and password file <none>
I20260808 04:40:48.155941 25751 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:48.155998 25751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:48.156158 25751 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:40:48.158143 25751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-2/data/instance:
uuid: "b97b91a762914aef818ff9dea49ad33a"
format_stamp: "Formatted at 2026-08-08 04:40:48 on dist-test-slave-t7g5"
server_key: "3e1b6e97dc35ed7ace2c12703caf1dd3"
server_key_iv: "c7477a1d88704a26483f823f64dc6652"
server_key_version: "encryptionkey@0"
I20260808 04:40:48.158649 25751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance:
uuid: "b97b91a762914aef818ff9dea49ad33a"
format_stamp: "Formatted at 2026-08-08 04:40:48 on dist-test-slave-t7g5"
server_key: "3e1b6e97dc35ed7ace2c12703caf1dd3"
server_key_iv: "c7477a1d88704a26483f823f64dc6652"
server_key_version: "encryptionkey@0"
I20260808 04:40:48.162227 25751 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 04:40:48.164582 25778 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:48.165838 25751 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:40:48.165948 25751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-2/wal
uuid: "b97b91a762914aef818ff9dea49ad33a"
format_stamp: "Formatted at 2026-08-08 04:40:48 on dist-test-slave-t7g5"
server_key: "3e1b6e97dc35ed7ace2c12703caf1dd3"
server_key_iv: "c7477a1d88704a26483f823f64dc6652"
server_key_version: "encryptionkey@0"
I20260808 04:40:48.166049 25751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:48.175918 25751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:48.178510 25751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:48.178656 25751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:48.179131 25751 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:48.179884 25751 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:48.179929 25751 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:48.179966 25751 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:48.179986 25751 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:48.188213 25751 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.67:41603
I20260808 04:40:48.188246 25935 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.67:41603 every 8 connection(s)
I20260808 04:40:48.189114 25751 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
I20260808 04:40:48.195371 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 25751
I20260808 04:40:48.195526 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance
I20260808 04:40:48.195847 12881 external_mini_cluster.cc:1428] Setting key 143144bdf61fc750e406385a168537f9
Aug 08 04:40:48 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164048, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:40:48.203071 25313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:48.191501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:60281 (local address 127.12.148.126:46689)
0808 04:40:48.191650 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:48.191654 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:48.192801 (+ 1147us) server_negotiation.cc:407] Connection header received
0808 04:40:48.193933 (+ 1132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:48.193937 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:48.193999 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:48.194076 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:48.195484 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.196140 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.197594 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.197929 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.198011 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:48.200198 (+ 2187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:48.200201 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:48.200203 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:48.200227 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:48.201408 (+ 1181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:48.201900 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:48.201902 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:48.201903 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:48.201981 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:48.202238 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:48.202240 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:48.202241 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:48.202408 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:48.202477 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:48.202860 (+ 383us) server_negotiation.cc:299] Negotiation successful
0808 04:40:48.202955 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 04:40:48.203846 25941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:48.191874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.67:60281)
0808 04:40:48.192629 (+ 755us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:48.192685 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:48.193674 (+ 989us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:48.194245 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:48.194252 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:48.194600 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:48.195297 (+ 697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:48.195319 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.196287 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.196291 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:48.197479 (+ 1188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:48.197490 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.198061 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.198064 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:48.198204 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:48.198681 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:48.198698 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:48.200049 (+ 1351us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:40:48.201508 (+ 1459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:48.201513 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:48.201524 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:48.201823 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:48.202046 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:40:48.202048 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:40:48.202049 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:40:48.202176 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:40:48.202470 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:40:48.202475 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:40:48.202686 (+ 211us) client_negotiation.cc:769] Sending connection context
0808 04:40:48.202829 (+ 143us) client_negotiation.cc:240] Negotiation successful
0808 04:40:48.203071 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":114,"threads_started":1}
I20260808 04:40:48.204933 25937 heartbeater.cc:347] Connected to a master server at 127.12.148.126:46689
I20260808 04:40:48.205144 25937 heartbeater.cc:464] Registering TS with master...
I20260808 04:40:48.205709 25937 heartbeater.cc:511] Master 127.12.148.126:46689 requested a full tablet report, sending...
I20260808 04:40:48.206812 25259 ts_manager.cc:194] Registered new tserver with Master: b97b91a762914aef818ff9dea49ad33a (127.12.148.67:41603)
I20260808 04:40:48.207338 25259 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.67@KRBTEST.COM'} at 127.12.148.67:60281
I20260808 04:40:48.209554 12881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.12.148.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.148.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.148.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.65.keytab.
Entry for principal oryx/127.12.148.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.65.keytab.
WARNING: no policy specified for oryx/127.12.148.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.148.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.148.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.66.keytab.
Entry for principal oryx/127.12.148.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.66.keytab.
WARNING: no policy specified for oryx/127.12.148.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.148.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.148.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.67.keytab.
Entry for principal oryx/127.12.148.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.67.keytab.
I20260808 04:40:48.284529 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 25354
I20260808 04:40:48.297241 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 25546
I20260808 04:40:48.311482 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 25751
I20260808 04:40:48.329597 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 25208
I20260808 04:40:48.339229 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:46689
--webserver_interface=127.12.148.126
--webserver_port=33585
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:41633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:46689
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:40:48.450301 25952 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:48.450556 25952 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:48.450599 25952 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:48.454527 25952 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:40:48.454577 25952 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:48.454595 25952 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:48.454625 25952 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:40:48.454653 25952 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:40:48.459913 25952 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:41633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:46689
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:46689
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=33585
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25952
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:48.460945 25952 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:48.461980 25952 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:48.470397 25960 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:48.470402 25957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:48.470398 25962 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:48.470721 25952 server_base.cc:1034] running on GCE node
I20260808 04:40:48.471347 25952 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:48.472446 25952 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:48.473615 25952 hybrid_clock.cc:648] HybridClock initialized: now 1786164048473601 us; error 38 us; skew 500 ppm
Aug 08 04:40:48 dist-test-slave-t7g5 krb5kdc[25193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164048, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:48.476404 25952 init.cc:377] Logged in from keytab as kudu/127.12.148.126@KRBTEST.COM (short username kudu)
I20260808 04:40:48.477340 25952 webserver.cc:460] Webserver started at http://127.12.148.126:33585/ using document root <none> and password file <none>
I20260808 04:40:48.477977 25952 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:48.478061 25952 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:48.482080 25952 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 04:40:48.484290 25972 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:48.485630 25952 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:40:48.485781 25952 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "b0dd948737f748b48c09bfcea221c9db"
format_stamp: "Formatted at 2026-08-08 04:40:47 on dist-test-slave-t7g5"
server_key: "c121c1f7df7e79f3500084b7a44aad7b"
server_key_iv: "2bc0590d7e934d50946dda5835e155af"
server_key_version: "encryptionkey@0"
I20260808 04:40:48.486348 25952 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:48.508706 25952 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:48.511902 25952 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:48.512089 25952 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:48.519223 25952 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:46689
I20260808 04:40:48.519241 26039 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:46689 every 8 connection(s)
I20260808 04:40:48.520315 25952 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:40:48.524829 26042 sys_catalog.cc:263] Verifying existing consensus state
I20260808 04:40:48.526197 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 25952
I20260808 04:40:48.526625 26042 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0dd948737f748b48c09bfcea221c9db: Bootstrap starting.
I20260808 04:40:48.526633 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.65:46615
--local_ip_for_outbound_sockets=127.12.148.65
--tserver_master_addrs=127.12.148.126:46689
--webserver_port=43873
--webserver_interface=127.12.148.65
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:41633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.12.148.65
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.65.keytab with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 04:40:48.548388 26042 log.cc:824] T 00000000000000000000000000000000 P b0dd948737f748b48c09bfcea221c9db: Log is configured to *not* fsync() on all Append() calls
I20260808 04:40:48.557029 26042 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0dd948737f748b48c09bfcea221c9db: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 04:40:48.557439 26042 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0dd948737f748b48c09bfcea221c9db: Bootstrap complete.
I20260808 04:40:48.563040 26042 raft_consensus.cc:348] T 00000000000000000000000000000000 P b0dd948737f748b48c09bfcea221c9db [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0dd948737f748b48c09bfcea221c9db" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 46689 } }
I20260808 04:40:48.563571 26042 raft_consensus.cc:729] T 00000000000000000000000000000000 P b0dd948737f748b48c09bfcea221c9db [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0dd948737f748b48c09bfcea221c9db, State: Initialized, Role: FOLLOWER
I20260808 04:40:48.564150 26042 consensus_queue.cc:260] T 00000000000000000000000000000000 P b0dd948737f748b48c09bfcea221c9db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0dd948737f748b48c09bfcea221c9db" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 46689 } }
I20260808 04:40:48.564301 26042 raft_consensus.cc:388] T 00000000000000000000000000000000 P b0dd948737f748b48c09bfcea221c9db [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:40:48.564370 26042 raft_consensus.cc:482] T 00000000000000000000000000000000 P b0dd948737f748b48c09bfcea221c9db [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:40:48.564467 26042 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b0dd948737f748b48c09bfcea221c9db [term 1 FOLLOWER]: Advancing to term 2
I20260808 04:40:48.566934 26042 raft_consensus.cc:504] T 00000000000000000000000000000000 P b0dd948737f748b48c09bfcea221c9db [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0dd948737f748b48c09bfcea221c9db" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 46689 } }
I20260808 04:40:48.567303 26042 leader_election.cc:302] T 00000000000000000000000000000000 P b0dd948737f748b48c09bfcea221c9db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b0dd948737f748b48c09bfcea221c9db; no voters:
I20260808 04:40:48.567667 26042 leader_election.cc:288] T 00000000000000000000000000000000 P b0dd948737f748b48c09bfcea221c9db [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 04:40:48.567786 26046 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b0dd948737f748b48c09bfcea221c9db [term 2 FOLLOWER]: Leader election won for term 2
I20260808 04:40:48.568064 26046 raft_consensus.cc:686] T 00000000000000000000000000000000 P b0dd948737f748b48c09bfcea221c9db [term 2 LEADER]: Becoming Leader. State: Replica: b0dd948737f748b48c09bfcea221c9db, State: Running, Role: LEADER
I20260808 04:40:48.568383 26046 consensus_queue.cc:237] T 00000000000000000000000000000000 P b0dd948737f748b48c09bfcea221c9db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0dd948737f748b48c09bfcea221c9db" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 46689 } }
I20260808 04:40:48.568908 26042 sys_catalog.cc:564] T 00000000000000000000000000000000 P b0dd948737f748b48c09bfcea221c9db [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:40:48.569262 26051 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0dd948737f748b48c09bfcea221c9db [sys.catalog]: SysCatalogTable state changed. Reason: New leader b0dd948737f748b48c09bfcea221c9db. Latest consensus state: current_term: 2 leader_uuid: "b0dd948737f748b48c09bfcea221c9db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0dd948737f748b48c09bfcea221c9db" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 46689 } } }
I20260808 04:40:48.569386 26051 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0dd948737f748b48c09bfcea221c9db [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:48.569751 26047 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0dd948737f748b48c09bfcea221c9db [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "b0dd948737f748b48c09bfcea221c9db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0dd948737f748b48c09bfcea221c9db" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 46689 } } }
I20260808 04:40:48.569849 26047 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0dd948737f748b48c09bfcea221c9db [sys.catalog]: This master's current role is: LEADER
I20260808 04:40:48.570120 26055 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:40:48.573344 26055 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:40:48.574172 26055 catalog_manager.cc:1259] Loaded cluster ID: 70cc23f6bd19409d82bbe1fd1c401e2d
I20260808 04:40:48.574235 26055 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:40:48.576579 26055 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:40:48.577240 26055 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b0dd948737f748b48c09bfcea221c9db: Loaded TSK: 0
I20260808 04:40:48.578496 26055 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 04:40:48.652858 26044 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:48.653131 26044 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:48.653198 26044 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:48.657439 26044 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:48.657511 26044 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:48.657598 26044 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.65
I20260808 04:40:48.663652 26044 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:41633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.65.keytab
--principal=oryx/127.12.148.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.65:46615
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.148.65
--webserver_port=43873
--tserver_master_addrs=127.12.148.126:46689
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26044
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.65
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:48.664703 26044 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:48.665761 26044 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:48.675989 26079 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:48.676007 26084 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:48.676302 26044 server_base.cc:1034] running on GCE node
W20260808 04:40:48.676052 26081 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:48.676716 26044 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:48.677306 26044 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:48.678478 26044 hybrid_clock.cc:648] HybridClock initialized: now 1786164048678434 us; error 60 us; skew 500 ppm
Aug 08 04:40:48 dist-test-slave-t7g5 krb5kdc[25193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164048, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.148.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:48.681191 26044 init.cc:377] Logged in from keytab as oryx/127.12.148.65@KRBTEST.COM (short username oryx)
I20260808 04:40:48.682127 26044 webserver.cc:460] Webserver started at http://127.12.148.65:43873/ using document root <none> and password file <none>
I20260808 04:40:48.682679 26044 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:48.682756 26044 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:48.686661 26044 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 04:40:48.688841 26096 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:48.690356 26044 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 04:40:48.690547 26044 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-0/wal
uuid: "4ad994cdb87f45269a8723d15606ecfa"
format_stamp: "Formatted at 2026-08-08 04:40:47 on dist-test-slave-t7g5"
server_key: "b0098c0642f39d35f73d79579de7adfb"
server_key_iv: "857b1a4fd0634bfcc162f1c93defd241"
server_key_version: "encryptionkey@0"
I20260808 04:40:48.691128 26044 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:48.721311 26044 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:48.724732 26044 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:48.724941 26044 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:48.725559 26044 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:48.726465 26044 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:48.726518 26044 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:48.726574 26044 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:48.726600 26044 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:48.735247 26044 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.65:46615
I20260808 04:40:48.735299 26265 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.65:46615 every 8 connection(s)
I20260808 04:40:48.736305 26044 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
I20260808 04:40:48.745362 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 26044
I20260808 04:40:48.745920 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.66:44461
--local_ip_for_outbound_sockets=127.12.148.66
--tserver_master_addrs=127.12.148.126:46689
--webserver_port=33143
--webserver_interface=127.12.148.66
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:41633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.12.148.66
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.66.keytab with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 04:40:48 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.65@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:48 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.65@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:48.749260 26269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:48.738436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.65:50069)
0808 04:40:48.739136 (+ 700us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:48.739190 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:48.739991 (+ 801us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:48.741088 (+ 1097us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:48.741095 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:48.741465 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:48.742012 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:48.742029 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.743304 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.743307 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:48.744212 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:48.744221 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.744965 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.744968 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:48.745166 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:48.745861 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:48.745883 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:48.748421 (+ 2538us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":496,"thread_start_us":103,"threads_started":1}
W20260808 04:40:48.749759 26268 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:48.738328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:50069 (local address 127.12.148.126:46689)
0808 04:40:48.738782 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:48.738799 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:48.739297 (+ 498us) server_negotiation.cc:407] Connection header received
0808 04:40:48.740378 (+ 1081us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:48.740390 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:48.740708 (+ 318us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:48.740989 (+ 281us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:48.742178 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.743175 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.744307 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.744802 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.744920 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:48.748769 (+ 3849us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.65:50069: BlockingRecv error: recv got EOF from 127.12.148.65:50069 (error 108)
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":118,"threads_started":1}
W20260808 04:40:48.749967 26266 heartbeater.cc:644] Failed to heartbeat to 127.12.148.126:46689 (0 consecutive failures): Not authorized: Failed to ping master at 127.12.148.126:46689: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Aug 08 04:40:48 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.65@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:48 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.65@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:48.756184 26269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:48.750538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.65:55887)
0808 04:40:48.750684 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:48.750699 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:48.750790 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:48.751045 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:48.751048 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:48.751253 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:48.751387 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:48.751395 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.752181 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.752185 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:48.753063 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:48.753075 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.753489 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.753493 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:48.753590 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:48.754082 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:48.754098 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:48.756068 (+ 1970us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":57}
W20260808 04:40:48.756392 26268 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:48.750665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:55887 (local address 127.12.148.126:46689)
0808 04:40:48.750781 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:48.750784 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:48.750800 (+ 16us) server_negotiation.cc:407] Connection header received
0808 04:40:48.750878 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:48.750880 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:48.750925 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:48.750991 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:48.751536 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.752066 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.753177 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.753383 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.753451 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:48.756268 (+ 2817us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.65:55887: BlockingRecv error: recv got EOF from 127.12.148.65:55887 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 08 04:40:48 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.65@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:48 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.65@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:48.761981 26269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:48.756810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.65:58391)
0808 04:40:48.756979 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:48.756992 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:48.757056 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:48.757281 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:48.757282 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:48.757421 (+ 139us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:48.757493 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:48.757497 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.758526 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.758529 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:48.759063 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:48.759072 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.759643 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.759646 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:48.759710 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:48.760176 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:48.760187 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:48.761877 (+ 1690us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":103}
W20260808 04:40:48.762161 26268 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:48.756919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:58391 (local address 127.12.148.126:46689)
0808 04:40:48.757047 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:48.757052 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:48.757067 (+ 15us) server_negotiation.cc:407] Connection header received
0808 04:40:48.757135 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:48.757138 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:48.757190 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:48.757274 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:48.757595 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.758376 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.759170 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.759527 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.759626 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:48.762042 (+ 2416us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.65:58391: BlockingRecv error: recv got EOF from 127.12.148.65:58391 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260808 04:40:48.762274 26266 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 04:40:48.866333 26270 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:48.866976 26270 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:48.867105 26270 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:48.872033 26270 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:48.872126 26270 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:48.872215 26270 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.66
I20260808 04:40:48.877748 26270 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:41633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.66.keytab
--principal=oryx/127.12.148.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.66:44461
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.148.66
--webserver_port=33143
--tserver_master_addrs=127.12.148.126:46689
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26270
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.66
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:48.878765 26270 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:48.879719 26270 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:48.889042 26277 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:48.889060 26281 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:48.889240 26270 server_base.cc:1034] running on GCE node
W20260808 04:40:48.889364 26284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:48.889843 26270 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:48.890480 26270 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:48.891654 26270 hybrid_clock.cc:648] HybridClock initialized: now 1786164048891622 us; error 48 us; skew 500 ppm
Aug 08 04:40:48 dist-test-slave-t7g5 krb5kdc[25193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164048, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.148.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:48.894443 26270 init.cc:377] Logged in from keytab as oryx/127.12.148.66@KRBTEST.COM (short username oryx)
I20260808 04:40:48.895336 26270 webserver.cc:460] Webserver started at http://127.12.148.66:33143/ using document root <none> and password file <none>
I20260808 04:40:48.895879 26270 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:48.895949 26270 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:48.899722 26270 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.001s
I20260808 04:40:48.901697 26293 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:48.902884 26270 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:40:48.902983 26270 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-1/wal
uuid: "cd650240c9224bbf80473c96a80711d3"
format_stamp: "Formatted at 2026-08-08 04:40:47 on dist-test-slave-t7g5"
server_key: "11275627808536908442ee0f2e893690"
server_key_iv: "433d7d672a0d05c7341a687e9bb9e45f"
server_key_version: "encryptionkey@0"
I20260808 04:40:48.903519 26270 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:48.913311 26270 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:48.916071 26270 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:48.916242 26270 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:48.916806 26270 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:48.917615 26270 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:48.917690 26270 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:48.917749 26270 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:48.917771 26270 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:48.926167 26270 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.66:44461
I20260808 04:40:48.926189 26453 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.66:44461 every 8 connection(s)
I20260808 04:40:48.927157 26270 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
I20260808 04:40:48.934659 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 26270
I20260808 04:40:48.935217 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.67:41603
--local_ip_for_outbound_sockets=127.12.148.67
--tserver_master_addrs=127.12.148.126:46689
--webserver_port=35765
--webserver_interface=127.12.148.67
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:41633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.12.148.67
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.67.keytab with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 04:40:48 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.66@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:48 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.66@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
W20260808 04:40:48.937796 26268 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:48.928868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:54913 (local address 127.12.148.126:46689)
0808 04:40:48.928988 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:48.928992 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:48.930015 (+ 1023us) server_negotiation.cc:407] Connection header received
0808 04:40:48.930904 (+ 889us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:48.930908 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:48.930972 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:48.931042 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:48.932241 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.932776 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.933939 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.934157 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.934244 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:48.937688 (+ 3444us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.66:54913: BlockingRecv error: recv got EOF from 127.12.148.66:54913 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 04:40:48.938597 26457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:48.929193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.66:54913)
0808 04:40:48.929871 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:48.929914 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:48.930685 (+ 771us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:48.931229 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:48.931237 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:48.931590 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:48.932092 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:48.932106 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.932896 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.932899 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:48.933824 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:48.933834 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.934291 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.934295 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:48.934496 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:48.935103 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:48.935126 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:48.937530 (+ 2404us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":112,"threads_started":1}
W20260808 04:40:48.939098 26455 heartbeater.cc:644] Failed to heartbeat to 127.12.148.126:46689 (0 consecutive failures): Not authorized: Failed to ping master at 127.12.148.126:46689: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Aug 08 04:40:48 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.66@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:48 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.66@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:48.944722 26457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:48.939503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.66:52541)
0808 04:40:48.939643 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:48.939657 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:48.939726 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:48.939931 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:48.939934 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:48.940079 (+ 145us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:48.940171 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:48.940176 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.940931 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.940935 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:48.941831 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:48.941844 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.942256 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.942260 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:48.942355 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:48.942798 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:48.942813 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:48.944598 (+ 1785us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":88}
W20260808 04:40:48.944897 26268 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:48.939613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:52541 (local address 127.12.148.126:46689)
0808 04:40:48.939741 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:48.939745 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:48.939760 (+ 15us) server_negotiation.cc:407] Connection header received
0808 04:40:48.939800 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:48.939803 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:48.939842 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:48.939904 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:48.940277 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.940797 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.941948 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.942152 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.942225 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:48.944763 (+ 2538us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.66:52541: BlockingRecv error: recv got EOF from 127.12.148.66:52541 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 08 04:40:48 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.66@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:48 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.66@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:48.950191 26457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:48.945379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.66:37211)
0808 04:40:48.945477 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:48.945492 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:48.945572 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:48.945855 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:48.945858 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:48.946009 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:48.946086 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:48.946091 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.946795 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.946799 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:48.947308 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:48.947317 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.947739 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.947743 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:48.947823 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:48.948279 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:48.948291 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:48.950073 (+ 1782us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 04:40:48.950295 26268 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:48.945482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:37211 (local address 127.12.148.126:46689)
0808 04:40:48.945604 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:48.945609 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:48.945626 (+ 17us) server_negotiation.cc:407] Connection header received
0808 04:40:48.945697 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:48.945704 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:48.945749 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:48.945823 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:48.946211 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.946686 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.947421 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:48.947628 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:48.947722 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:48.950197 (+ 2475us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.66:37211: BlockingRecv error: recv got EOF from 127.12.148.66:37211 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260808 04:40:48.950632 26455 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 04:40:49.049746 26461 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:40:49.050014 26461 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:40:49.050056 26461 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:40:49.053977 26461 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:40:49.054029 26461 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:40:49.054085 26461 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.67
I20260808 04:40:49.059152 26461 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:41633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/krb5kdc/oryx_127.12.148.67.keytab
--principal=oryx/127.12.148.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.67:41603
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.148.67
--webserver_port=35765
--tserver_master_addrs=127.12.148.126:46689
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26461
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.67
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:40:49.060117 26461 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:40:49.061065 26461 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:40:49.070469 26469 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:49.070480 26472 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:40:49.070492 26470 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:40:49.070866 26461 server_base.cc:1034] running on GCE node
I20260808 04:40:49.071316 26461 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:40:49.071967 26461 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:40:49.073122 26461 hybrid_clock.cc:648] HybridClock initialized: now 1786164049073096 us; error 38 us; skew 500 ppm
Aug 08 04:40:49 dist-test-slave-t7g5 krb5kdc[25193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164049, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.148.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:40:49.075877 26461 init.cc:377] Logged in from keytab as oryx/127.12.148.67@KRBTEST.COM (short username oryx)
I20260808 04:40:49.076745 26461 webserver.cc:460] Webserver started at http://127.12.148.67:35765/ using document root <none> and password file <none>
I20260808 04:40:49.077263 26461 fs_manager.cc:359] Metadata directory not provided
I20260808 04:40:49.077335 26461 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:40:49.081207 26461 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:40:49.083319 26481 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:49.084549 26461 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 04:40:49.084648 26461 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-2/wal
uuid: "b97b91a762914aef818ff9dea49ad33a"
format_stamp: "Formatted at 2026-08-08 04:40:48 on dist-test-slave-t7g5"
server_key: "3e1b6e97dc35ed7ace2c12703caf1dd3"
server_key_iv: "c7477a1d88704a26483f823f64dc6652"
server_key_version: "encryptionkey@0"
I20260808 04:40:49.085170 26461 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:40:49.111227 26461 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:40:49.114202 26461 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:40:49.114403 26461 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:40:49.115016 26461 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:40:49.115875 26461 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:40:49.115923 26461 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:49.115978 26461 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:40:49.116009 26461 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:40:49.124754 26461 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.67:41603
I20260808 04:40:49.124783 26644 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.67:41603 every 8 connection(s)
I20260808 04:40:49.125763 26461 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
I20260808 04:40:49.133991 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 26461
Aug 08 04:40:49 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.67@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:49 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.67@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
W20260808 04:40:49.136704 26268 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:49.127541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:60999 (local address 127.12.148.126:46689)
0808 04:40:49.127673 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:49.127677 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:49.128756 (+ 1079us) server_negotiation.cc:407] Connection header received
0808 04:40:49.129646 (+ 890us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:49.129672 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:49.129737 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:49.129815 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:49.130998 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:49.131517 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:49.132690 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:49.132921 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:49.133010 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:49.136579 (+ 3569us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.67:60999: BlockingRecv error: recv got EOF from 127.12.148.67:60999 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 04:40:49.137501 26650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:49.127928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.67:60999)
0808 04:40:49.128598 (+ 670us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:49.128640 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:49.129433 (+ 793us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:49.130005 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:49.130012 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:49.130373 (+ 361us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:49.130847 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:49.130862 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:49.131636 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:49.131639 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:49.132565 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:49.132576 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:49.133064 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:49.133068 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:49.133228 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:49.133858 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:49.133879 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:49.136457 (+ 2578us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":111,"threads_started":1}
W20260808 04:40:49.137981 26645 heartbeater.cc:644] Failed to heartbeat to 127.12.148.126:46689 (0 consecutive failures): Not authorized: Failed to ping master at 127.12.148.126:46689: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Aug 08 04:40:49 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.67@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:49 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.67@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:49.143187 26650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:49.138388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.67:33631)
0808 04:40:49.138499 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:49.138513 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:49.138586 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:49.138785 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:49.138788 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:49.138936 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:49.139031 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:49.139037 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:49.139729 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:49.139733 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:49.140387 (+ 654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:49.140397 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:49.140790 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:49.140793 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:49.140887 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:49.141247 (+ 360us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:49.141259 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:49.143069 (+ 1810us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":40}
W20260808 04:40:49.143294 26268 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:49.138472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:33631 (local address 127.12.148.126:46689)
0808 04:40:49.138574 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:49.138578 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:49.138590 (+ 12us) server_negotiation.cc:407] Connection header received
0808 04:40:49.138656 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:49.138659 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:49.138698 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:49.138758 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:49.139136 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:49.139626 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:49.140495 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:49.140695 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:49.140777 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:49.143195 (+ 2418us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.67:33631: BlockingRecv error: recv got EOF from 127.12.148.67:33631 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 04:40:49.145357 26653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:49.135035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52354 (local address 127.12.148.126:46689)
0808 04:40:49.135270 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:49.135275 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:49.135289 (+ 14us) server_negotiation.cc:407] Connection header received
0808 04:40:49.135589 (+ 300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:49.135593 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:49.135638 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:49.135708 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:49.137748 (+ 2040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:49.138490 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:49.139338 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:49.139570 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:49.139655 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:49.140977 (+ 1322us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:40:49.140983 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:40:49.140999 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:40:49.141026 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:40:49.142902 (+ 1876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:49.143546 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:49.143551 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:49.143558 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:49.143686 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:40:49.144138 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:40:49.144141 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:40:49.144143 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:40:49.144560 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:40:49.144756 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0808 04:40:49.145001 (+ 245us) server_negotiation.cc:299] Negotiation successful
0808 04:40:49.145243 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":68,"threads_started":1}
Aug 08 04:40:49 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.67@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:49 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.67@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:49.148687 26650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:49.143747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.67:56665)
0808 04:40:49.143852 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:49.143865 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:49.143934 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:49.144133 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:49.144136 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:49.144260 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:49.144336 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:49.144341 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:49.145204 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:49.145207 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:49.145862 (+ 655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:49.145872 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:49.146348 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:49.146352 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:49.146429 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:49.146801 (+ 372us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:49.146815 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:49.148601 (+ 1786us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":34}
W20260808 04:40:49.148814 26268 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:49.143821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:56665 (local address 127.12.148.126:46689)
0808 04:40:49.143960 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:49.143963 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:49.143974 (+ 11us) server_negotiation.cc:407] Connection header received
0808 04:40:49.144001 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:49.144003 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:49.144034 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:49.144093 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:49.144434 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:49.145087 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:49.145960 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:49.146248 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:49.146340 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:49.148708 (+ 2368us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.67:56665: BlockingRecv error: recv got EOF from 127.12.148.67:56665 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
W20260808 04:40:49.148867 26645 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 08 04:40:49 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.65@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:49 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.65@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:49.768186 26655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:49.762892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.65:51769)
0808 04:40:49.763147 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:49.763160 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:49.763245 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:49.763513 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:49.763516 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:49.763711 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:49.763842 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:49.763848 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:49.764626 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:49.764629 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:49.765273 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:49.765285 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:49.765705 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:49.765708 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:49.765789 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:49.766279 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:49.766292 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:49.768062 (+ 1770us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":75,"threads_started":1}
W20260808 04:40:49.768309 26656 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:49.763003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:51769 (local address 127.12.148.126:46689)
0808 04:40:49.763252 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:49.763256 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:49.763276 (+ 20us) server_negotiation.cc:407] Connection header received
0808 04:40:49.763315 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:49.763317 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:49.763357 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:49.763438 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:49.763964 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:49.764519 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:49.765385 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:49.765599 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:49.765695 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:49.768194 (+ 2499us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.65:51769: BlockingRecv error: recv got EOF from 127.12.148.65:51769 (error 108)
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":95,"threads_started":1}
Aug 08 04:40:49 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.66@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:49 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.66@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:49.956499 26657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:49.951219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.66:40011)
0808 04:40:49.951476 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:49.951491 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:49.951594 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:49.951849 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:49.951852 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:49.952051 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:49.952169 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:49.952175 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:49.952960 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:49.952963 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:49.953534 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:49.953543 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:49.954005 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:49.954009 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:49.954103 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:49.954566 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:49.954576 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:49.956386 (+ 1810us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":76,"threads_started":1}
W20260808 04:40:49.956640 26656 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:49.951374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:40011 (local address 127.12.148.126:46689)
0808 04:40:49.951522 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:49.951526 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:49.951544 (+ 18us) server_negotiation.cc:407] Connection header received
0808 04:40:49.951690 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:49.951693 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:49.951744 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:49.951809 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:49.952294 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:49.952847 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:49.953670 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:49.953900 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:49.953989 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:49.956520 (+ 2531us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.66:40011: BlockingRecv error: recv got EOF from 127.12.148.66:40011 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 08 04:40:50 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.67@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:50 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.67@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:50.154757 26658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:50.149475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.67:60349)
0808 04:40:50.149770 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:50.149785 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:50.149884 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:50.150105 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:50.150107 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:50.150295 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:50.150419 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:50.150425 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:50.151111 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:50.151114 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:50.151708 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:50.151717 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:50.152135 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:50.152139 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:50.152229 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:50.152778 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:50.152791 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:50.154632 (+ 1841us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":84,"threads_started":1}
W20260808 04:40:50.154882 26656 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:50.149554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:60349 (local address 127.12.148.126:46689)
0808 04:40:50.149717 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:50.149721 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:50.149846 (+ 125us) server_negotiation.cc:407] Connection header received
0808 04:40:50.149965 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:50.149967 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:50.150014 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:50.150080 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:50.150506 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:50.151029 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:50.151804 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:50.152015 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:50.152083 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:50.154775 (+ 2692us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.67:60349: BlockingRecv error: recv got EOF from 127.12.148.67:60349 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 08 04:40:50 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.65@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:50 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.65@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:50.774638 26659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:50.768962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.65:48527)
0808 04:40:50.769231 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:50.769248 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:50.769354 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:50.769576 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:50.769578 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:50.769788 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:50.769891 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:50.769896 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:50.770750 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:50.770754 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:50.771485 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:50.771498 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:50.772049 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:50.772052 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:50.772119 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:50.772632 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:50.772648 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:50.774481 (+ 1833us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":94,"threads_started":1}
W20260808 04:40:50.774859 26660 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:50.768997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:48527 (local address 127.12.148.126:46689)
0808 04:40:50.769226 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:50.769230 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:50.769307 (+ 77us) server_negotiation.cc:407] Connection header received
0808 04:40:50.769428 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:50.769431 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:50.769475 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:50.769552 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:50.770015 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:50.770627 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:50.771614 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:50.771942 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:50.772027 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:50.774636 (+ 2609us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.65:48527: BlockingRecv error: recv got EOF from 127.12.148.65:48527 (error 108)
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":68,"threads_started":1}
Aug 08 04:40:50 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.66@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:50 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.66@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:50.962152 26661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:50.957202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.66:49655)
0808 04:40:50.957477 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:50.957491 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:50.957586 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:50.957845 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:50.957848 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:50.958038 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:50.958138 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:50.958143 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:50.958834 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:50.958836 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:50.959394 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:50.959401 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:50.959756 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:50.959758 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:50.959812 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:50.960254 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:50.960264 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:50.962038 (+ 1774us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":79,"threads_started":1}
W20260808 04:40:50.962285 26660 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:50.957271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:49655 (local address 127.12.148.126:46689)
0808 04:40:50.957396 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:50.957399 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:50.957551 (+ 152us) server_negotiation.cc:407] Connection header received
0808 04:40:50.957675 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:50.957677 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:50.957731 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:50.957813 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:50.958233 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:50.958756 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:50.959479 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:50.959680 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:50.959744 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:50.962168 (+ 2424us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.66:49655: BlockingRecv error: recv got EOF from 127.12.148.66:49655 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 08 04:40:51 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.67@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:51 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.67@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:51.160535 26662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:51.155538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.67:60627)
0808 04:40:51.155796 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:51.155809 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:51.155914 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:51.156120 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:51.156122 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:51.156301 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:51.156413 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:51.156418 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:51.157110 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:51.157112 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:51.157698 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:51.157707 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:51.158091 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:51.158093 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:51.158153 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:51.158617 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:51.158629 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:51.160419 (+ 1790us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":74,"threads_started":1}
W20260808 04:40:51.160765 26660 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:51.155664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:60627 (local address 127.12.148.126:46689)
0808 04:40:51.155781 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:51.155784 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:51.155873 (+ 89us) server_negotiation.cc:407] Connection header received
0808 04:40:51.155985 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:51.155987 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:51.156031 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:51.156097 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:51.156495 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:51.157030 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:51.157787 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:51.158007 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:51.158109 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:51.160558 (+ 2449us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.67:60627: BlockingRecv error: recv got EOF from 127.12.148.67:60627 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 08 04:40:51 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.65@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:51 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.65@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:51.780341 26664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:51.775352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.65:34355)
0808 04:40:51.775640 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:51.775653 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:51.775740 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:51.775957 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:51.775959 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:51.776143 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:51.776241 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:51.776247 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:51.776919 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:51.776921 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:51.777505 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:51.777513 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:51.777889 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:51.777892 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:51.777959 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:51.778414 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:51.778425 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:51.780206 (+ 1781us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":97,"threads_started":1}
W20260808 04:40:51.780478 26665 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:51.775436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:34355 (local address 127.12.148.126:46689)
0808 04:40:51.775719 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:51.775722 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:51.775735 (+ 13us) server_negotiation.cc:407] Connection header received
0808 04:40:51.775817 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:51.775819 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:51.775861 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:51.775933 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:51.776326 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:51.776841 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:51.777586 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:51.777810 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:51.777872 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:51.780342 (+ 2470us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.65:34355: BlockingRecv error: recv got EOF from 127.12.148.65:34355 (error 108)
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":95,"threads_started":1}
Aug 08 04:40:51 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.66@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:51 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.66@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:51.968114 26668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:51.962825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.66:33557)
0808 04:40:51.963100 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:51.963113 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:51.963220 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:51.963467 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:51.963470 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:51.963699 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:51.963823 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:51.963832 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:51.964750 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:51.964753 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:51.965313 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:51.965331 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:51.965719 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:51.965722 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:51.965789 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:51.966254 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:51.966264 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:51.967990 (+ 1726us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":85,"threads_started":1}
W20260808 04:40:51.968233 26665 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:51.962899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:33557 (local address 127.12.148.126:46689)
0808 04:40:51.963042 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:51.963047 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:51.963181 (+ 134us) server_negotiation.cc:407] Connection header received
0808 04:40:51.963309 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:51.963312 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:51.963360 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:51.963427 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:51.963969 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:51.964645 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:51.965410 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:51.965614 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:51.965696 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:51.968118 (+ 2422us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.66:33557: BlockingRecv error: recv got EOF from 127.12.148.66:33557 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 08 04:40:52 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.67@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:52 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.67@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:52.166708 26669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:52.161248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.67:42185)
0808 04:40:52.161521 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:52.161535 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:52.161635 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:52.161958 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:52.161960 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:52.162142 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:52.162243 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:52.162248 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:52.163009 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:52.163011 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:52.163578 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:52.163585 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:52.163979 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:52.163981 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:52.164039 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:52.164497 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:52.164511 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:52.166573 (+ 2062us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":88,"threads_started":1}
W20260808 04:40:52.166843 26665 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:52.161319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:42185 (local address 127.12.148.126:46689)
0808 04:40:52.161456 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:52.161460 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:52.161599 (+ 139us) server_negotiation.cc:407] Connection header received
0808 04:40:52.161783 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:52.161786 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:52.161843 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:52.161924 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:52.162366 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:52.162922 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:52.163660 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:52.163892 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:52.163961 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:52.166732 (+ 2771us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.67:42185: BlockingRecv error: recv got EOF from 127.12.148.67:42185 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 08 04:40:52 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.65@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:52 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.65@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:52.789386 26670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:52.781179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.65:55691)
0808 04:40:52.781524 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:52.781539 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:52.781628 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:52.781981 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:52.781985 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:52.782213 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:52.782320 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:52.782327 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:52.783118 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:52.783123 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:52.783684 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:52.783692 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:52.784152 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:52.784156 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:52.784258 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:52.787375 (+ 3117us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:52.787389 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:52.789246 (+ 1857us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":104,"threads_started":1}
W20260808 04:40:52.789590 26671 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:52.781262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:55691 (local address 127.12.148.126:46689)
0808 04:40:52.781570 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:52.781574 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:52.781590 (+ 16us) server_negotiation.cc:407] Connection header received
0808 04:40:52.781759 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:52.781762 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:52.781822 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:52.781947 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:52.782450 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:52.783003 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:52.783806 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:52.784040 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:52.784137 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:52.789434 (+ 5297us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.65:55691: BlockingRecv error: recv got EOF from 127.12.148.65:55691 (error 108)
Metrics: {"server-negotiator.queue_time_us":231,"thread_start_us":121,"threads_started":1}
Aug 08 04:40:52 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.66@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:52 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.66@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:52.974059 26672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:52.968864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.66:57963)
0808 04:40:52.969139 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:52.969152 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:52.969250 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:52.969456 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:52.969458 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:52.969699 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:52.969822 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:52.969828 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:52.970595 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:52.970599 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:52.971185 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:52.971195 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:52.971620 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:52.971624 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:52.971716 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:52.972180 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:52.972190 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:52.973899 (+ 1709us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":106,"threads_started":1}
W20260808 04:40:52.974153 26671 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:52.968904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:57963 (local address 127.12.148.126:46689)
0808 04:40:52.969051 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:52.969056 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:52.969220 (+ 164us) server_negotiation.cc:407] Connection header received
0808 04:40:52.969313 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:52.969315 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:52.969358 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:52.969422 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:52.969954 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:52.970483 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:52.971299 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:52.971517 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:52.971605 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:52.974054 (+ 2449us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.66:57963: BlockingRecv error: recv got EOF from 127.12.148.66:57963 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 08 04:40:53 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.67@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:53 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.67@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:53.172926 26673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:53.167540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.67:45401)
0808 04:40:53.167803 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:53.167816 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:53.167915 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:53.168117 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:53.168119 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:53.168308 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:53.168409 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:53.168414 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:53.169257 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:53.169260 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:53.169952 (+ 692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:53.169964 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:53.170508 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:53.170511 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:53.170575 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:53.171063 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:53.171074 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:53.172802 (+ 1728us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":78,"threads_started":1}
W20260808 04:40:53.173036 26671 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:53.167600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:45401 (local address 127.12.148.126:46689)
0808 04:40:53.167720 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:53.167723 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:53.167876 (+ 153us) server_negotiation.cc:407] Connection header received
0808 04:40:53.167978 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:53.167980 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:53.168026 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:53.168089 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:53.168489 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:53.169120 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:53.170114 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:53.170405 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:53.170488 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:53.172928 (+ 2440us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.67:45401: BlockingRecv error: recv got EOF from 127.12.148.67:45401 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 08 04:40:53 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.65@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:53 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.65@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:53.795764 26675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:53.790174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.65:50033)
0808 04:40:53.790461 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:53.790476 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:53.790564 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:53.790831 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:53.790835 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:53.791037 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:53.791136 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:53.791141 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:53.791893 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:53.791896 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:53.792495 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:53.792504 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:53.792925 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:53.792929 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:53.793001 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:53.793483 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:53.793496 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:53.795612 (+ 2116us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":76,"threads_started":1}
W20260808 04:40:53.795877 26676 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:53.790234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:50033 (local address 127.12.148.126:46689)
0808 04:40:53.790521 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:53.790524 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:53.790538 (+ 14us) server_negotiation.cc:407] Connection header received
0808 04:40:53.790639 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:53.790641 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:53.790686 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:53.790758 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:53.791250 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:53.791790 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:53.792587 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:53.792807 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:53.792879 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:53.795761 (+ 2882us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.65:50033: BlockingRecv error: recv got EOF from 127.12.148.65:50033 (error 108)
Metrics: {"server-negotiator.queue_time_us":218,"thread_start_us":118,"threads_started":1}
Aug 08 04:40:53 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.66@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:53 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.66@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:53.980080 26680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:53.974896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.66:54345)
0808 04:40:53.975172 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:53.975185 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:53.975270 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:53.975500 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:53.975502 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:53.975690 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:53.975789 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:53.975794 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:53.976488 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:53.976490 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:53.977052 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:53.977060 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:53.977418 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:53.977420 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:53.977480 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:53.977970 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:53.977983 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:53.979963 (+ 1980us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":88,"threads_started":1}
W20260808 04:40:53.980188 26676 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:53.975077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:54345 (local address 127.12.148.126:46689)
0808 04:40:53.975206 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:53.975210 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:53.975225 (+ 15us) server_negotiation.cc:407] Connection header received
0808 04:40:53.975349 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:53.975351 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:53.975392 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:53.975475 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:53.975874 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:53.976404 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:53.977136 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:53.977342 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:53.977409 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:53.980089 (+ 2680us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.66:54345: BlockingRecv error: recv got EOF from 127.12.148.66:54345 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 08 04:40:54 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.67@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:54 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.67@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:54.178964 26681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:54.173711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.67:40881)
0808 04:40:54.173987 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:54.174000 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:54.174105 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:54.174361 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:54.174364 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:54.174571 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:54.174669 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:54.174675 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:54.175463 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:54.175467 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:54.176049 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:54.176059 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:54.176495 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:54.176499 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:54.176584 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:54.177038 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:54.177049 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:54.178811 (+ 1762us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":93,"threads_started":1}
W20260808 04:40:54.179106 26676 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:54.173756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:40881 (local address 127.12.148.126:46689)
0808 04:40:54.173893 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:54.173897 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:54.174067 (+ 170us) server_negotiation.cc:407] Connection header received
0808 04:40:54.174194 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:54.174197 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:54.174246 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:54.174310 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:54.174792 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:54.175339 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:54.176167 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:54.176392 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:54.176477 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:54.179001 (+ 2524us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.67:40881: BlockingRecv error: recv got EOF from 127.12.148.67:40881 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 08 04:40:54 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.65@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:54 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.65@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:54.801512 26682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:54.796539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.65:58843)
0808 04:40:54.796811 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:54.796825 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:54.796916 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:54.797134 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:54.797136 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:54.797321 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:54.797419 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:54.797425 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:54.798155 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:54.798157 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:54.798711 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:54.798718 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:54.799080 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:54.799082 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:54.799140 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:54.799602 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:54.799613 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:54.801387 (+ 1774us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":75,"threads_started":1}
W20260808 04:40:54.801697 26683 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:54.796620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:58843 (local address 127.12.148.126:46689)
0808 04:40:54.796885 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:54.796888 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:54.796902 (+ 14us) server_negotiation.cc:407] Connection header received
0808 04:40:54.796994 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:54.796996 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:54.797039 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:54.797110 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:54.797516 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:54.798078 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:54.798793 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:54.799006 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:54.799070 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:54.801535 (+ 2465us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.65:58843: BlockingRecv error: recv got EOF from 127.12.148.65:58843 (error 108)
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":105,"threads_started":1}
Aug 08 04:40:54 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.66@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:54 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.66@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:54.986024 26684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:54.980792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.66:37537)
0808 04:40:54.981047 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:54.981060 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:54.981155 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:54.981366 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:54.981368 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:54.981559 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:54.981685 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:54.981693 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:54.982384 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:54.982386 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:54.982964 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:54.982972 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:54.983351 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:54.983353 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:54.983410 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:54.983894 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:54.983904 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:54.985893 (+ 1989us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":77,"threads_started":1}
W20260808 04:40:54.986230 26683 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:54.980843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:37537 (local address 127.12.148.126:46689)
0808 04:40:54.981008 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:54.981013 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:54.981120 (+ 107us) server_negotiation.cc:407] Connection header received
0808 04:40:54.981230 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:54.981232 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:54.981276 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:54.981342 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:54.981779 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:54.982303 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:54.983045 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:54.983272 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:54.983342 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:54.986039 (+ 2697us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.66:37537: BlockingRecv error: recv got EOF from 127.12.148.66:37537 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 08 04:40:55 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.67@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:55 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.67@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:55.185298 26685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:55.179716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.67:60533)
0808 04:40:55.179975 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:55.179988 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:55.180090 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:55.180317 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:55.180319 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:55.180522 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:55.180622 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:55.180628 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:55.181330 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:55.181332 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:55.181957 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:55.181966 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:55.182406 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:55.182409 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:55.182481 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:55.183010 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:55.183025 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:55.185143 (+ 2118us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":76,"threads_started":1}
W20260808 04:40:55.185398 26683 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:55.179830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:60533 (local address 127.12.148.126:46689)
0808 04:40:55.179953 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:55.179957 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:55.180081 (+ 124us) server_negotiation.cc:407] Connection header received
0808 04:40:55.180161 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:55.180163 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:55.180213 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:55.180292 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:55.180711 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:55.181247 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:55.182062 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:55.182299 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:55.182390 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:55.185279 (+ 2889us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.67:60533: BlockingRecv error: recv got EOF from 127.12.148.67:60533 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 08 04:40:55 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.65@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:55 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.65@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:55.807473 26686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:55.802265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.65:43651)
0808 04:40:55.802592 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:55.802606 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:55.802697 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:55.802954 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:55.802956 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:55.803142 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:55.803241 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:55.803246 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:55.803962 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:55.803965 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:55.804539 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:55.804548 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:55.804929 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:55.804933 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:55.805002 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:55.805522 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:55.805534 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:55.807354 (+ 1820us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":87,"threads_started":1}
W20260808 04:40:55.807615 26689 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:55.802384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:43651 (local address 127.12.148.126:46689)
0808 04:40:55.802643 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:55.802646 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:55.802659 (+ 13us) server_negotiation.cc:407] Connection header received
0808 04:40:55.802808 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:55.802810 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:55.802853 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:55.802926 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:55.803325 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:55.803857 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:55.804624 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:55.804830 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:55.804894 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:55.807491 (+ 2597us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.65:43651: BlockingRecv error: recv got EOF from 127.12.148.65:43651 (error 108)
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":77,"threads_started":1}
Aug 08 04:40:55 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.66@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:55 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.66@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:55.992192 26690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:55.986681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.66:56849)
0808 04:40:55.987041 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:55.987054 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:55.987167 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:55.987416 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:55.987420 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:55.987627 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:55.987722 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:55.987729 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:55.988541 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:55.988544 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:55.989132 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:55.989144 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:55.989574 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:55.989576 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:55.989645 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:55.990116 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:55.990127 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:55.992066 (+ 1939us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":110,"threads_started":1}
W20260808 04:40:55.992395 26689 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:55.986795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:56849 (local address 127.12.148.126:46689)
0808 04:40:55.986968 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:55.986973 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:55.987123 (+ 150us) server_negotiation.cc:407] Connection header received
0808 04:40:55.987255 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:55.987258 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:55.987307 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:55.987381 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:55.987834 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:55.988436 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:55.989228 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:55.989464 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:55.989573 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:55.992250 (+ 2677us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.66:56849: BlockingRecv error: recv got EOF from 127.12.148.66:56849 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 08 04:40:56 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.67@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:56 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.67@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:56.192200 26691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:56.186121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.67:37637)
0808 04:40:56.186566 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:56.186579 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:56.186684 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:56.186938 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:56.186941 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:56.187159 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:56.187266 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:56.187272 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:56.188054 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:56.188058 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:56.188640 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:56.188650 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:56.189129 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:56.189133 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:56.189219 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:56.189774 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:56.189790 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:56.192050 (+ 2260us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":107,"threads_started":1}
W20260808 04:40:56.192301 26689 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:56.186202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:37637 (local address 127.12.148.126:46689)
0808 04:40:56.186346 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:56.186351 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:56.186647 (+ 296us) server_negotiation.cc:407] Connection header received
0808 04:40:56.186787 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:56.186789 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:56.186836 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:56.186901 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:56.187378 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:56.187949 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:56.188771 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:56.189020 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:56.189101 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:56.192192 (+ 3091us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.67:37637: BlockingRecv error: recv got EOF from 127.12.148.67:37637 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 08 04:40:56 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.65@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:56 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.65@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:56.813536 26693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:56.808187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.65:57741)
0808 04:40:56.808478 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:56.808492 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:56.808586 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:56.808806 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:56.808808 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:56.809002 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:56.809105 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:56.809112 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:56.809846 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:56.809848 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:56.810415 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:56.810423 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:56.810901 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:56.810903 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:56.810961 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:56.811470 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:56.811482 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:56.813415 (+ 1933us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":80,"threads_started":1}
W20260808 04:40:56.813741 26694 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:56.808383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:57741 (local address 127.12.148.126:46689)
0808 04:40:56.808607 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:56.808611 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:56.808624 (+ 13us) server_negotiation.cc:407] Connection header received
0808 04:40:56.808663 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:56.808665 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:56.808708 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:56.808783 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:56.809201 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:56.809769 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:56.810551 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:56.810805 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:56.810899 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:56.813573 (+ 2674us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.65:57741: BlockingRecv error: recv got EOF from 127.12.148.65:57741 (error 108)
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":65,"threads_started":1}
Aug 08 04:40:56 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.66@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:56 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.66@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:56.998395 26695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:56.992840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.66:53665)
0808 04:40:56.993150 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:56.993163 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:56.993287 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:56.993527 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:56.993531 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:56.993760 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:56.993860 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:56.993867 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:56.994797 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:56.994800 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:56.995360 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:56.995369 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:56.995838 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:56.995842 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:56.995924 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:56.996382 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:56.996394 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:56.998271 (+ 1877us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":108,"threads_started":1}
W20260808 04:40:56.998548 26694 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:56.992908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:53665 (local address 127.12.148.126:46689)
0808 04:40:56.993082 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:56.993086 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:56.993235 (+ 149us) server_negotiation.cc:407] Connection header received
0808 04:40:56.993373 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:56.993376 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:56.993424 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:56.993488 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:56.993979 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:56.994681 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:56.995489 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:56.995730 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:56.995818 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:56.998427 (+ 2609us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.66:53665: BlockingRecv error: recv got EOF from 127.12.148.66:53665 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 08 04:40:57 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.67@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:57 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.67@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:57.201038 26697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:57.193142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.67:33455)
0808 04:40:57.193405 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:57.193417 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:57.193525 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:57.193739 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:57.193741 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:57.193938 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:57.194040 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:57.194046 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:57.194727 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:57.194730 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:57.195310 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:57.195319 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:57.195718 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:57.195721 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:57.195794 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:57.199094 (+ 3300us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:57.199106 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:57.200905 (+ 1799us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":88,"threads_started":1}
W20260808 04:40:57.201154 26694 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:57.193211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:33455 (local address 127.12.148.126:46689)
0808 04:40:57.193328 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:57.193332 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:57.193478 (+ 146us) server_negotiation.cc:407] Connection header received
0808 04:40:57.193588 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:57.193590 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:57.193635 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:57.193717 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:57.194128 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:57.194637 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:57.195403 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:57.195622 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:57.195696 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:57.201051 (+ 5355us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.67:33455: BlockingRecv error: recv got EOF from 127.12.148.67:33455 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 08 04:40:57 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.65@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:57 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.65@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:57.821727 26699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:57.814319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.65:49263)
0808 04:40:57.814581 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:57.814594 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:57.814681 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:57.814883 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:57.814885 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:57.815074 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:57.815167 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:57.815173 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:57.815865 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:57.815867 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:57.816425 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:57.816432 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:57.816822 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:57.816824 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:57.816886 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:57.819695 (+ 2809us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:57.819708 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:57.821546 (+ 1838us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":94,"threads_started":1}
W20260808 04:40:57.821861 26701 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:57.814397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:49263 (local address 127.12.148.126:46689)
0808 04:40:57.814626 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:57.814630 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:57.814642 (+ 12us) server_negotiation.cc:407] Connection header received
0808 04:40:57.814755 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:57.814757 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:57.814800 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:57.814872 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:57.815247 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:57.815790 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:57.816502 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:57.816713 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:57.816781 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:57.821738 (+ 4957us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.65:49263: BlockingRecv error: recv got EOF from 127.12.148.65:49263 (error 108)
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":65,"threads_started":1}
Aug 08 04:40:57 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.66@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:57 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.66@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:58.004263 26702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:57.999089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.66:33271)
0808 04:40:57.999357 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:57.999371 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:57.999485 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:57.999686 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:57.999688 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:57.999884 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:57.999983 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:57.999989 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:58.000680 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:58.000683 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:58.001224 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:58.001230 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:58.001645 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:58.001673 (+ 28us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:58.001751 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:58.002233 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:58.002245 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:58.004132 (+ 1887us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":80,"threads_started":1}
W20260808 04:40:58.004385 26701 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:57.999149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:33271 (local address 127.12.148.126:46689)
0808 04:40:57.999326 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:57.999330 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:57.999433 (+ 103us) server_negotiation.cc:407] Connection header received
0808 04:40:57.999557 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:57.999559 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:57.999606 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:57.999671 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:58.000067 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:58.000600 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:58.001331 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:58.001553 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:58.001631 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:58.004269 (+ 2638us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.66:33271: BlockingRecv error: recv got EOF from 127.12.148.66:33271 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 08 04:40:58 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.67@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:58 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.67@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:58.207123 26703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:58.201841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.67:59717)
0808 04:40:58.202142 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:58.202157 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:58.202275 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:58.202533 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:58.202536 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:58.202738 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:58.202833 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:58.202839 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:58.203595 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:58.203599 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:58.204180 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:58.204188 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:58.204623 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:58.204627 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:58.204707 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:58.205145 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:58.205156 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:58.206975 (+ 1819us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":108,"threads_started":1}
W20260808 04:40:58.207216 26701 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:58.201911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:59717 (local address 127.12.148.126:46689)
0808 04:40:58.202051 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:58.202056 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:58.202235 (+ 179us) server_negotiation.cc:407] Connection header received
0808 04:40:58.202357 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:58.202360 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:58.202413 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:58.202488 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:58.202962 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:58.203488 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:58.204297 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:58.204522 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:58.204609 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:58.207117 (+ 2508us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.67:59717: BlockingRecv error: recv got EOF from 127.12.148.67:59717 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 08 04:40:58 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.65@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:58 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.65@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:58.828027 26704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:58.822714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.65:34403)
0808 04:40:58.823030 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:58.823044 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:58.823149 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:58.823371 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:58.823373 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:58.823557 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:58.823654 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:58.823659 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:58.824357 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:58.824359 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:58.824919 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:58.824926 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:58.825343 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:58.825346 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:58.825419 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:58.826039 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:58.826053 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:58.827837 (+ 1784us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":97,"threads_started":1}
W20260808 04:40:58.828121 26705 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:58.822849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:34403 (local address 127.12.148.126:46689)
0808 04:40:58.823085 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:58.823088 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:58.823103 (+ 15us) server_negotiation.cc:407] Connection header received
0808 04:40:58.823230 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:58.823232 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:58.823273 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:58.823345 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:58.823738 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:58.824278 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:58.825004 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:58.825219 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:58.825291 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:58.827997 (+ 2706us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.65:34403: BlockingRecv error: recv got EOF from 127.12.148.65:34403 (error 108)
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":76,"threads_started":1}
Aug 08 04:40:59 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.66@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:59 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.66@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:59.010586 26706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:59.005159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.66:55837)
0808 04:40:59.005440 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:59.005455 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:59.005546 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:59.005764 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:59.005766 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:59.005963 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:59.006061 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:59.006067 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:59.006837 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:59.006840 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:59.007450 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:59.007462 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:59.007889 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:59.007892 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:59.007966 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:59.008439 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:59.008453 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:59.010403 (+ 1950us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":88,"threads_started":1}
W20260808 04:40:59.010740 26705 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:59.005199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:55837 (local address 127.12.148.126:46689)
0808 04:40:59.005377 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:59.005382 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:59.005506 (+ 124us) server_negotiation.cc:407] Connection header received
0808 04:40:59.005620 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:59.005622 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:59.005684 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:59.005741 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:59.006151 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:59.006744 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:59.007564 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:59.007797 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:59.007879 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:59.010599 (+ 2720us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.66:55837: BlockingRecv error: recv got EOF from 127.12.148.66:55837 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 08 04:40:59 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.67@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:59 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.67@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:59.213253 26707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:59.207931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.67:46427)
0808 04:40:59.208226 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:59.208243 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:59.208354 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:59.208610 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:59.208613 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:59.208822 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:59.208919 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:59.208925 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:59.209701 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:59.209705 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:59.210264 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:59.210273 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:59.210710 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:59.210713 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:59.210795 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:59.211272 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:59.211283 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:59.213078 (+ 1795us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":106,"threads_started":1}
W20260808 04:40:59.213325 26705 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:59.208109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:46427 (local address 127.12.148.126:46689)
0808 04:40:59.208242 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:59.208247 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:59.208306 (+ 59us) server_negotiation.cc:407] Connection header received
0808 04:40:59.208447 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:59.208450 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:59.208500 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:59.208568 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:59.209041 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:59.209563 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:59.210374 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:59.210604 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:59.210693 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:59.213219 (+ 2526us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.67:46427: BlockingRecv error: recv got EOF from 127.12.148.67:46427 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 08 04:40:59 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.65@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:40:59 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.65@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:40:59.834698 26708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:40:59.828866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.65:38989)
0808 04:40:59.829178 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0808 04:40:59.829191 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:40:59.829294 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:40:59.829667 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:40:59.829670 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:40:59.829897 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:40:59.830038 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:59.830048 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:59.830975 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:59.830979 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:59.831623 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:40:59.831635 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:40:59.832095 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:40:59.832098 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:40:59.832158 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:59.832623 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:40:59.832634 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:40:59.834528 (+ 1894us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":111,"threads_started":1}
W20260808 04:40:59.834915 26709 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:40:59.828924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:38989 (local address 127.12.148.126:46689)
0808 04:40:59.829187 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0808 04:40:59.829191 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:40:59.829258 (+ 67us) server_negotiation.cc:407] Connection header received
0808 04:40:59.829485 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:40:59.829488 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:40:59.829539 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:40:59.829621 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:40:59.830200 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:59.830860 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:59.831741 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:40:59.831992 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:40:59.832078 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:40:59.834677 (+ 2599us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.65:38989: BlockingRecv error: recv got EOF from 127.12.148.65:38989 (error 108)
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":66,"threads_started":1}
Aug 08 04:41:00 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.66@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:41:00 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.66@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:41:00.016938 26710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:00.011507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.66:41161)
0808 04:41:00.011777 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:00.011790 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:00.011920 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:00.012140 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:00.012142 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:00.012324 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:00.012424 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:00.012430 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:00.013128 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:00.013130 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:00.013739 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:00.013749 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:00.014121 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:00.014123 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:00.014180 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:00.014726 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:41:00.014741 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:00.016763 (+ 2022us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":90,"threads_started":1}
W20260808 04:41:00.017012 26709 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:41:00.011601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:41161 (local address 127.12.148.126:46689)
0808 04:41:00.011733 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:00.011736 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:00.011881 (+ 145us) server_negotiation.cc:407] Connection header received
0808 04:41:00.011995 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:00.011997 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:00.012043 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:00.012114 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:00.012513 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:00.013031 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:00.013828 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:00.014038 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:00.014108 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:00.016909 (+ 2801us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.66:41161: BlockingRecv error: recv got EOF from 127.12.148.66:41161 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 08 04:41:00 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.67@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:41:00 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.67@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:41:00.219702 26711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:00.214127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.67:59999)
0808 04:41:00.214425 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:00.214438 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:00.214559 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:00.214813 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:00.214816 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:00.215038 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:00.215142 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:00.215149 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:00.215922 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:00.215925 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:00.216498 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:00.216508 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:00.216963 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:00.216967 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:00.217056 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:00.217567 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:41:00.217578 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:00.219543 (+ 1965us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":119,"threads_started":1}
W20260808 04:41:00.219820 26709 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:41:00.214212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:59999 (local address 127.12.148.126:46689)
0808 04:41:00.214345 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:00.214349 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:00.214515 (+ 166us) server_negotiation.cc:407] Connection header received
0808 04:41:00.214659 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:00.214662 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:00.214708 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:00.214775 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:00.215267 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:00.215811 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:00.216621 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:00.216847 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:00.216937 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:00.219713 (+ 2776us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.67:59999: BlockingRecv error: recv got EOF from 127.12.148.67:59999 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 08 04:41:00 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.65@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:41:00 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.65@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:41:00.840866 26712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:00.835541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.65:53739)
0808 04:41:00.835853 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:00.835868 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:00.835969 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:00.836242 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:00.836244 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:00.836487 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:00.836620 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:00.836629 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:00.837393 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:00.837395 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:00.838010 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:00.838019 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:00.838391 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:00.838394 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:00.838451 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:00.838941 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:41:00.838954 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:00.840737 (+ 1783us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":96,"threads_started":1}
W20260808 04:41:00.841022 26715 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:41:00.835607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:53739 (local address 127.12.148.126:46689)
0808 04:41:00.835847 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:00.835851 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:00.835940 (+ 89us) server_negotiation.cc:407] Connection header received
0808 04:41:00.836055 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:00.836058 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:00.836104 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:00.836199 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:00.836739 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:00.837302 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:00.838099 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:00.838314 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:00.838391 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:00.840879 (+ 2488us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.65:53739: BlockingRecv error: recv got EOF from 127.12.148.65:53739 (error 108)
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":82,"threads_started":1}
Aug 08 04:41:01 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.66@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:41:01 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.66@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:41:01.023581 26717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:01.017848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.66:52641)
0808 04:41:01.018134 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:01.018147 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:01.018254 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:01.018518 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:01.018521 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:01.018711 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:01.018813 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:01.018819 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:01.019768 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:01.019772 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:01.020423 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:01.020437 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:01.020965 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:01.020968 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:01.021033 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:01.021558 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:41:01.021570 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:01.023460 (+ 1890us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":84,"threads_started":1}
W20260808 04:41:01.023761 26715 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:41:01.017976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:52641 (local address 127.12.148.126:46689)
0808 04:41:01.018112 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:01.018115 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:01.018212 (+ 97us) server_negotiation.cc:407] Connection header received
0808 04:41:01.018328 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:01.018330 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:01.018379 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:01.018469 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:01.018932 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:01.019605 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:01.020545 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:01.020840 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:01.020939 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:01.023641 (+ 2702us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.66:52641: BlockingRecv error: recv got EOF from 127.12.148.66:52641 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 08 04:41:01 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.67@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:41:01 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.67@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:41:01.225819 26718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:01.220576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.67:58381)
0808 04:41:01.220839 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:01.220852 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:01.220950 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:01.221159 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:01.221161 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:01.221346 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:01.221459 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:01.221465 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:01.222209 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:01.222211 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:01.222788 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:01.222797 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:01.223230 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:01.223232 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:01.223289 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:01.223791 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:41:01.223803 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:01.225694 (+ 1891us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":104,"threads_started":1}
W20260808 04:41:01.225981 26715 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:41:01.220647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:58381 (local address 127.12.148.126:46689)
0808 04:41:01.220784 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:01.220789 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:01.220913 (+ 124us) server_negotiation.cc:407] Connection header received
0808 04:41:01.221027 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:01.221029 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:01.221076 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:01.221132 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:01.221543 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:01.222114 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:01.222913 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:01.223139 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:01.223227 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:01.225865 (+ 2638us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.67:58381: BlockingRecv error: recv got EOF from 127.12.148.67:58381 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 08 04:41:01 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.65@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:41:01 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.65@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:41:01.847262 26719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:01.841618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.65:53647)
0808 04:41:01.841957 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:01.841971 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:01.842063 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:01.842286 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:01.842288 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:01.842493 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:01.842589 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:01.842595 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:01.843459 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:01.843462 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:01.844029 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:01.844038 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:01.844551 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:01.844554 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:01.844627 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:01.845166 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:41:01.845179 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:01.847135 (+ 1956us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":91,"threads_started":1}
W20260808 04:41:01.847481 26720 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:41:01.841732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:53647 (local address 127.12.148.126:46689)
0808 04:41:01.841992 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:01.841995 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:01.842011 (+ 16us) server_negotiation.cc:407] Connection header received
0808 04:41:01.842140 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:01.842143 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:01.842186 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:01.842262 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:01.842677 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:01.843309 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:01.844162 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:01.844414 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:01.844500 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:01.847308 (+ 2808us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.65:53647: BlockingRecv error: recv got EOF from 127.12.148.65:53647 (error 108)
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":85,"threads_started":1}
Aug 08 04:41:02 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.66@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:41:02 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.66@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:41:02.030036 26721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:02.024526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.66:57381)
0808 04:41:02.024821 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:02.024834 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:02.024971 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:02.025204 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:02.025206 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:02.025400 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:02.025501 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:02.025507 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:02.026282 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:02.026286 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:02.027035 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:02.027048 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:02.027589 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:02.027593 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:02.027663 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:02.028154 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:41:02.028166 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:02.029921 (+ 1755us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":79,"threads_started":1}
W20260808 04:41:02.030203 26720 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:41:02.024695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:57381 (local address 127.12.148.126:46689)
0808 04:41:02.024827 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:02.024830 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:02.024930 (+ 100us) server_negotiation.cc:407] Connection header received
0808 04:41:02.025046 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:02.025048 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:02.025096 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:02.025169 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:02.025593 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:02.026165 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:02.027167 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:02.027470 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:02.027573 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:02.030084 (+ 2511us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.66:57381: BlockingRecv error: recv got EOF from 127.12.148.66:57381 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 08 04:41:02 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.67@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:41:02 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.67@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:41:02.231817 26722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:02.226652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.67:49727)
0808 04:41:02.226960 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:02.226973 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:02.227074 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:02.227288 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:02.227290 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:02.227490 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:02.227590 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:02.227595 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:02.228278 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:02.228280 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:02.228842 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:02.228850 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:02.229249 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:02.229253 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:02.229323 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:02.229841 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:41:02.229856 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:02.231693 (+ 1837us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":88,"threads_started":1}
W20260808 04:41:02.231957 26720 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:41:02.226742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:49727 (local address 127.12.148.126:46689)
0808 04:41:02.226867 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:02.226871 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:02.227036 (+ 165us) server_negotiation.cc:407] Connection header received
0808 04:41:02.227144 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:02.227146 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:02.227192 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:02.227257 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:02.227676 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:02.228199 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:02.228923 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:02.229138 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:02.229204 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:02.231830 (+ 2626us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.67:49727: BlockingRecv error: recv got EOF from 127.12.148.67:49727 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 08 04:41:02 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.65@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:41:02 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.65@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:41:02.857409 26723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:02.847986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.65:35451)
0808 04:41:02.848286 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:02.848302 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:02.848411 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:02.848713 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:02.848716 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:02.848939 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:02.849045 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:02.849050 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:02.849876 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:02.849879 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:02.850435 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:02.850443 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:02.850841 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:02.850843 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:02.850902 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:02.855301 (+ 4399us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:41:02.855315 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:02.857246 (+ 1931us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":93,"threads_started":1}
W20260808 04:41:02.857547 26726 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:41:02.848073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:35451 (local address 127.12.148.126:46689)
0808 04:41:02.848423 (+ 350us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:02.848427 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:02.848476 (+ 49us) server_negotiation.cc:407] Connection header received
0808 04:41:02.848513 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:02.848515 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:02.848558 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:02.848623 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:02.849151 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:02.849746 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:02.850520 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:02.850736 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:02.850821 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:02.857427 (+ 6606us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.65:35451: BlockingRecv error: recv got EOF from 127.12.148.65:35451 (error 108)
Metrics: {"server-negotiator.queue_time_us":276,"thread_start_us":72,"threads_started":1}
Aug 08 04:41:03 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.66@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:41:03 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.66@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:41:03.036208 26727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:03.030869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.66:48759)
0808 04:41:03.031160 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:03.031173 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:03.031276 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:03.031536 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:03.031539 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:03.031745 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:03.031876 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:03.031886 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:03.032735 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:03.032738 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:03.033300 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:03.033309 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:03.033719 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:03.033723 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:03.033793 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:03.034294 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:41:03.034306 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:03.036082 (+ 1776us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":105,"threads_started":1}
W20260808 04:41:03.036324 26726 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:41:03.030992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:48759 (local address 127.12.148.126:46689)
0808 04:41:03.031128 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:03.031133 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:03.031252 (+ 119us) server_negotiation.cc:407] Connection header received
0808 04:41:03.031360 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:03.031362 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:03.031408 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:03.031492 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:03.032009 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:03.032631 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:03.033393 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:03.033605 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:03.033697 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:03.036222 (+ 2525us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.66:48759: BlockingRecv error: recv got EOF from 127.12.148.66:48759 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 08 04:41:03 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.67@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:41:03 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.67@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:41:03.237716 26728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:03.232541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.67:59053)
0808 04:41:03.232825 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:03.232839 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:03.232939 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:03.233162 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:03.233164 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:03.233355 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:03.233472 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:03.233478 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:03.234210 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:03.234212 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:03.234772 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:03.234779 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:03.235209 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:03.235212 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:03.235271 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:03.235795 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:41:03.235809 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:03.237557 (+ 1748us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":96,"threads_started":1}
W20260808 04:41:03.237843 26726 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:41:03.232657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:59053 (local address 127.12.148.126:46689)
0808 04:41:03.232790 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:03.232794 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:03.232903 (+ 109us) server_negotiation.cc:407] Connection header received
0808 04:41:03.233011 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:03.233013 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:03.233065 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:03.233135 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:03.233561 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:03.234129 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:03.234895 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:03.235123 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:03.235200 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:03.237725 (+ 2525us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.67:59053: BlockingRecv error: recv got EOF from 127.12.148.67:59053 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 08 04:41:03 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.65@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:41:03 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.65@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:41:03.863503 26729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:03.858424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.65:38407)
0808 04:41:03.858700 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:03.858714 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:03.858801 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:03.859054 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:03.859056 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:03.859244 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:03.859339 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:03.859345 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:03.860059 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:03.860061 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:03.860617 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:03.860624 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:03.861035 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:03.861038 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:03.861106 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:03.861580 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:41:03.861591 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:03.863366 (+ 1775us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":87,"threads_started":1}
W20260808 04:41:03.863651 26730 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:41:03.858534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:38407 (local address 127.12.148.126:46689)
0808 04:41:03.858766 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:03.858769 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:03.858784 (+ 15us) server_negotiation.cc:407] Connection header received
0808 04:41:03.858907 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:03.858910 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:03.858955 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:03.859031 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:03.859429 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:03.859978 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:03.860698 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:03.860932 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:03.861001 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:03.863514 (+ 2513us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.65:38407: BlockingRecv error: recv got EOF from 127.12.148.65:38407 (error 108)
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":58,"threads_started":1}
Aug 08 04:41:04 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.66@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 04:41:04 dist-test-slave-t7g5 krb5kdc[25193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.148.66@KRBTEST.COM for oryx/127.12.148.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 04:41:04.043193 26731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:04.037113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46689 (local address 127.12.148.66:46697)
0808 04:41:04.037407 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:04.037423 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:04.037541 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:04.037819 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:04.037822 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:04.038039 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:04.038139 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:04.038145 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:04.038905 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:04.038909 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:04.039490 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:04.039499 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:04.040065 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:04.040068 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:04.040149 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:04.040700 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:41:04.040716 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:04.043043 (+ 2327us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.148.126:46689: Server oryx/127.12.148.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":92,"threads_started":1}
W20260808 04:41:04.043304 26730 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:41:04.037259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:46697 (local address 127.12.148.126:46689)
0808 04:41:04.037409 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:04.037414 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:04.037504 (+ 90us) server_negotiation.cc:407] Connection header received
0808 04:41:04.037630 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:04.037633 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:04.037706 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:04.037774 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:04.038263 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:04.038795 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:04.039609 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:04.039836 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:04.039921 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:04.043197 (+ 3276us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.148.66:46697: BlockingRecv error: recv got EOF from 127.12.148.66:46697 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 04:41:04.142760 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 26044
I20260808 04:41:04.156299 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 26270
I20260808 04:41:04.166718 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 26461
I20260808 04:41:04.174891 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 25952
2026-08-08T04:41:04Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18122 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-08T04:41:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:41:04Z Disabled control of system clock
I20260808 04:41:04.215462 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:44971
--webserver_interface=127.12.148.126
--webserver_port=0
--builtin_ntp_servers=127.12.148.84:41869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:44971
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 04:41:04.327548 26736 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:41:04.327821 26736 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:41:04.327853 26736 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:41:04.331805 26736 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:41:04.331871 26736 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:41:04.331884 26736 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:41:04.331900 26736 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:41:04.331918 26736 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:41:04.336639 26736 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:41869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:44971
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:44971
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26736
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:41:04.337749 26736 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:41:04.339139 26736 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:41:04.347950 26742 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:04.348016 26744 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:04.347963 26741 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:41:04.348034 26736 server_base.cc:1034] running on GCE node
I20260808 04:41:04.348810 26736 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:41:04.349964 26736 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:41:04.351111 26736 hybrid_clock.cc:648] HybridClock initialized: now 1786164064351089 us; error 36 us; skew 500 ppm
I20260808 04:41:04.353003 26736 webserver.cc:460] Webserver started at http://127.12.148.126:46337/ using document root <none> and password file <none>
I20260808 04:41:04.353582 26736 fs_manager.cc:359] Metadata directory not provided
I20260808 04:41:04.353667 26736 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:41:04.353895 26736 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:41:04.356000 26736 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "af5888829818494ea4c870581d18e357"
format_stamp: "Formatted at 2026-08-08 04:41:04 on dist-test-slave-t7g5"
server_key: "7008a3a41bce5d3d34e849decfa02229"
server_key_iv: "d6f606eca0230ffb8e87e0cbd246a405"
server_key_version: "encryptionkey@0"
I20260808 04:41:04.356567 26736 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "af5888829818494ea4c870581d18e357"
format_stamp: "Formatted at 2026-08-08 04:41:04 on dist-test-slave-t7g5"
server_key: "7008a3a41bce5d3d34e849decfa02229"
server_key_iv: "d6f606eca0230ffb8e87e0cbd246a405"
server_key_version: "encryptionkey@0"
I20260808 04:41:04.360270 26736 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260808 04:41:04.362759 26750 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:04.364104 26736 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20260808 04:41:04.364229 26736 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "af5888829818494ea4c870581d18e357"
format_stamp: "Formatted at 2026-08-08 04:41:04 on dist-test-slave-t7g5"
server_key: "7008a3a41bce5d3d34e849decfa02229"
server_key_iv: "d6f606eca0230ffb8e87e0cbd246a405"
server_key_version: "encryptionkey@0"
I20260808 04:41:04.364347 26736 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:41:04.374926 26736 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:41:04.375574 26736 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:41:04.375751 26736 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:41:04.382148 26736 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:44971
I20260808 04:41:04.382157 26827 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:44971 every 8 connection(s)
I20260808 04:41:04.383057 26736 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:41:04.386226 26831 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:41:04.391165 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 26736
I20260808 04:41:04.391328 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:41:04.391610 12881 external_mini_cluster.cc:1428] Setting key 5a22898e31e477171ec263f4e58a0803
I20260808 04:41:04.391731 26831 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af5888829818494ea4c870581d18e357: Bootstrap starting.
I20260808 04:41:04.394407 26831 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P af5888829818494ea4c870581d18e357: Neither blocks nor log segments found. Creating new log.
I20260808 04:41:04.395172 26831 log.cc:824] T 00000000000000000000000000000000 P af5888829818494ea4c870581d18e357: Log is configured to *not* fsync() on all Append() calls
I20260808 04:41:04.397084 26831 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af5888829818494ea4c870581d18e357: No bootstrap required, opened a new log
I20260808 04:41:04.400668 26834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:04.392911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59408 (local address 127.12.148.126:44971)
0808 04:41:04.393557 (+ 646us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:04.393571 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:04.393604 (+ 33us) server_negotiation.cc:407] Connection header received
0808 04:41:04.394272 (+ 668us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:04.394288 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:04.394710 (+ 422us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:04.395022 (+ 312us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:04.395459 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:04.396587 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:04.397535 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:04.398048 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:04.398195 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:04.399036 (+ 841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:41:04.399042 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:41:04.399054 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:41:04.399424 (+ 370us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:41:04.399479 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:41:04.399499 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:41:04.399584 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:04.399725 (+ 141us) server_negotiation.cc:299] Negotiation successful
0808 04:41:04.399976 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":276,"thread_start_us":131,"threads_started":1}
I20260808 04:41:04.401021 26831 raft_consensus.cc:348] T 00000000000000000000000000000000 P af5888829818494ea4c870581d18e357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af5888829818494ea4c870581d18e357" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 44971 } }
I20260808 04:41:04.401257 26831 raft_consensus.cc:374] T 00000000000000000000000000000000 P af5888829818494ea4c870581d18e357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:41:04.401311 26831 raft_consensus.cc:729] T 00000000000000000000000000000000 P af5888829818494ea4c870581d18e357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af5888829818494ea4c870581d18e357, State: Initialized, Role: FOLLOWER
I20260808 04:41:04.401835 26831 consensus_queue.cc:260] T 00000000000000000000000000000000 P af5888829818494ea4c870581d18e357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af5888829818494ea4c870581d18e357" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 44971 } }
I20260808 04:41:04.401988 26831 raft_consensus.cc:388] T 00000000000000000000000000000000 P af5888829818494ea4c870581d18e357 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:41:04.402055 26831 raft_consensus.cc:482] T 00000000000000000000000000000000 P af5888829818494ea4c870581d18e357 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:41:04.402156 26831 raft_consensus.cc:3037] T 00000000000000000000000000000000 P af5888829818494ea4c870581d18e357 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:41:04.403128 26831 raft_consensus.cc:504] T 00000000000000000000000000000000 P af5888829818494ea4c870581d18e357 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af5888829818494ea4c870581d18e357" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 44971 } }
I20260808 04:41:04.403450 26831 leader_election.cc:302] T 00000000000000000000000000000000 P af5888829818494ea4c870581d18e357 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: af5888829818494ea4c870581d18e357; no voters:
I20260808 04:41:04.403744 26831 leader_election.cc:288] T 00000000000000000000000000000000 P af5888829818494ea4c870581d18e357 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:41:04.403846 26836 raft_consensus.cc:2781] T 00000000000000000000000000000000 P af5888829818494ea4c870581d18e357 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:41:04.404073 26836 raft_consensus.cc:686] T 00000000000000000000000000000000 P af5888829818494ea4c870581d18e357 [term 1 LEADER]: Becoming Leader. State: Replica: af5888829818494ea4c870581d18e357, State: Running, Role: LEADER
I20260808 04:41:04.404551 26836 consensus_queue.cc:237] T 00000000000000000000000000000000 P af5888829818494ea4c870581d18e357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af5888829818494ea4c870581d18e357" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 44971 } }
I20260808 04:41:04.405002 26831 sys_catalog.cc:564] T 00000000000000000000000000000000 P af5888829818494ea4c870581d18e357 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:41:04.406149 26840 sys_catalog.cc:455] T 00000000000000000000000000000000 P af5888829818494ea4c870581d18e357 [sys.catalog]: SysCatalogTable state changed. Reason: New leader af5888829818494ea4c870581d18e357. Latest consensus state: current_term: 1 leader_uuid: "af5888829818494ea4c870581d18e357" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af5888829818494ea4c870581d18e357" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 44971 } } }
I20260808 04:41:04.406296 26840 sys_catalog.cc:458] T 00000000000000000000000000000000 P af5888829818494ea4c870581d18e357 [sys.catalog]: This master's current role is: LEADER
I20260808 04:41:04.406527 26839 sys_catalog.cc:455] T 00000000000000000000000000000000 P af5888829818494ea4c870581d18e357 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "af5888829818494ea4c870581d18e357" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af5888829818494ea4c870581d18e357" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 44971 } } }
I20260808 04:41:04.406687 26839 sys_catalog.cc:458] T 00000000000000000000000000000000 P af5888829818494ea4c870581d18e357 [sys.catalog]: This master's current role is: LEADER
I20260808 04:41:04.406736 26849 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:41:04.409896 26849 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:41:04.415236 26849 catalog_manager.cc:1347] Generated new cluster ID: 3e8105180d3c4676b48588cf2bf6a450
I20260808 04:41:04.415310 26849 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:41:04.424031 26849 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:41:04.425140 26849 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:41:04.435947 26849 catalog_manager.cc:5868] T 00000000000000000000000000000000 P af5888829818494ea4c870581d18e357: Generated new TSK 0
I20260808 04:41:04.436674 26849 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:41:04.443051 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.65:0
--local_ip_for_outbound_sockets=127.12.148.65
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:44971
--builtin_ntp_servers=127.12.148.84:41869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260808 04:41:04.557838 26862 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:41:04.558092 26862 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:41:04.558131 26862 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:41:04.562191 26862 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:41:04.562254 26862 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:41:04.562328 26862 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.65
I20260808 04:41:04.567147 26862 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:41869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:44971
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26862
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.65
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:41:04.568172 26862 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:41:04.569516 26862 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:41:04.578740 26878 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:04.578768 26880 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:04.578733 26875 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:41:04.578846 26862 server_base.cc:1034] running on GCE node
I20260808 04:41:04.579332 26862 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:41:04.579982 26862 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:41:04.581139 26862 hybrid_clock.cc:648] HybridClock initialized: now 1786164064581121 us; error 30 us; skew 500 ppm
I20260808 04:41:04.582933 26862 webserver.cc:460] Webserver started at http://127.12.148.65:36253/ using document root <none> and password file <none>
I20260808 04:41:04.583475 26862 fs_manager.cc:359] Metadata directory not provided
I20260808 04:41:04.583544 26862 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:41:04.583741 26862 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:41:04.585767 26862 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/data/instance:
uuid: "15d41ffa0e474cac847af84992285211"
format_stamp: "Formatted at 2026-08-08 04:41:04 on dist-test-slave-t7g5"
server_key: "08b438d4c3239fe1efd4008dd88e391a"
server_key_iv: "251aa57d58f7e00c5f3dd8e2b9e82164"
server_key_version: "encryptionkey@0"
I20260808 04:41:04.586306 26862 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance:
uuid: "15d41ffa0e474cac847af84992285211"
format_stamp: "Formatted at 2026-08-08 04:41:04 on dist-test-slave-t7g5"
server_key: "08b438d4c3239fe1efd4008dd88e391a"
server_key_iv: "251aa57d58f7e00c5f3dd8e2b9e82164"
server_key_version: "encryptionkey@0"
I20260808 04:41:04.589896 26862 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 04:41:04.592345 26888 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:04.593568 26862 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:41:04.593713 26862 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/wal
uuid: "15d41ffa0e474cac847af84992285211"
format_stamp: "Formatted at 2026-08-08 04:41:04 on dist-test-slave-t7g5"
server_key: "08b438d4c3239fe1efd4008dd88e391a"
server_key_iv: "251aa57d58f7e00c5f3dd8e2b9e82164"
server_key_version: "encryptionkey@0"
I20260808 04:41:04.593832 26862 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:41:04.613464 26862 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:41:04.614267 26862 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:41:04.614460 26862 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:41:04.615099 26862 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:41:04.616117 26862 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:41:04.616169 26862 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:04.616226 26862 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:41:04.616256 26862 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:04.624856 26862 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.65:44729
I20260808 04:41:04.624898 27037 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.65:44729 every 8 connection(s)
I20260808 04:41:04.625854 26862 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
I20260808 04:41:04.630667 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 26862
I20260808 04:41:04.630792 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance
I20260808 04:41:04.631101 12881 external_mini_cluster.cc:1428] Setting key 229e12fee909b5cbc5fe2aa7f2a41330
I20260808 04:41:04.633239 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.66:0
--local_ip_for_outbound_sockets=127.12.148.66
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:44971
--builtin_ntp_servers=127.12.148.84:41869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 04:41:04.635860 26834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:04.627707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:45161 (local address 127.12.148.126:44971)
0808 04:41:04.627838 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:04.627841 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:04.628938 (+ 1097us) server_negotiation.cc:407] Connection header received
0808 04:41:04.630300 (+ 1362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:04.630302 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:04.630349 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:04.630421 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:04.631625 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:04.632319 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:04.633882 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:04.634117 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:04.634202 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:04.635373 (+ 1171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:41:04.635377 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:41:04.635380 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:41:04.635394 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:41:04.635419 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:41:04.635429 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:41:04.635520 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:04.635642 (+ 122us) server_negotiation.cc:299] Negotiation successful
0808 04:41:04.635706 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 04:41:04.636687 27041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:04.628103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:44971 (local address 127.12.148.65:45161)
0808 04:41:04.628784 (+ 681us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:04.628827 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:04.630111 (+ 1284us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:04.630621 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:04.630631 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:04.630757 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:04.631464 (+ 707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:04.631485 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:04.632431 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:04.632434 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:04.633767 (+ 1333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:04.633779 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:04.634269 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:04.634272 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:04.634467 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:04.635098 (+ 631us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:41:04.635100 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:04.635144 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:41:04.635209 (+ 65us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:41:04.635523 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:41:04.635528 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:41:04.635532 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 04:41:04.635622 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 04:41:04.635869 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":115,"threads_started":1}
I20260808 04:41:04.637915 27038 heartbeater.cc:347] Connected to a master server at 127.12.148.126:44971
I20260808 04:41:04.638203 27038 heartbeater.cc:464] Registering TS with master...
I20260808 04:41:04.638862 27038 heartbeater.cc:511] Master 127.12.148.126:44971 requested a full tablet report, sending...
I20260808 04:41:04.640487 26773 ts_manager.cc:194] Registered new tserver with Master: 15d41ffa0e474cac847af84992285211 (127.12.148.65:44729)
I20260808 04:41:04.641718 26773 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.148.65:45161
W20260808 04:41:04.750018 27042 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:41:04.750278 27042 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:41:04.750315 27042 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:41:04.754379 27042 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:41:04.754438 27042 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:41:04.754492 27042 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.66
I20260808 04:41:04.759321 27042 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:41869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:44971
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27042
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.66
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:41:04.760376 27042 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:41:04.761735 27042 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:41:04.771162 27049 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:04.771245 27054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:04.771204 27048 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:41:04.771497 27042 server_base.cc:1034] running on GCE node
I20260808 04:41:04.771911 27042 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:41:04.772567 27042 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:41:04.773732 27042 hybrid_clock.cc:648] HybridClock initialized: now 1786164064773711 us; error 28 us; skew 500 ppm
I20260808 04:41:04.775604 27042 webserver.cc:460] Webserver started at http://127.12.148.66:37253/ using document root <none> and password file <none>
I20260808 04:41:04.776175 27042 fs_manager.cc:359] Metadata directory not provided
I20260808 04:41:04.776260 27042 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:41:04.776485 27042 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:41:04.778614 27042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/data/instance:
uuid: "fc8fe045f57544999ac8eaa935b7771b"
format_stamp: "Formatted at 2026-08-08 04:41:04 on dist-test-slave-t7g5"
server_key: "99a277e954c0120106f2205c3048d74b"
server_key_iv: "dfec2f154d1fb7e496dd8d8e4b31f73f"
server_key_version: "encryptionkey@0"
I20260808 04:41:04.779179 27042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance:
uuid: "fc8fe045f57544999ac8eaa935b7771b"
format_stamp: "Formatted at 2026-08-08 04:41:04 on dist-test-slave-t7g5"
server_key: "99a277e954c0120106f2205c3048d74b"
server_key_iv: "dfec2f154d1fb7e496dd8d8e4b31f73f"
server_key_version: "encryptionkey@0"
I20260808 04:41:04.782976 27042 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 04:41:04.785434 27066 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:04.786607 27042 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:41:04.786732 27042 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/wal
uuid: "fc8fe045f57544999ac8eaa935b7771b"
format_stamp: "Formatted at 2026-08-08 04:41:04 on dist-test-slave-t7g5"
server_key: "99a277e954c0120106f2205c3048d74b"
server_key_iv: "dfec2f154d1fb7e496dd8d8e4b31f73f"
server_key_version: "encryptionkey@0"
I20260808 04:41:04.786854 27042 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:41:04.806394 27042 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:41:04.807126 27042 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:41:04.807304 27042 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:41:04.807881 27042 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:41:04.808848 27042 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:41:04.808897 27042 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:04.808940 27042 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:41:04.808969 27042 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:04.817193 27042 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.66:40507
I20260808 04:41:04.817241 27223 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.66:40507 every 8 connection(s)
I20260808 04:41:04.818122 27042 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
I20260808 04:41:04.821240 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 27042
I20260808 04:41:04.821349 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance
I20260808 04:41:04.821614 12881 external_mini_cluster.cc:1428] Setting key b3885dc37eea382b2cd80a761a62fd61
I20260808 04:41:04.823643 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.67:0
--local_ip_for_outbound_sockets=127.12.148.67
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:44971
--builtin_ntp_servers=127.12.148.84:41869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 04:41:04.827704 26834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:04.819984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:45241 (local address 127.12.148.126:44971)
0808 04:41:04.820126 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:04.820131 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:04.821188 (+ 1057us) server_negotiation.cc:407] Connection header received
0808 04:41:04.822719 (+ 1531us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:04.822722 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:04.822775 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:04.822847 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:04.824010 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:04.824538 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:04.825947 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:04.826163 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:04.826253 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:04.827255 (+ 1002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:41:04.827258 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:41:04.827260 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:41:04.827270 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:41:04.827290 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:41:04.827300 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:41:04.827360 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:04.827497 (+ 137us) server_negotiation.cc:299] Negotiation successful
0808 04:41:04.827560 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 04:41:04.828550 27226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:04.820377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:44971 (local address 127.12.148.66:45241)
0808 04:41:04.821042 (+ 665us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:04.821083 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:04.822512 (+ 1429us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:04.823042 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:04.823050 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:04.823152 (+ 102us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:04.823835 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:04.823857 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:04.824664 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:04.824668 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:04.825831 (+ 1163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:04.825841 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:04.826311 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:04.826316 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:04.826463 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:04.827011 (+ 548us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:41:04.827012 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:04.827054 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:41:04.827115 (+ 61us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:41:04.827370 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:41:04.827379 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:41:04.827386 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 04:41:04.827491 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 04:41:04.827760 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":110,"threads_started":1}
I20260808 04:41:04.829681 27224 heartbeater.cc:347] Connected to a master server at 127.12.148.126:44971
I20260808 04:41:04.829890 27224 heartbeater.cc:464] Registering TS with master...
I20260808 04:41:04.830368 27224 heartbeater.cc:511] Master 127.12.148.126:44971 requested a full tablet report, sending...
I20260808 04:41:04.831372 26773 ts_manager.cc:194] Registered new tserver with Master: fc8fe045f57544999ac8eaa935b7771b (127.12.148.66:40507)
I20260808 04:41:04.832139 26773 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.148.66:45241
W20260808 04:41:04.935299 27230 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:41:04.935575 27230 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:41:04.935611 27230 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:41:04.939584 27230 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:41:04.939640 27230 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:41:04.939690 27230 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.67
I20260808 04:41:04.944280 27230 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:41869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:44971
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27230
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.67
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:41:04.945241 27230 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:41:04.946602 27230 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:41:04.955953 27236 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:04.955937 27240 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:41:04.956015 27230 server_base.cc:1034] running on GCE node
W20260808 04:41:04.955960 27237 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:41:04.956554 27230 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:41:04.957154 27230 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:41:04.958318 27230 hybrid_clock.cc:648] HybridClock initialized: now 1786164064958289 us; error 38 us; skew 500 ppm
I20260808 04:41:04.960017 27230 webserver.cc:460] Webserver started at http://127.12.148.67:42779/ using document root <none> and password file <none>
I20260808 04:41:04.960579 27230 fs_manager.cc:359] Metadata directory not provided
I20260808 04:41:04.960649 27230 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:41:04.960836 27230 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:41:04.962859 27230 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/data/instance:
uuid: "4297e730352646bc96dade6c53a7c6e3"
format_stamp: "Formatted at 2026-08-08 04:41:04 on dist-test-slave-t7g5"
server_key: "bac30f6386b5348865622f78a59977b0"
server_key_iv: "d97f636a6931f1c29fd2a107767d5e8e"
server_key_version: "encryptionkey@0"
I20260808 04:41:04.963397 27230 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance:
uuid: "4297e730352646bc96dade6c53a7c6e3"
format_stamp: "Formatted at 2026-08-08 04:41:04 on dist-test-slave-t7g5"
server_key: "bac30f6386b5348865622f78a59977b0"
server_key_iv: "d97f636a6931f1c29fd2a107767d5e8e"
server_key_version: "encryptionkey@0"
I20260808 04:41:04.966956 27230 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 04:41:04.969504 27249 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:04.970765 27230 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:41:04.970875 27230 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/wal
uuid: "4297e730352646bc96dade6c53a7c6e3"
format_stamp: "Formatted at 2026-08-08 04:41:04 on dist-test-slave-t7g5"
server_key: "bac30f6386b5348865622f78a59977b0"
server_key_iv: "d97f636a6931f1c29fd2a107767d5e8e"
server_key_version: "encryptionkey@0"
I20260808 04:41:04.970976 27230 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:41:04.990675 27230 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:41:04.991421 27230 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:41:04.991575 27230 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:41:04.992111 27230 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:41:04.993010 27230 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:41:04.993058 27230 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:04.993098 27230 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:41:04.993117 27230 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:05.001645 27230 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.67:38221
I20260808 04:41:05.001713 27399 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.67:38221 every 8 connection(s)
I20260808 04:41:05.002586 27230 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
I20260808 04:41:05.011132 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 27230
I20260808 04:41:05.011255 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance
I20260808 04:41:05.011534 12881 external_mini_cluster.cc:1428] Setting key 90e92549ac9f1ea24f4805528fb35d9a
I20260808 04:41:05.012039 26834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:05.004392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:38363 (local address 127.12.148.126:44971)
0808 04:41:05.004520 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:05.004523 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:05.005699 (+ 1176us) server_negotiation.cc:407] Connection header received
0808 04:41:05.007206 (+ 1507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:05.007209 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:05.007256 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:05.007336 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:05.008315 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:05.008845 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:05.010105 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:05.010328 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:05.010407 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:05.011537 (+ 1130us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:41:05.011540 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:41:05.011542 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:41:05.011555 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:41:05.011576 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:41:05.011584 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:41:05.011644 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:05.011844 (+ 200us) server_negotiation.cc:299] Negotiation successful
0808 04:41:05.011904 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 04:41:05.013073 27402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:05.004803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:44971 (local address 127.12.148.67:38363)
0808 04:41:05.005548 (+ 745us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:05.005591 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:05.007018 (+ 1427us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:05.007509 (+ 491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:05.007516 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:05.007600 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:05.008176 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:05.008192 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:05.008994 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:05.008997 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:05.009976 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:05.009987 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:05.010449 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:05.010451 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:05.010594 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:05.011242 (+ 648us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:41:05.011244 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:05.011294 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:41:05.011386 (+ 92us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:41:05.011683 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:41:05.011694 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:41:05.011699 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 04:41:05.011799 (+ 100us) client_negotiation.cc:240] Negotiation successful
0808 04:41:05.012116 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":152,"threads_started":1}
I20260808 04:41:05.014183 27400 heartbeater.cc:347] Connected to a master server at 127.12.148.126:44971
I20260808 04:41:05.014411 27400 heartbeater.cc:464] Registering TS with master...
I20260808 04:41:05.014921 27400 heartbeater.cc:511] Master 127.12.148.126:44971 requested a full tablet report, sending...
I20260808 04:41:05.016034 26773 ts_manager.cc:194] Registered new tserver with Master: 4297e730352646bc96dade6c53a7c6e3 (127.12.148.67:38221)
I20260808 04:41:05.016589 26773 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.148.67:38363
I20260808 04:41:05.025489 12881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 04:41:05.028497 26834 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:41:05.027543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59412 (local address 127.12.148.126:44971)
0808 04:41:05.027660 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:05.027664 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:05.027897 (+ 233us) server_negotiation.cc:407] Connection header received
0808 04:41:05.027990 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:05.027992 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:05.028035 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:05.028101 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:05.028340 (+ 239us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59412: BlockingRecv error: recv got EOF from 127.0.0.1:59412 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 04:41:05.028724 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 26862
I20260808 04:41:05.048151 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 27042
I20260808 04:41:05.067764 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 27230
I20260808 04:41:05.081640 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 26736
2026-08-08T04:41:05Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (901 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-08T04:41:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:41:05Z Disabled control of system clock
I20260808 04:41:05.116432 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:44675
--webserver_interface=127.12.148.126
--webserver_port=0
--builtin_ntp_servers=127.12.148.84:35145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:44675
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 04:41:05.227264 27418 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:41:05.227535 27418 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:41:05.227569 27418 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:41:05.231504 27418 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:41:05.231559 27418 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:41:05.231572 27418 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:41:05.231587 27418 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:41:05.231601 27418 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:41:05.236213 27418 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:35145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:44675
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:44675
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27418
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:41:05.237212 27418 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:41:05.238664 27418 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:41:05.247390 27424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:05.247382 27425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:05.247381 27427 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:41:05.247430 27418 server_base.cc:1034] running on GCE node
I20260808 04:41:05.248104 27418 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:41:05.249142 27418 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:41:05.250294 27418 hybrid_clock.cc:648] HybridClock initialized: now 1786164065250277 us; error 28 us; skew 500 ppm
I20260808 04:41:05.252072 27418 webserver.cc:460] Webserver started at http://127.12.148.126:33501/ using document root <none> and password file <none>
I20260808 04:41:05.252624 27418 fs_manager.cc:359] Metadata directory not provided
I20260808 04:41:05.252763 27418 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:41:05.252974 27418 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:41:05.255012 27418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "78fd85ee16b247b8ab2adecf2d351405"
format_stamp: "Formatted at 2026-08-08 04:41:05 on dist-test-slave-t7g5"
server_key: "b35b76e5d25132561bff2568603afc83"
server_key_iv: "fbb64e9b20ddbbb49c923ac378b21802"
server_key_version: "encryptionkey@0"
I20260808 04:41:05.255564 27418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "78fd85ee16b247b8ab2adecf2d351405"
format_stamp: "Formatted at 2026-08-08 04:41:05 on dist-test-slave-t7g5"
server_key: "b35b76e5d25132561bff2568603afc83"
server_key_iv: "fbb64e9b20ddbbb49c923ac378b21802"
server_key_version: "encryptionkey@0"
I20260808 04:41:05.259176 27418 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 04:41:05.261387 27437 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:05.262588 27418 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:41:05.262712 27418 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "78fd85ee16b247b8ab2adecf2d351405"
format_stamp: "Formatted at 2026-08-08 04:41:05 on dist-test-slave-t7g5"
server_key: "b35b76e5d25132561bff2568603afc83"
server_key_iv: "fbb64e9b20ddbbb49c923ac378b21802"
server_key_version: "encryptionkey@0"
I20260808 04:41:05.262804 27418 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:41:05.267334 27418 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:41:05.267906 27418 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:41:05.268059 27418 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:41:05.274313 27418 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:44675
I20260808 04:41:05.274319 27503 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:44675 every 8 connection(s)
I20260808 04:41:05.275175 27418 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:41:05.278396 27504 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:41:05.281985 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 27418
I20260808 04:41:05.282114 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:41:05.282446 12881 external_mini_cluster.cc:1428] Setting key 99715ccff87b187c31d50f424a10d6a9
I20260808 04:41:05.284528 27504 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78fd85ee16b247b8ab2adecf2d351405: Bootstrap starting.
I20260808 04:41:05.286854 27504 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 78fd85ee16b247b8ab2adecf2d351405: Neither blocks nor log segments found. Creating new log.
I20260808 04:41:05.287657 27504 log.cc:824] T 00000000000000000000000000000000 P 78fd85ee16b247b8ab2adecf2d351405: Log is configured to *not* fsync() on all Append() calls
I20260808 04:41:05.287972 27507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:05.283917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41510 (local address 127.12.148.126:44675)
0808 04:41:05.284563 (+ 646us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:05.284578 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:05.284620 (+ 42us) server_negotiation.cc:407] Connection header received
0808 04:41:05.285258 (+ 638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:05.285274 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:05.285621 (+ 347us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:05.285969 (+ 348us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:05.286741 (+ 772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:41:05.286746 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:41:05.286757 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:41:05.286767 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:41:05.286823 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:41:05.286838 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:41:05.286936 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:05.287057 (+ 121us) server_negotiation.cc:299] Negotiation successful
0808 04:41:05.287286 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284,"thread_start_us":140,"threads_started":1}
I20260808 04:41:05.289696 27504 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78fd85ee16b247b8ab2adecf2d351405: No bootstrap required, opened a new log
I20260808 04:41:05.293164 27504 raft_consensus.cc:348] T 00000000000000000000000000000000 P 78fd85ee16b247b8ab2adecf2d351405 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78fd85ee16b247b8ab2adecf2d351405" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 44675 } }
I20260808 04:41:05.293385 27504 raft_consensus.cc:374] T 00000000000000000000000000000000 P 78fd85ee16b247b8ab2adecf2d351405 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:41:05.293426 27504 raft_consensus.cc:729] T 00000000000000000000000000000000 P 78fd85ee16b247b8ab2adecf2d351405 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78fd85ee16b247b8ab2adecf2d351405, State: Initialized, Role: FOLLOWER
I20260808 04:41:05.293840 27504 consensus_queue.cc:260] T 00000000000000000000000000000000 P 78fd85ee16b247b8ab2adecf2d351405 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78fd85ee16b247b8ab2adecf2d351405" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 44675 } }
I20260808 04:41:05.293969 27504 raft_consensus.cc:388] T 00000000000000000000000000000000 P 78fd85ee16b247b8ab2adecf2d351405 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:41:05.294014 27504 raft_consensus.cc:482] T 00000000000000000000000000000000 P 78fd85ee16b247b8ab2adecf2d351405 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:41:05.294085 27504 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 78fd85ee16b247b8ab2adecf2d351405 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:41:05.294936 27504 raft_consensus.cc:504] T 00000000000000000000000000000000 P 78fd85ee16b247b8ab2adecf2d351405 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78fd85ee16b247b8ab2adecf2d351405" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 44675 } }
I20260808 04:41:05.295228 27504 leader_election.cc:302] T 00000000000000000000000000000000 P 78fd85ee16b247b8ab2adecf2d351405 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 78fd85ee16b247b8ab2adecf2d351405; no voters:
I20260808 04:41:05.295511 27504 leader_election.cc:288] T 00000000000000000000000000000000 P 78fd85ee16b247b8ab2adecf2d351405 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:41:05.295599 27509 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 78fd85ee16b247b8ab2adecf2d351405 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:41:05.295835 27509 raft_consensus.cc:686] T 00000000000000000000000000000000 P 78fd85ee16b247b8ab2adecf2d351405 [term 1 LEADER]: Becoming Leader. State: Replica: 78fd85ee16b247b8ab2adecf2d351405, State: Running, Role: LEADER
I20260808 04:41:05.296137 27509 consensus_queue.cc:237] T 00000000000000000000000000000000 P 78fd85ee16b247b8ab2adecf2d351405 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78fd85ee16b247b8ab2adecf2d351405" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 44675 } }
I20260808 04:41:05.296721 27504 sys_catalog.cc:564] T 00000000000000000000000000000000 P 78fd85ee16b247b8ab2adecf2d351405 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:41:05.297791 27510 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78fd85ee16b247b8ab2adecf2d351405 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "78fd85ee16b247b8ab2adecf2d351405" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78fd85ee16b247b8ab2adecf2d351405" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 44675 } } }
I20260808 04:41:05.297818 27511 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78fd85ee16b247b8ab2adecf2d351405 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 78fd85ee16b247b8ab2adecf2d351405. Latest consensus state: current_term: 1 leader_uuid: "78fd85ee16b247b8ab2adecf2d351405" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78fd85ee16b247b8ab2adecf2d351405" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 44675 } } }
I20260808 04:41:05.297919 27510 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78fd85ee16b247b8ab2adecf2d351405 [sys.catalog]: This master's current role is: LEADER
I20260808 04:41:05.297928 27511 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78fd85ee16b247b8ab2adecf2d351405 [sys.catalog]: This master's current role is: LEADER
I20260808 04:41:05.298332 27520 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:41:05.301476 27520 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:41:05.307127 27520 catalog_manager.cc:1347] Generated new cluster ID: c2e2142fdf904b2db84969a202cee327
I20260808 04:41:05.307199 27520 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:41:05.340255 27520 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:41:05.340603 27520 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:41:05.346890 27520 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 78fd85ee16b247b8ab2adecf2d351405: Generated new TSK 0
I20260808 04:41:05.347581 27520 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:41:05.356319 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.65:0
--local_ip_for_outbound_sockets=127.12.148.65
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:44675
--builtin_ntp_servers=127.12.148.84:35145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 04:41:05.469633 27537 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:41:05.469905 27537 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:41:05.469951 27537 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:41:05.473884 27537 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:41:05.473930 27537 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:41:05.473994 27537 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.65
I20260808 04:41:05.478591 27537 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:35145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:44675
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27537
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.65
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:41:05.479604 27537 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:41:05.481022 27537 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:41:05.490545 27543 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:05.490525 27547 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:05.490626 27544 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:41:05.491082 27537 server_base.cc:1034] running on GCE node
I20260808 04:41:05.491469 27537 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:41:05.492075 27537 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:41:05.493229 27537 hybrid_clock.cc:648] HybridClock initialized: now 1786164065493217 us; error 37 us; skew 500 ppm
I20260808 04:41:05.495208 27537 webserver.cc:460] Webserver started at http://127.12.148.65:41755/ using document root <none> and password file <none>
I20260808 04:41:05.495781 27537 fs_manager.cc:359] Metadata directory not provided
I20260808 04:41:05.495851 27537 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:41:05.496047 27537 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:41:05.498272 27537 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/data/instance:
uuid: "3ee1dcccf7ef43c2ae08dcfb6533211a"
format_stamp: "Formatted at 2026-08-08 04:41:05 on dist-test-slave-t7g5"
server_key: "a625008eaab8498a4ad8a630019c5dc6"
server_key_iv: "bbc327da6351f2b5764d25cdced5eba6"
server_key_version: "encryptionkey@0"
I20260808 04:41:05.498829 27537 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance:
uuid: "3ee1dcccf7ef43c2ae08dcfb6533211a"
format_stamp: "Formatted at 2026-08-08 04:41:05 on dist-test-slave-t7g5"
server_key: "a625008eaab8498a4ad8a630019c5dc6"
server_key_iv: "bbc327da6351f2b5764d25cdced5eba6"
server_key_version: "encryptionkey@0"
I20260808 04:41:05.502554 27537 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 04:41:05.505224 27558 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:05.506476 27537 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 04:41:05.506583 27537 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/wal
uuid: "3ee1dcccf7ef43c2ae08dcfb6533211a"
format_stamp: "Formatted at 2026-08-08 04:41:05 on dist-test-slave-t7g5"
server_key: "a625008eaab8498a4ad8a630019c5dc6"
server_key_iv: "bbc327da6351f2b5764d25cdced5eba6"
server_key_version: "encryptionkey@0"
I20260808 04:41:05.506690 27537 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:41:05.511226 27537 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:41:05.511811 27537 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:41:05.511981 27537 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:41:05.512516 27537 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:41:05.513415 27537 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:41:05.513463 27537 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:05.513504 27537 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:41:05.513535 27537 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:05.522106 27537 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.65:33643
I20260808 04:41:05.522128 27720 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.65:33643 every 8 connection(s)
I20260808 04:41:05.523066 27537 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
I20260808 04:41:05.524168 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 27537
I20260808 04:41:05.524262 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance
I20260808 04:41:05.524603 12881 external_mini_cluster.cc:1428] Setting key 8c0f2aa4809263a060f28c1a2bb677ec
I20260808 04:41:05.526588 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.66:0
--local_ip_for_outbound_sockets=127.12.148.66
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:44675
--builtin_ntp_servers=127.12.148.84:35145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260808 04:41:05.529286 27507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:05.524924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:52171 (local address 127.12.148.126:44675)
0808 04:41:05.525045 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:05.525048 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:05.526315 (+ 1267us) server_negotiation.cc:407] Connection header received
0808 04:41:05.527633 (+ 1318us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:05.527637 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:05.527681 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:05.527762 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:05.528848 (+ 1086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:41:05.528852 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:41:05.528855 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:41:05.528867 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:41:05.528889 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:41:05.528897 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:41:05.528975 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:05.529104 (+ 129us) server_negotiation.cc:299] Negotiation successful
0808 04:41:05.529150 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 04:41:05.530404 27725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:05.525411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:44675 (local address 127.12.148.65:52171)
0808 04:41:05.526168 (+ 757us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:05.526210 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:05.527429 (+ 1219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:05.527926 (+ 497us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:05.527932 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:05.528018 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:05.528564 (+ 546us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:41:05.528565 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:05.528607 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:41:05.528680 (+ 73us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:41:05.528969 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:41:05.528979 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:41:05.528985 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 04:41:05.529141 (+ 156us) client_negotiation.cc:240] Negotiation successful
0808 04:41:05.529429 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":122,"threads_started":1}
I20260808 04:41:05.531646 27722 heartbeater.cc:347] Connected to a master server at 127.12.148.126:44675
I20260808 04:41:05.531870 27722 heartbeater.cc:464] Registering TS with master...
I20260808 04:41:05.532260 27722 heartbeater.cc:511] Master 127.12.148.126:44675 requested a full tablet report, sending...
I20260808 04:41:05.533735 27461 ts_manager.cc:194] Registered new tserver with Master: 3ee1dcccf7ef43c2ae08dcfb6533211a (127.12.148.65:33643)
W20260808 04:41:05.637866 27726 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:41:05.638120 27726 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:41:05.638157 27726 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:41:05.642061 27726 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:41:05.642113 27726 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:41:05.642177 27726 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.66
I20260808 04:41:05.646914 27726 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:35145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:44675
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27726
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.66
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:41:05.647888 27726 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:41:05.649191 27726 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:41:05.658556 27734 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:05.658556 27738 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:05.658609 27733 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:41:05.659133 27726 server_base.cc:1034] running on GCE node
I20260808 04:41:05.659518 27726 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:41:05.660156 27726 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:41:05.661311 27726 hybrid_clock.cc:648] HybridClock initialized: now 1786164065661273 us; error 47 us; skew 500 ppm
I20260808 04:41:05.663048 27726 webserver.cc:460] Webserver started at http://127.12.148.66:38101/ using document root <none> and password file <none>
I20260808 04:41:05.663596 27726 fs_manager.cc:359] Metadata directory not provided
I20260808 04:41:05.663659 27726 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:41:05.663857 27726 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:41:05.665896 27726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/data/instance:
uuid: "fcfaf9956c714136bb82b4cf92e4a5a9"
format_stamp: "Formatted at 2026-08-08 04:41:05 on dist-test-slave-t7g5"
server_key: "a539d8e5ee478f9ef50d9cfc39e1abab"
server_key_iv: "81e6088ddf979a8cba50b6d255208f9f"
server_key_version: "encryptionkey@0"
I20260808 04:41:05.666468 27726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance:
uuid: "fcfaf9956c714136bb82b4cf92e4a5a9"
format_stamp: "Formatted at 2026-08-08 04:41:05 on dist-test-slave-t7g5"
server_key: "a539d8e5ee478f9ef50d9cfc39e1abab"
server_key_iv: "81e6088ddf979a8cba50b6d255208f9f"
server_key_version: "encryptionkey@0"
I20260808 04:41:05.670148 27726 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 04:41:05.672711 27747 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:05.674080 27726 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:41:05.674199 27726 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/wal
uuid: "fcfaf9956c714136bb82b4cf92e4a5a9"
format_stamp: "Formatted at 2026-08-08 04:41:05 on dist-test-slave-t7g5"
server_key: "a539d8e5ee478f9ef50d9cfc39e1abab"
server_key_iv: "81e6088ddf979a8cba50b6d255208f9f"
server_key_version: "encryptionkey@0"
I20260808 04:41:05.674306 27726 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:41:05.678843 27726 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:41:05.679435 27726 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:41:05.679592 27726 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:41:05.680114 27726 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:41:05.681015 27726 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:41:05.681066 27726 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:05.681116 27726 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:41:05.681143 27726 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:05.689733 27726 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.66:36477
I20260808 04:41:05.689756 27920 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.66:36477 every 8 connection(s)
I20260808 04:41:05.690629 27726 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
I20260808 04:41:05.693730 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 27726
I20260808 04:41:05.693852 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance
I20260808 04:41:05.694124 12881 external_mini_cluster.cc:1428] Setting key 8f13f2cfc46da5b4df27b6d613cb8181
I20260808 04:41:05.697064 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.67:0
--local_ip_for_outbound_sockets=127.12.148.67
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:44675
--builtin_ntp_servers=127.12.148.84:35145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260808 04:41:05.697134 27507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:05.692451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:52513 (local address 127.12.148.126:44675)
0808 04:41:05.692582 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:05.692585 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:05.693726 (+ 1141us) server_negotiation.cc:407] Connection header received
0808 04:41:05.695217 (+ 1491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:05.695221 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:05.695265 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:05.695342 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:05.696698 (+ 1356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:41:05.696701 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:41:05.696703 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:41:05.696715 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:41:05.696738 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:41:05.696746 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:41:05.696827 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:05.696981 (+ 154us) server_negotiation.cc:299] Negotiation successful
0808 04:41:05.697018 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 04:41:05.698334 27923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:05.692816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:44675 (local address 127.12.148.66:52513)
0808 04:41:05.693546 (+ 730us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:05.693590 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:05.695006 (+ 1416us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:05.695579 (+ 573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:05.695588 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:05.695701 (+ 113us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:05.696386 (+ 685us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:41:05.696388 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:05.696446 (+ 58us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:41:05.696543 (+ 97us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:41:05.696836 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:41:05.696844 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:41:05.696850 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 04:41:05.697041 (+ 191us) client_negotiation.cc:240] Negotiation successful
0808 04:41:05.697310 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":135,"threads_started":1}
I20260808 04:41:05.699463 27921 heartbeater.cc:347] Connected to a master server at 127.12.148.126:44675
I20260808 04:41:05.699689 27921 heartbeater.cc:464] Registering TS with master...
I20260808 04:41:05.700093 27921 heartbeater.cc:511] Master 127.12.148.126:44675 requested a full tablet report, sending...
I20260808 04:41:05.701217 27461 ts_manager.cc:194] Registered new tserver with Master: fcfaf9956c714136bb82b4cf92e4a5a9 (127.12.148.66:36477)
W20260808 04:41:05.812456 27925 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:41:05.812727 27925 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:41:05.812767 27925 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:41:05.816810 27925 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:41:05.816879 27925 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:41:05.816936 27925 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.67
I20260808 04:41:05.821719 27925 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:35145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:44675
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27925
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.67
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:41:05.822764 27925 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:41:05.824106 27925 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:41:05.833477 27933 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:05.833477 27938 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:05.833527 27934 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:41:05.833920 27925 server_base.cc:1034] running on GCE node
I20260808 04:41:05.834261 27925 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:41:05.834903 27925 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:41:05.836076 27925 hybrid_clock.cc:648] HybridClock initialized: now 1786164065836050 us; error 34 us; skew 500 ppm
I20260808 04:41:05.837955 27925 webserver.cc:460] Webserver started at http://127.12.148.67:33585/ using document root <none> and password file <none>
I20260808 04:41:05.838508 27925 fs_manager.cc:359] Metadata directory not provided
I20260808 04:41:05.838572 27925 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:41:05.838781 27925 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:41:05.840783 27925 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/data/instance:
uuid: "40f4d3d2ae1e44d9b913d159ba32e6d8"
format_stamp: "Formatted at 2026-08-08 04:41:05 on dist-test-slave-t7g5"
server_key: "cf95fa32b93d2c276d1d41675513327d"
server_key_iv: "1f53f5f5fc3f74328a1a815d5da9fecb"
server_key_version: "encryptionkey@0"
I20260808 04:41:05.841328 27925 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance:
uuid: "40f4d3d2ae1e44d9b913d159ba32e6d8"
format_stamp: "Formatted at 2026-08-08 04:41:05 on dist-test-slave-t7g5"
server_key: "cf95fa32b93d2c276d1d41675513327d"
server_key_iv: "1f53f5f5fc3f74328a1a815d5da9fecb"
server_key_version: "encryptionkey@0"
I20260808 04:41:05.845009 27925 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 04:41:05.847668 27945 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:05.848970 27925 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 04:41:05.849080 27925 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/wal
uuid: "40f4d3d2ae1e44d9b913d159ba32e6d8"
format_stamp: "Formatted at 2026-08-08 04:41:05 on dist-test-slave-t7g5"
server_key: "cf95fa32b93d2c276d1d41675513327d"
server_key_iv: "1f53f5f5fc3f74328a1a815d5da9fecb"
server_key_version: "encryptionkey@0"
I20260808 04:41:05.849195 27925 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:41:05.853822 27925 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:41:05.854413 27925 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:41:05.854569 27925 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:41:05.855116 27925 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:41:05.856021 27925 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:41:05.856068 27925 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:05.856112 27925 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:41:05.856139 27925 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:05.864238 27925 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.67:46157
I20260808 04:41:05.864267 28116 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.67:46157 every 8 connection(s)
I20260808 04:41:05.865154 27925 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
I20260808 04:41:05.865437 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 27925
I20260808 04:41:05.865568 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance
I20260808 04:41:05.865957 12881 external_mini_cluster.cc:1428] Setting key e5bfd0189317060d47376b4d7f391857
I20260808 04:41:05.871500 27507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:05.867062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:59477 (local address 127.12.148.126:44675)
0808 04:41:05.867175 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:05.867178 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:05.868572 (+ 1394us) server_negotiation.cc:407] Connection header received
0808 04:41:05.869898 (+ 1326us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:05.869901 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:05.869955 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:05.870028 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:05.871071 (+ 1043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:41:05.871074 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:41:05.871077 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:41:05.871090 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:41:05.871112 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:41:05.871120 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:41:05.871194 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:05.871317 (+ 123us) server_negotiation.cc:299] Negotiation successful
0808 04:41:05.871361 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 04:41:05.872327 28121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:05.867672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:44675 (local address 127.12.148.67:59477)
0808 04:41:05.868427 (+ 755us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:05.868486 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:05.869697 (+ 1211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:05.870201 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:05.870208 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:05.870303 (+ 95us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:05.870817 (+ 514us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:41:05.870818 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:05.870858 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:41:05.870928 (+ 70us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:41:05.871187 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:41:05.871195 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:41:05.871201 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 04:41:05.871353 (+ 152us) client_negotiation.cc:240] Negotiation successful
0808 04:41:05.871613 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":161,"threads_started":1}
I20260808 04:41:05.873400 28117 heartbeater.cc:347] Connected to a master server at 127.12.148.126:44675
I20260808 04:41:05.873620 28117 heartbeater.cc:464] Registering TS with master...
I20260808 04:41:05.874042 28117 heartbeater.cc:511] Master 127.12.148.126:44675 requested a full tablet report, sending...
I20260808 04:41:05.875002 27461 ts_manager.cc:194] Registered new tserver with Master: 40f4d3d2ae1e44d9b913d159ba32e6d8 (127.12.148.67:46157)
I20260808 04:41:05.879921 12881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 04:41:05.882654 27507 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:41:05.881773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41524 (local address 127.12.148.126:44675)
0808 04:41:05.881888 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:05.881892 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:05.882109 (+ 217us) server_negotiation.cc:407] Connection header received
0808 04:41:05.882216 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:05.882219 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:05.882254 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:05.882315 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:05.882553 (+ 238us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41524: BlockingRecv error: recv got EOF from 127.0.0.1:41524 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 04:41:05.882925 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 27537
I20260808 04:41:05.897495 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 27726
I20260808 04:41:05.916792 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 27925
I20260808 04:41:05.930370 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 27418
2026-08-08T04:41:05Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (849 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:41:05 dist-test-slave-t7g5 krb5kdc[28136](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:41:05 dist-test-slave-t7g5 krb5kdc[28136](info): set up 2 sockets
Aug 08 04:41:05 dist-test-slave-t7g5 krb5kdc[28136](info): commencing operation
krb5kdc: starting...
W20260808 04:41:07.084355 12881 mini_kdc.cc:121] Time spent starting KDC: real 1.128s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Aug 08 04:41:07 dist-test-slave-t7g5 krb5kdc[28136](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164067, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:41:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:41:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.148.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
I20260808 04:41:07.206736 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:34445
--webserver_interface=127.12.148.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:43353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:34445
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:41:07.318426 28160 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:41:07.318711 28160 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:41:07.318749 28160 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:41:07.322784 28160 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:41:07.322844 28160 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:41:07.322860 28160 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:41:07.322875 28160 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:41:07.322889 28160 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:41:07.328003 28160 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:43353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:34445
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:34445
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28160
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:41:07.328958 28160 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:41:07.329947 28160 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:41:07.338060 28166 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:07.338069 28169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:41:07.338119 28160 server_base.cc:1034] running on GCE node
W20260808 04:41:07.338069 28165 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:41:07.338814 28160 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:41:07.339834 28160 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:41:07.340997 28160 hybrid_clock.cc:648] HybridClock initialized: now 1786164067340975 us; error 38 us; skew 500 ppm
Aug 08 04:41:07 dist-test-slave-t7g5 krb5kdc[28136](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164067, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:41:07.344412 28160 init.cc:377] Logged in from keytab as kudu/127.12.148.126@KRBTEST.COM (short username kudu)
I20260808 04:41:07.345592 28160 webserver.cc:460] Webserver started at http://127.12.148.126:34513/ using document root <none> and password file <none>
I20260808 04:41:07.346405 28160 fs_manager.cc:359] Metadata directory not provided
I20260808 04:41:07.346499 28160 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:41:07.346756 28160 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:41:07.349740 28160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "8a4ffb7d1f7441a4bacc9ad364b5b713"
format_stamp: "Formatted at 2026-08-08 04:41:07 on dist-test-slave-t7g5"
server_key: "daa768014ddfb57969068eb670b8e6b4"
server_key_iv: "e476e3574ce0c5c73047b9add634cf7c"
server_key_version: "encryptionkey@0"
I20260808 04:41:07.350589 28160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "8a4ffb7d1f7441a4bacc9ad364b5b713"
format_stamp: "Formatted at 2026-08-08 04:41:07 on dist-test-slave-t7g5"
server_key: "daa768014ddfb57969068eb670b8e6b4"
server_key_iv: "e476e3574ce0c5c73047b9add634cf7c"
server_key_version: "encryptionkey@0"
I20260808 04:41:07.355038 28160 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260808 04:41:07.358068 28178 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:07.359699 28160 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 04:41:07.359869 28160 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "8a4ffb7d1f7441a4bacc9ad364b5b713"
format_stamp: "Formatted at 2026-08-08 04:41:07 on dist-test-slave-t7g5"
server_key: "daa768014ddfb57969068eb670b8e6b4"
server_key_iv: "e476e3574ce0c5c73047b9add634cf7c"
server_key_version: "encryptionkey@0"
I20260808 04:41:07.359997 28160 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:41:07.410671 28160 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:41:07.413770 28160 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:41:07.413930 28160 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:41:07.420326 28160 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:34445
I20260808 04:41:07.420617 28271 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:34445 every 8 connection(s)
I20260808 04:41:07.421252 28160 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:41:07.423970 28273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:41:07.425426 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 28160
I20260808 04:41:07.425526 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:41:07.425854 12881 external_mini_cluster.cc:1428] Setting key f08d422b67f59f53432ca49c5a92cc9e
I20260808 04:41:07.430012 28273 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a4ffb7d1f7441a4bacc9ad364b5b713: Bootstrap starting.
I20260808 04:41:07.432489 28273 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8a4ffb7d1f7441a4bacc9ad364b5b713: Neither blocks nor log segments found. Creating new log.
I20260808 04:41:07.433368 28273 log.cc:824] T 00000000000000000000000000000000 P 8a4ffb7d1f7441a4bacc9ad364b5b713: Log is configured to *not* fsync() on all Append() calls
Aug 08 04:41:07 dist-test-slave-t7g5 krb5kdc[28136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164067, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:41:07.435391 28273 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a4ffb7d1f7441a4bacc9ad364b5b713: No bootstrap required, opened a new log
I20260808 04:41:07.439958 28280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:07.427132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52612 (local address 127.12.148.126:34445)
0808 04:41:07.427492 (+ 360us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:07.427507 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:07.427542 (+ 35us) server_negotiation.cc:407] Connection header received
0808 04:41:07.428129 (+ 587us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:07.428144 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:07.428458 (+ 314us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:07.428719 (+ 261us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:07.429574 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:07.430580 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:07.431723 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:07.432184 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:07.432312 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:07.434935 (+ 2623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:41:07.434942 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:41:07.434956 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:41:07.434986 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:41:07.436887 (+ 1901us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:41:07.437302 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:41:07.437307 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:41:07.437313 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:41:07.437460 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:41:07.437731 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:41:07.437735 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:41:07.437737 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:41:07.438263 (+ 526us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:41:07.438461 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:07.438675 (+ 214us) server_negotiation.cc:299] Negotiation successful
0808 04:41:07.438986 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":229,"thread_start_us":100,"threads_started":1}
I20260808 04:41:07.439909 28273 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8a4ffb7d1f7441a4bacc9ad364b5b713 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a4ffb7d1f7441a4bacc9ad364b5b713" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 34445 } }
I20260808 04:41:07.440181 28273 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8a4ffb7d1f7441a4bacc9ad364b5b713 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:41:07.440248 28273 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8a4ffb7d1f7441a4bacc9ad364b5b713 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a4ffb7d1f7441a4bacc9ad364b5b713, State: Initialized, Role: FOLLOWER
I20260808 04:41:07.440716 28273 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a4ffb7d1f7441a4bacc9ad364b5b713 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a4ffb7d1f7441a4bacc9ad364b5b713" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 34445 } }
I20260808 04:41:07.440872 28273 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8a4ffb7d1f7441a4bacc9ad364b5b713 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:41:07.440936 28273 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8a4ffb7d1f7441a4bacc9ad364b5b713 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:41:07.441035 28273 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8a4ffb7d1f7441a4bacc9ad364b5b713 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:41:07.442166 28273 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8a4ffb7d1f7441a4bacc9ad364b5b713 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a4ffb7d1f7441a4bacc9ad364b5b713" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 34445 } }
I20260808 04:41:07.442489 28273 leader_election.cc:302] T 00000000000000000000000000000000 P 8a4ffb7d1f7441a4bacc9ad364b5b713 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8a4ffb7d1f7441a4bacc9ad364b5b713; no voters:
I20260808 04:41:07.442773 28273 leader_election.cc:288] T 00000000000000000000000000000000 P 8a4ffb7d1f7441a4bacc9ad364b5b713 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:41:07.442871 28283 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8a4ffb7d1f7441a4bacc9ad364b5b713 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:41:07.443082 28283 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8a4ffb7d1f7441a4bacc9ad364b5b713 [term 1 LEADER]: Becoming Leader. State: Replica: 8a4ffb7d1f7441a4bacc9ad364b5b713, State: Running, Role: LEADER
I20260808 04:41:07.443395 28283 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8a4ffb7d1f7441a4bacc9ad364b5b713 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a4ffb7d1f7441a4bacc9ad364b5b713" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 34445 } }
I20260808 04:41:07.443934 28273 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8a4ffb7d1f7441a4bacc9ad364b5b713 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:41:07.444993 28285 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a4ffb7d1f7441a4bacc9ad364b5b713 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8a4ffb7d1f7441a4bacc9ad364b5b713. Latest consensus state: current_term: 1 leader_uuid: "8a4ffb7d1f7441a4bacc9ad364b5b713" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a4ffb7d1f7441a4bacc9ad364b5b713" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 34445 } } }
I20260808 04:41:07.445123 28285 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a4ffb7d1f7441a4bacc9ad364b5b713 [sys.catalog]: This master's current role is: LEADER
I20260808 04:41:07.445379 28284 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a4ffb7d1f7441a4bacc9ad364b5b713 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8a4ffb7d1f7441a4bacc9ad364b5b713" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a4ffb7d1f7441a4bacc9ad364b5b713" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 34445 } } }
I20260808 04:41:07.445474 28284 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a4ffb7d1f7441a4bacc9ad364b5b713 [sys.catalog]: This master's current role is: LEADER
I20260808 04:41:07.445688 28301 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:41:07.448474 28301 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:41:07.454017 28301 catalog_manager.cc:1347] Generated new cluster ID: 18fc27454ec043e3a87a5af48bd99d20
I20260808 04:41:07.454102 28301 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:41:07.473302 28301 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:41:07.474306 28301 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:41:07.477909 28301 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8a4ffb7d1f7441a4bacc9ad364b5b713: Generated new TSK 0
I20260808 04:41:07.478724 28301 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.148.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab.
Entry for principal kudu/127.12.148.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab.
I20260808 04:41:07.516894 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.65:0
--local_ip_for_outbound_sockets=127.12.148.65
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:34445
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:43353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:41:07.651234 28316 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:41:07.651489 28316 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:41:07.651528 28316 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:41:07.655421 28316 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:41:07.655499 28316 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:41:07.655555 28316 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.65
I20260808 04:41:07.660648 28316 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:43353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:34445
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28316
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.65
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:41:07.661618 28316 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:41:07.662608 28316 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:41:07.671908 28323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:07.671908 28325 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:41:07.672073 28316 server_base.cc:1034] running on GCE node
W20260808 04:41:07.671931 28327 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:41:07.672637 28316 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:41:07.673254 28316 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:41:07.674407 28316 hybrid_clock.cc:648] HybridClock initialized: now 1786164067674385 us; error 36 us; skew 500 ppm
Aug 08 04:41:07 dist-test-slave-t7g5 krb5kdc[28136](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164067, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:41:07.677052 28316 init.cc:377] Logged in from keytab as kudu/127.12.148.65@KRBTEST.COM (short username kudu)
I20260808 04:41:07.677930 28316 webserver.cc:460] Webserver started at http://127.12.148.65:43137/ using document root <none> and password file <none>
I20260808 04:41:07.678475 28316 fs_manager.cc:359] Metadata directory not provided
I20260808 04:41:07.678546 28316 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:41:07.678745 28316 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:41:07.680756 28316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/data/instance:
uuid: "dca0dc21d84544849a135ee920564b35"
format_stamp: "Formatted at 2026-08-08 04:41:07 on dist-test-slave-t7g5"
server_key: "6fec6b4dd78b9cd6919a34785848ec13"
server_key_iv: "3ef4b9a85d4a28605aa64ef9c73fc02a"
server_key_version: "encryptionkey@0"
I20260808 04:41:07.681301 28316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance:
uuid: "dca0dc21d84544849a135ee920564b35"
format_stamp: "Formatted at 2026-08-08 04:41:07 on dist-test-slave-t7g5"
server_key: "6fec6b4dd78b9cd6919a34785848ec13"
server_key_iv: "3ef4b9a85d4a28605aa64ef9c73fc02a"
server_key_version: "encryptionkey@0"
I20260808 04:41:07.684913 28316 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 04:41:07.687304 28339 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:07.688482 28316 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 04:41:07.688630 28316 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/wal
uuid: "dca0dc21d84544849a135ee920564b35"
format_stamp: "Formatted at 2026-08-08 04:41:07 on dist-test-slave-t7g5"
server_key: "6fec6b4dd78b9cd6919a34785848ec13"
server_key_iv: "3ef4b9a85d4a28605aa64ef9c73fc02a"
server_key_version: "encryptionkey@0"
I20260808 04:41:07.688727 28316 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:41:07.711859 28316 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:41:07.714811 28316 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:41:07.715004 28316 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:41:07.715598 28316 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:41:07.716430 28316 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:41:07.716481 28316 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:07.716522 28316 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:41:07.716552 28316 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:07.725682 28316 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.65:39383
I20260808 04:41:07.725746 28508 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.65:39383 every 8 connection(s)
I20260808 04:41:07.726629 28316 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
I20260808 04:41:07.733423 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 28316
I20260808 04:41:07.733533 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance
I20260808 04:41:07.733844 12881 external_mini_cluster.cc:1428] Setting key 45c64167fda1b6fcbbb01e527262c639
Aug 08 04:41:07 dist-test-slave-t7g5 krb5kdc[28136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164067, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:41:07.740232 28280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:07.728451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:37983 (local address 127.12.148.126:34445)
0808 04:41:07.728583 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:07.728587 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:07.729438 (+ 851us) server_negotiation.cc:407] Connection header received
0808 04:41:07.730866 (+ 1428us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:07.730870 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:07.730929 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:07.731006 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:07.732225 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:07.732762 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:07.734006 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:07.734241 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:07.734335 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:07.736869 (+ 2534us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:41:07.736872 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:41:07.736874 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:41:07.736898 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:41:07.738227 (+ 1329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:41:07.738708 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:41:07.738711 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:41:07.738712 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:41:07.738791 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:41:07.739104 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:41:07.739108 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:41:07.739109 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:41:07.739287 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:41:07.739384 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:07.739914 (+ 530us) server_negotiation.cc:299] Negotiation successful
0808 04:41:07.740064 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 04:41:07.740957 28514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:07.728831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:34445 (local address 127.12.148.65:37983)
0808 04:41:07.729285 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:07.729339 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:07.730637 (+ 1298us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:07.731198 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:07.731206 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:07.731585 (+ 379us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:07.732075 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:07.732089 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:07.732905 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:07.732908 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:07.733893 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:07.733906 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:07.734394 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:07.734398 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:07.734563 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:07.735113 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:41:07.735131 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:07.736712 (+ 1581us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:41:07.738336 (+ 1624us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:41:07.738342 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:41:07.738357 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:41:07.738614 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:41:07.738875 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:41:07.738878 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:41:07.738880 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:41:07.739018 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:41:07.739385 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:41:07.739392 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:41:07.739639 (+ 247us) client_negotiation.cc:769] Sending connection context
0808 04:41:07.739821 (+ 182us) client_negotiation.cc:240] Negotiation successful
0808 04:41:07.740103 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":116,"threads_started":1}
I20260808 04:41:07.742434 28509 heartbeater.cc:347] Connected to a master server at 127.12.148.126:34445
I20260808 04:41:07.742656 28509 heartbeater.cc:464] Registering TS with master...
I20260808 04:41:07.743113 28509 heartbeater.cc:511] Master 127.12.148.126:34445 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.12.148.66@KRBTEST.COM; defaulting to no policy
I20260808 04:41:07.744735 28203 ts_manager.cc:194] Registered new tserver with Master: dca0dc21d84544849a135ee920564b35 (127.12.148.65:39383)
I20260808 04:41:07.745995 28203 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.65@KRBTEST.COM'} at 127.12.148.65:37983
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab.
Entry for principal kudu/127.12.148.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab.
I20260808 04:41:07.760828 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.66:0
--local_ip_for_outbound_sockets=127.12.148.66
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:34445
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:43353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:41:07.871356 28517 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:41:07.871585 28517 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:41:07.871625 28517 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:41:07.875536 28517 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:41:07.875591 28517 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:41:07.875645 28517 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.66
I20260808 04:41:07.880703 28517 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:43353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:34445
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28517
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.66
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:41:07.881669 28517 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:41:07.882643 28517 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:41:07.892030 28531 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:07.892043 28526 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:07.892045 28528 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:41:07.892184 28517 server_base.cc:1034] running on GCE node
I20260808 04:41:07.892684 28517 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:41:07.893342 28517 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:41:07.894520 28517 hybrid_clock.cc:648] HybridClock initialized: now 1786164067894479 us; error 54 us; skew 500 ppm
Aug 08 04:41:07 dist-test-slave-t7g5 krb5kdc[28136](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164067, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:41:07.900107 28517 init.cc:377] Logged in from keytab as kudu/127.12.148.66@KRBTEST.COM (short username kudu)
I20260808 04:41:07.901023 28517 webserver.cc:460] Webserver started at http://127.12.148.66:43031/ using document root <none> and password file <none>
I20260808 04:41:07.901583 28517 fs_manager.cc:359] Metadata directory not provided
I20260808 04:41:07.901678 28517 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:41:07.901894 28517 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:41:07.903981 28517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/data/instance:
uuid: "2ee73ebe762945cd8d722e292ecc0506"
format_stamp: "Formatted at 2026-08-08 04:41:07 on dist-test-slave-t7g5"
server_key: "59b9e967372653881fe86ee1770bcb31"
server_key_iv: "4f3bbb621fd3f23326a4dd9addb8136e"
server_key_version: "encryptionkey@0"
I20260808 04:41:07.904554 28517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance:
uuid: "2ee73ebe762945cd8d722e292ecc0506"
format_stamp: "Formatted at 2026-08-08 04:41:07 on dist-test-slave-t7g5"
server_key: "59b9e967372653881fe86ee1770bcb31"
server_key_iv: "4f3bbb621fd3f23326a4dd9addb8136e"
server_key_version: "encryptionkey@0"
I20260808 04:41:07.908274 28517 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260808 04:41:07.910663 28539 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:07.911852 28517 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:41:07.911963 28517 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/wal
uuid: "2ee73ebe762945cd8d722e292ecc0506"
format_stamp: "Formatted at 2026-08-08 04:41:07 on dist-test-slave-t7g5"
server_key: "59b9e967372653881fe86ee1770bcb31"
server_key_iv: "4f3bbb621fd3f23326a4dd9addb8136e"
server_key_version: "encryptionkey@0"
I20260808 04:41:07.912057 28517 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:41:07.931561 28517 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:41:07.934549 28517 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:41:07.934732 28517 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:41:07.935401 28517 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:41:07.936302 28517 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:41:07.936357 28517 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:07.936436 28517 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:41:07.936471 28517 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:07.945395 28517 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.66:40471
I20260808 04:41:07.945456 28707 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.66:40471 every 8 connection(s)
I20260808 04:41:07.946382 28517 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
I20260808 04:41:07.947049 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 28517
I20260808 04:41:07.947167 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance
I20260808 04:41:07.947458 12881 external_mini_cluster.cc:1428] Setting key 7393c34d1d0c79a235c244cb5d21e11b
Aug 08 04:41:07 dist-test-slave-t7g5 krb5kdc[28136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164067, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.148.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.67@KRBTEST.COM" created.
I20260808 04:41:07.960544 28280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:07.948225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:42231 (local address 127.12.148.126:34445)
0808 04:41:07.948828 (+ 603us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:07.948832 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:07.950073 (+ 1241us) server_negotiation.cc:407] Connection header received
0808 04:41:07.951413 (+ 1340us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:07.951416 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:07.951470 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:07.951544 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:07.952735 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:07.953249 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:07.954421 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:07.954637 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:07.954733 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:07.957070 (+ 2337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:41:07.957073 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:41:07.957075 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:41:07.957098 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:41:07.958535 (+ 1437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:41:07.959065 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:41:07.959067 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:41:07.959069 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:41:07.959141 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:41:07.959423 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:41:07.959425 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:41:07.959426 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:41:07.959591 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:41:07.959683 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:07.960247 (+ 564us) server_negotiation.cc:299] Negotiation successful
0808 04:41:07.960367 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":499}
I20260808 04:41:07.961294 28710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:07.948771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:34445 (local address 127.12.148.66:42231)
0808 04:41:07.949932 (+ 1161us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:07.949976 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:07.951202 (+ 1226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:07.951722 (+ 520us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:07.951730 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:07.952085 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:07.952590 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:07.952604 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:07.953367 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:07.953370 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:07.954306 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:07.954316 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:07.954776 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:07.954780 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:07.954944 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:07.955494 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:41:07.955511 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:07.956916 (+ 1405us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:41:07.958648 (+ 1732us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:41:07.958653 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:41:07.958665 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:41:07.958948 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:41:07.959207 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:41:07.959209 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:41:07.959211 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:41:07.959353 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:41:07.959714 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:41:07.959720 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:41:07.959994 (+ 274us) client_negotiation.cc:769] Sending connection context
0808 04:41:07.960163 (+ 169us) client_negotiation.cc:240] Negotiation successful
0808 04:41:07.960424 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":967,"thread_start_us":133,"threads_started":1}
I20260808 04:41:07.962543 28708 heartbeater.cc:347] Connected to a master server at 127.12.148.126:34445
I20260808 04:41:07.962771 28708 heartbeater.cc:464] Registering TS with master...
I20260808 04:41:07.963245 28708 heartbeater.cc:511] Master 127.12.148.126:34445 requested a full tablet report, sending...
I20260808 04:41:07.964345 28203 ts_manager.cc:194] Registered new tserver with Master: 2ee73ebe762945cd8d722e292ecc0506 (127.12.148.66:40471)
I20260808 04:41:07.965111 28203 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.66@KRBTEST.COM'} at 127.12.148.66:42231
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab.
Entry for principal kudu/127.12.148.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab.
I20260808 04:41:07.976176 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.67:0
--local_ip_for_outbound_sockets=127.12.148.67
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:34445
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:43353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:41:08.088300 28714 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:41:08.088553 28714 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:41:08.088613 28714 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:41:08.092585 28714 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:41:08.092645 28714 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:41:08.092720 28714 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.67
I20260808 04:41:08.097944 28714 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:43353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:34445
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28714
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.67
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:41:08.098970 28714 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:41:08.099967 28714 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:41:08.109261 28720 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:08.109244 28721 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:08.109241 28723 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:41:08.109491 28714 server_base.cc:1034] running on GCE node
I20260808 04:41:08.110047 28714 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:41:08.110670 28714 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:41:08.111829 28714 hybrid_clock.cc:648] HybridClock initialized: now 1786164068111807 us; error 37 us; skew 500 ppm
Aug 08 04:41:08 dist-test-slave-t7g5 krb5kdc[28136](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164068, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:41:08.114513 28714 init.cc:377] Logged in from keytab as kudu/127.12.148.67@KRBTEST.COM (short username kudu)
I20260808 04:41:08.115360 28714 webserver.cc:460] Webserver started at http://127.12.148.67:35071/ using document root <none> and password file <none>
I20260808 04:41:08.115888 28714 fs_manager.cc:359] Metadata directory not provided
I20260808 04:41:08.115957 28714 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:41:08.116148 28714 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:41:08.118165 28714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/data/instance:
uuid: "debc8229474d4f23b8849834eb420c67"
format_stamp: "Formatted at 2026-08-08 04:41:08 on dist-test-slave-t7g5"
server_key: "a3c55912310a6456b9500cb174611cc1"
server_key_iv: "591eacd596d12892475a29abb6072ffd"
server_key_version: "encryptionkey@0"
I20260808 04:41:08.118690 28714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance:
uuid: "debc8229474d4f23b8849834eb420c67"
format_stamp: "Formatted at 2026-08-08 04:41:08 on dist-test-slave-t7g5"
server_key: "a3c55912310a6456b9500cb174611cc1"
server_key_iv: "591eacd596d12892475a29abb6072ffd"
server_key_version: "encryptionkey@0"
I20260808 04:41:08.122282 28714 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 04:41:08.124709 28735 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:08.126031 28714 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:41:08.126134 28714 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/wal
uuid: "debc8229474d4f23b8849834eb420c67"
format_stamp: "Formatted at 2026-08-08 04:41:08 on dist-test-slave-t7g5"
server_key: "a3c55912310a6456b9500cb174611cc1"
server_key_iv: "591eacd596d12892475a29abb6072ffd"
server_key_version: "encryptionkey@0"
I20260808 04:41:08.126233 28714 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:41:08.145489 28714 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:41:08.148634 28714 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:41:08.148813 28714 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:41:08.149401 28714 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:41:08.150287 28714 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:41:08.150346 28714 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:08.150393 28714 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:41:08.150424 28714 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:08.158897 28714 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.67:32883
I20260808 04:41:08.158922 28901 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.67:32883 every 8 connection(s)
I20260808 04:41:08.159750 28714 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
I20260808 04:41:08.163313 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 28714
I20260808 04:41:08.163446 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance
I20260808 04:41:08.163775 12881 external_mini_cluster.cc:1428] Setting key 89ef73381b204e7c937a269b5e4b36eb
Aug 08 04:41:08 dist-test-slave-t7g5 krb5kdc[28136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164068, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:41:08.172847 28280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:08.161473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:56953 (local address 127.12.148.126:34445)
0808 04:41:08.161606 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:08.161610 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:08.162432 (+ 822us) server_negotiation.cc:407] Connection header received
0808 04:41:08.164078 (+ 1646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:08.164082 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:08.164145 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:08.164236 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:08.165682 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.166282 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.167402 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.167617 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.167702 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:08.170019 (+ 2317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:41:08.170022 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:41:08.170024 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:41:08.170047 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:41:08.171212 (+ 1165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:41:08.171667 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:41:08.171669 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:41:08.171670 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:41:08.171739 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:41:08.171988 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:41:08.171990 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:41:08.171991 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:41:08.172149 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:41:08.172218 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:08.172635 (+ 417us) server_negotiation.cc:299] Negotiation successful
0808 04:41:08.172728 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 04:41:08.173619 28905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:08.161842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:34445 (local address 127.12.148.67:56953)
0808 04:41:08.162287 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:08.162330 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:08.163850 (+ 1520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:08.164427 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:08.164450 (+ 23us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:08.164977 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:08.165530 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:08.165543 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.166399 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.166403 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:08.167288 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:08.167297 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.167750 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.167754 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:08.167940 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:08.168453 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:41:08.168470 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:08.169879 (+ 1409us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:41:08.171308 (+ 1429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:41:08.171313 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:41:08.171334 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:41:08.171589 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:41:08.171798 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:41:08.171800 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:41:08.171801 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:41:08.171924 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:41:08.172218 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:41:08.172222 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:41:08.172455 (+ 233us) client_negotiation.cc:769] Sending connection context
0808 04:41:08.172603 (+ 148us) client_negotiation.cc:240] Negotiation successful
0808 04:41:08.172847 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":112,"threads_started":1}
I20260808 04:41:08.174750 28903 heartbeater.cc:347] Connected to a master server at 127.12.148.126:34445
I20260808 04:41:08.175019 28903 heartbeater.cc:464] Registering TS with master...
I20260808 04:41:08.175545 28903 heartbeater.cc:511] Master 127.12.148.126:34445 requested a full tablet report, sending...
I20260808 04:41:08.176620 28203 ts_manager.cc:194] Registered new tserver with Master: debc8229474d4f23b8849834eb420c67 (127.12.148.67:32883)
I20260808 04:41:08.177301 28203 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.67@KRBTEST.COM'} at 127.12.148.67:56953
I20260808 04:41:08.177561 12881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 04:41:08.186110 28280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:08.179487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52628 (local address 127.12.148.126:34445)
0808 04:41:08.179599 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:08.179604 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:08.179782 (+ 178us) server_negotiation.cc:407] Connection header received
0808 04:41:08.179904 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:08.179907 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:08.179955 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:08.180013 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:08.180683 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.181175 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.182037 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.182250 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.182326 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:08.183505 (+ 1179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:41:08.183509 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:41:08.183511 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:41:08.183535 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:41:08.184570 (+ 1035us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:41:08.184950 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:41:08.184953 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:41:08.184955 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:41:08.185034 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:41:08.185275 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:41:08.185278 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:41:08.185280 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:41:08.185494 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:41:08.185614 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:08.185857 (+ 243us) server_negotiation.cc:299] Negotiation successful
0808 04:41:08.185969 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 04:41:08.188472 28203 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52628:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:41:08.192220 28203 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:41:08.206897 28918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:08.201195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.67:32883 (local address 127.0.0.1:43544)
0808 04:41:08.201807 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:08.201831 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:08.201903 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:08.203032 (+ 1129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:08.203036 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:08.203053 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:41:08.203171 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:08.203178 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.204204 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.204207 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:08.205419 (+ 1212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:08.205429 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.206352 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.206356 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:08.206481 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:08.206524 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 04:41:08.206624 (+ 100us) client_negotiation.cc:240] Negotiation successful
0808 04:41:08.206744 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"mutex_wait_us":54,"thread_start_us":81,"threads_started":1}
I20260808 04:41:08.206902 28923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:08.202334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43544 (local address 127.12.148.67:32883)
0808 04:41:08.202664 (+ 330us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:08.202673 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:08.202692 (+ 19us) server_negotiation.cc:407] Connection header received
0808 04:41:08.202752 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:08.202756 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:08.202897 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:08.203037 (+ 140us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:41:08.203266 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.204095 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.205545 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.206239 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.206338 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:08.206490 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:08.206665 (+ 175us) server_negotiation.cc:299] Negotiation successful
0808 04:41:08.206756 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":239,"thread_start_us":141,"threads_started":1}
I20260808 04:41:08.207692 28919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:08.201136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:39383 (local address 127.0.0.1:36786)
0808 04:41:08.201578 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:08.201632 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:08.201783 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:08.203652 (+ 1869us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:08.203654 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:08.203673 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:41:08.203770 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:08.203776 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.205101 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.205104 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:08.206220 (+ 1116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:08.206230 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.207268 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.207272 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:08.207367 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:08.207390 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 04:41:08.207471 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 04:41:08.207538 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":86,"threads_started":1}
I20260808 04:41:08.207729 28920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:08.201283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36786 (local address 127.12.148.65:39383)
0808 04:41:08.203219 (+ 1936us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:08.203235 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:08.203255 (+ 20us) server_negotiation.cc:407] Connection header received
0808 04:41:08.203337 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:08.203341 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:08.203515 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:08.203656 (+ 141us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:41:08.203884 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.204957 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.206379 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.207140 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.207265 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:08.207406 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:08.207498 (+ 92us) server_negotiation.cc:299] Negotiation successful
0808 04:41:08.207583 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1832,"thread_start_us":95,"threads_started":1}
I20260808 04:41:08.208289 28922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:08.202079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59012 (local address 127.12.148.66:40471)
0808 04:41:08.202539 (+ 460us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:08.202548 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:08.202567 (+ 19us) server_negotiation.cc:407] Connection header received
0808 04:41:08.202627 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:08.202631 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:08.202787 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:08.202924 (+ 137us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:41:08.203226 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.204328 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.205857 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.206650 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.206744 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:08.206888 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:08.208039 (+ 1151us) server_negotiation.cc:299] Negotiation successful
0808 04:41:08.208141 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":376,"thread_start_us":106,"threads_started":1}
I20260808 04:41:08.207718 28921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:08.201908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:40471 (local address 127.0.0.1:59012)
0808 04:41:08.202142 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:08.202155 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:08.202242 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:08.202934 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:08.202939 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:08.202963 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:41:08.203096 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:08.203103 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.204501 (+ 1398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.204505 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:08.205712 (+ 1207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:08.205723 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.206958 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.207302 (+ 344us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:08.207391 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:08.207414 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 04:41:08.207482 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 04:41:08.207566 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"mutex_wait_us":3,"thread_start_us":98,"threads_started":1}
I20260808 04:41:08.210315 28805 tablet_service.cc:1467] Processing CreateTablet for tablet 6aabac04ed8f4462bbcb8ad5525d9f5c (DEFAULT_TABLE table=test-table [id=3d16a2e006434a83907be8043aa39ea1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:41:08.210704 28611 tablet_service.cc:1467] Processing CreateTablet for tablet 6aabac04ed8f4462bbcb8ad5525d9f5c (DEFAULT_TABLE table=test-table [id=3d16a2e006434a83907be8043aa39ea1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:41:08.211041 28406 tablet_service.cc:1467] Processing CreateTablet for tablet 6aabac04ed8f4462bbcb8ad5525d9f5c (DEFAULT_TABLE table=test-table [id=3d16a2e006434a83907be8043aa39ea1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:41:08.211503 28805 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6aabac04ed8f4462bbcb8ad5525d9f5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:41:08.211606 28611 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6aabac04ed8f4462bbcb8ad5525d9f5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:41:08.211989 28406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6aabac04ed8f4462bbcb8ad5525d9f5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:41:08.218652 28927 tablet_bootstrap.cc:492] T 6aabac04ed8f4462bbcb8ad5525d9f5c P 2ee73ebe762945cd8d722e292ecc0506: Bootstrap starting.
I20260808 04:41:08.219671 28929 tablet_bootstrap.cc:492] T 6aabac04ed8f4462bbcb8ad5525d9f5c P dca0dc21d84544849a135ee920564b35: Bootstrap starting.
I20260808 04:41:08.221474 28927 tablet_bootstrap.cc:654] T 6aabac04ed8f4462bbcb8ad5525d9f5c P 2ee73ebe762945cd8d722e292ecc0506: Neither blocks nor log segments found. Creating new log.
I20260808 04:41:08.221884 28929 tablet_bootstrap.cc:654] T 6aabac04ed8f4462bbcb8ad5525d9f5c P dca0dc21d84544849a135ee920564b35: Neither blocks nor log segments found. Creating new log.
I20260808 04:41:08.221980 28928 tablet_bootstrap.cc:492] T 6aabac04ed8f4462bbcb8ad5525d9f5c P debc8229474d4f23b8849834eb420c67: Bootstrap starting.
I20260808 04:41:08.222462 28927 log.cc:824] T 6aabac04ed8f4462bbcb8ad5525d9f5c P 2ee73ebe762945cd8d722e292ecc0506: Log is configured to *not* fsync() on all Append() calls
I20260808 04:41:08.223311 28929 log.cc:824] T 6aabac04ed8f4462bbcb8ad5525d9f5c P dca0dc21d84544849a135ee920564b35: Log is configured to *not* fsync() on all Append() calls
I20260808 04:41:08.223827 28928 tablet_bootstrap.cc:654] T 6aabac04ed8f4462bbcb8ad5525d9f5c P debc8229474d4f23b8849834eb420c67: Neither blocks nor log segments found. Creating new log.
I20260808 04:41:08.224807 28928 log.cc:824] T 6aabac04ed8f4462bbcb8ad5525d9f5c P debc8229474d4f23b8849834eb420c67: Log is configured to *not* fsync() on all Append() calls
I20260808 04:41:08.225193 28929 tablet_bootstrap.cc:492] T 6aabac04ed8f4462bbcb8ad5525d9f5c P dca0dc21d84544849a135ee920564b35: No bootstrap required, opened a new log
I20260808 04:41:08.225419 28929 ts_tablet_manager.cc:1397] T 6aabac04ed8f4462bbcb8ad5525d9f5c P dca0dc21d84544849a135ee920564b35: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 04:41:08.226521 28928 tablet_bootstrap.cc:492] T 6aabac04ed8f4462bbcb8ad5525d9f5c P debc8229474d4f23b8849834eb420c67: No bootstrap required, opened a new log
I20260808 04:41:08.226688 28928 ts_tablet_manager.cc:1397] T 6aabac04ed8f4462bbcb8ad5525d9f5c P debc8229474d4f23b8849834eb420c67: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 04:41:08.228443 28929 raft_consensus.cc:348] T 6aabac04ed8f4462bbcb8ad5525d9f5c P dca0dc21d84544849a135ee920564b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca0dc21d84544849a135ee920564b35" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39383 } } peers { permanent_uuid: "debc8229474d4f23b8849834eb420c67" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 32883 } } peers { permanent_uuid: "2ee73ebe762945cd8d722e292ecc0506" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40471 } }
I20260808 04:41:08.228658 28929 raft_consensus.cc:374] T 6aabac04ed8f4462bbcb8ad5525d9f5c P dca0dc21d84544849a135ee920564b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:41:08.228693 28929 raft_consensus.cc:729] T 6aabac04ed8f4462bbcb8ad5525d9f5c P dca0dc21d84544849a135ee920564b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dca0dc21d84544849a135ee920564b35, State: Initialized, Role: FOLLOWER
I20260808 04:41:08.229158 28929 consensus_queue.cc:260] T 6aabac04ed8f4462bbcb8ad5525d9f5c P dca0dc21d84544849a135ee920564b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca0dc21d84544849a135ee920564b35" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39383 } } peers { permanent_uuid: "debc8229474d4f23b8849834eb420c67" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 32883 } } peers { permanent_uuid: "2ee73ebe762945cd8d722e292ecc0506" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40471 } }
I20260808 04:41:08.229812 28509 heartbeater.cc:503] Master 127.12.148.126:34445 was elected leader, sending a full tablet report...
I20260808 04:41:08.229791 28928 raft_consensus.cc:348] T 6aabac04ed8f4462bbcb8ad5525d9f5c P debc8229474d4f23b8849834eb420c67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca0dc21d84544849a135ee920564b35" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39383 } } peers { permanent_uuid: "debc8229474d4f23b8849834eb420c67" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 32883 } } peers { permanent_uuid: "2ee73ebe762945cd8d722e292ecc0506" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40471 } }
I20260808 04:41:08.230049 28928 raft_consensus.cc:374] T 6aabac04ed8f4462bbcb8ad5525d9f5c P debc8229474d4f23b8849834eb420c67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:41:08.230100 28928 raft_consensus.cc:729] T 6aabac04ed8f4462bbcb8ad5525d9f5c P debc8229474d4f23b8849834eb420c67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: debc8229474d4f23b8849834eb420c67, State: Initialized, Role: FOLLOWER
I20260808 04:41:08.230149 28929 ts_tablet_manager.cc:1428] T 6aabac04ed8f4462bbcb8ad5525d9f5c P dca0dc21d84544849a135ee920564b35: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260808 04:41:08.230268 28927 tablet_bootstrap.cc:492] T 6aabac04ed8f4462bbcb8ad5525d9f5c P 2ee73ebe762945cd8d722e292ecc0506: No bootstrap required, opened a new log
I20260808 04:41:08.230456 28927 ts_tablet_manager.cc:1397] T 6aabac04ed8f4462bbcb8ad5525d9f5c P 2ee73ebe762945cd8d722e292ecc0506: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.000s
I20260808 04:41:08.230544 28928 consensus_queue.cc:260] T 6aabac04ed8f4462bbcb8ad5525d9f5c P debc8229474d4f23b8849834eb420c67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca0dc21d84544849a135ee920564b35" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39383 } } peers { permanent_uuid: "debc8229474d4f23b8849834eb420c67" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 32883 } } peers { permanent_uuid: "2ee73ebe762945cd8d722e292ecc0506" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40471 } }
I20260808 04:41:08.231451 28928 ts_tablet_manager.cc:1428] T 6aabac04ed8f4462bbcb8ad5525d9f5c P debc8229474d4f23b8849834eb420c67: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260808 04:41:08.231796 28903 heartbeater.cc:503] Master 127.12.148.126:34445 was elected leader, sending a full tablet report...
I20260808 04:41:08.233876 28927 raft_consensus.cc:348] T 6aabac04ed8f4462bbcb8ad5525d9f5c P 2ee73ebe762945cd8d722e292ecc0506 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca0dc21d84544849a135ee920564b35" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39383 } } peers { permanent_uuid: "debc8229474d4f23b8849834eb420c67" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 32883 } } peers { permanent_uuid: "2ee73ebe762945cd8d722e292ecc0506" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40471 } }
I20260808 04:41:08.234138 28927 raft_consensus.cc:374] T 6aabac04ed8f4462bbcb8ad5525d9f5c P 2ee73ebe762945cd8d722e292ecc0506 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:41:08.234203 28927 raft_consensus.cc:729] T 6aabac04ed8f4462bbcb8ad5525d9f5c P 2ee73ebe762945cd8d722e292ecc0506 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ee73ebe762945cd8d722e292ecc0506, State: Initialized, Role: FOLLOWER
I20260808 04:41:08.234622 28927 consensus_queue.cc:260] T 6aabac04ed8f4462bbcb8ad5525d9f5c P 2ee73ebe762945cd8d722e292ecc0506 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca0dc21d84544849a135ee920564b35" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39383 } } peers { permanent_uuid: "debc8229474d4f23b8849834eb420c67" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 32883 } } peers { permanent_uuid: "2ee73ebe762945cd8d722e292ecc0506" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40471 } }
I20260808 04:41:08.235262 28708 heartbeater.cc:503] Master 127.12.148.126:34445 was elected leader, sending a full tablet report...
I20260808 04:41:08.235472 28927 ts_tablet_manager.cc:1428] T 6aabac04ed8f4462bbcb8ad5525d9f5c P 2ee73ebe762945cd8d722e292ecc0506: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
W20260808 04:41:08.410657 28904 tablet.cc:2369] T 6aabac04ed8f4462bbcb8ad5525d9f5c P debc8229474d4f23b8849834eb420c67: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 04:41:08.447674 28709 tablet.cc:2369] T 6aabac04ed8f4462bbcb8ad5525d9f5c P 2ee73ebe762945cd8d722e292ecc0506: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 04:41:08.477945 28510 tablet.cc:2369] T 6aabac04ed8f4462bbcb8ad5525d9f5c P dca0dc21d84544849a135ee920564b35: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:41:08.686647 28941 raft_consensus.cc:482] T 6aabac04ed8f4462bbcb8ad5525d9f5c P debc8229474d4f23b8849834eb420c67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:41:08.686869 28941 raft_consensus.cc:504] T 6aabac04ed8f4462bbcb8ad5525d9f5c P debc8229474d4f23b8849834eb420c67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca0dc21d84544849a135ee920564b35" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39383 } } peers { permanent_uuid: "debc8229474d4f23b8849834eb420c67" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 32883 } } peers { permanent_uuid: "2ee73ebe762945cd8d722e292ecc0506" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40471 } }
I20260808 04:41:08.688030 28941 leader_election.cc:288] T 6aabac04ed8f4462bbcb8ad5525d9f5c P debc8229474d4f23b8849834eb420c67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dca0dc21d84544849a135ee920564b35 (127.12.148.65:39383), 2ee73ebe762945cd8d722e292ecc0506 (127.12.148.66:40471)
I20260808 04:41:08.691929 28945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:08.688293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:40471 (local address 127.12.148.67:53225)
0808 04:41:08.688660 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:08.688673 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:08.688777 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:08.689020 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:08.689023 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:08.689038 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:41:08.689167 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:08.689174 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.689970 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.689974 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:08.690900 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:08.690910 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.691521 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.691524 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:08.691621 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:08.691645 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 04:41:08.691706 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 04:41:08.691761 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"mutex_wait_us":68,"thread_start_us":92,"threads_started":1}
I20260808 04:41:08.691936 28922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:08.688486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:53225 (local address 127.12.148.66:40471)
0808 04:41:08.688602 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:08.688607 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:08.688754 (+ 147us) server_negotiation.cc:407] Connection header received
0808 04:41:08.688879 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:08.688882 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:08.688936 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:08.688997 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:41:08.689269 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.689868 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.691022 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.691404 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.691511 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:08.691569 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:08.691733 (+ 164us) server_negotiation.cc:299] Negotiation successful
0808 04:41:08.691811 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 04:41:08.691993 28944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:08.688293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:39383 (local address 127.12.148.67:36023)
0808 04:41:08.688719 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:08.688733 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:08.688865 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:08.689117 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:08.689119 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:08.689133 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:41:08.689226 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:08.689232 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.690042 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.690045 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:08.690898 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:08.690907 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.691598 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.691602 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:08.691695 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:08.691719 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 04:41:08.691793 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 04:41:08.691857 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":368,"mutex_wait_us":57,"thread_start_us":63,"threads_started":1}
I20260808 04:41:08.692014 28920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:08.688383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:36023 (local address 127.12.148.65:39383)
0808 04:41:08.688544 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:08.688549 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:08.688852 (+ 303us) server_negotiation.cc:407] Connection header received
0808 04:41:08.688970 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:08.688972 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:08.689024 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:08.689094 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:41:08.689338 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.689937 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.691028 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.691440 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.691553 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:08.691606 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:08.691828 (+ 222us) server_negotiation.cc:299] Negotiation successful
0808 04:41:08.691907 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 04:41:08.692687 28440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6aabac04ed8f4462bbcb8ad5525d9f5c" candidate_uuid: "debc8229474d4f23b8849834eb420c67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dca0dc21d84544849a135ee920564b35" is_pre_election: true
I20260808 04:41:08.692685 28644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6aabac04ed8f4462bbcb8ad5525d9f5c" candidate_uuid: "debc8229474d4f23b8849834eb420c67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ee73ebe762945cd8d722e292ecc0506" is_pre_election: true
I20260808 04:41:08.693019 28644 raft_consensus.cc:2454] T 6aabac04ed8f4462bbcb8ad5525d9f5c P 2ee73ebe762945cd8d722e292ecc0506 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate debc8229474d4f23b8849834eb420c67 in term 0.
I20260808 04:41:08.693019 28440 raft_consensus.cc:2454] T 6aabac04ed8f4462bbcb8ad5525d9f5c P dca0dc21d84544849a135ee920564b35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate debc8229474d4f23b8849834eb420c67 in term 0.
I20260808 04:41:08.693491 28739 leader_election.cc:302] T 6aabac04ed8f4462bbcb8ad5525d9f5c P debc8229474d4f23b8849834eb420c67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dca0dc21d84544849a135ee920564b35, debc8229474d4f23b8849834eb420c67; no voters:
I20260808 04:41:08.693780 28941 raft_consensus.cc:2781] T 6aabac04ed8f4462bbcb8ad5525d9f5c P debc8229474d4f23b8849834eb420c67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:41:08.693873 28941 raft_consensus.cc:482] T 6aabac04ed8f4462bbcb8ad5525d9f5c P debc8229474d4f23b8849834eb420c67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:41:08.693922 28941 raft_consensus.cc:3037] T 6aabac04ed8f4462bbcb8ad5525d9f5c P debc8229474d4f23b8849834eb420c67 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:41:08.694957 28941 raft_consensus.cc:504] T 6aabac04ed8f4462bbcb8ad5525d9f5c P debc8229474d4f23b8849834eb420c67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca0dc21d84544849a135ee920564b35" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39383 } } peers { permanent_uuid: "debc8229474d4f23b8849834eb420c67" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 32883 } } peers { permanent_uuid: "2ee73ebe762945cd8d722e292ecc0506" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40471 } }
I20260808 04:41:08.695276 28941 leader_election.cc:288] T 6aabac04ed8f4462bbcb8ad5525d9f5c P debc8229474d4f23b8849834eb420c67 [CANDIDATE]: Term 1 election: Requested vote from peers dca0dc21d84544849a135ee920564b35 (127.12.148.65:39383), 2ee73ebe762945cd8d722e292ecc0506 (127.12.148.66:40471)
I20260808 04:41:08.695617 28440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6aabac04ed8f4462bbcb8ad5525d9f5c" candidate_uuid: "debc8229474d4f23b8849834eb420c67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dca0dc21d84544849a135ee920564b35"
I20260808 04:41:08.695632 28644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6aabac04ed8f4462bbcb8ad5525d9f5c" candidate_uuid: "debc8229474d4f23b8849834eb420c67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ee73ebe762945cd8d722e292ecc0506"
I20260808 04:41:08.695726 28440 raft_consensus.cc:3037] T 6aabac04ed8f4462bbcb8ad5525d9f5c P dca0dc21d84544849a135ee920564b35 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:41:08.695746 28644 raft_consensus.cc:3037] T 6aabac04ed8f4462bbcb8ad5525d9f5c P 2ee73ebe762945cd8d722e292ecc0506 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:41:08.696686 28440 raft_consensus.cc:2454] T 6aabac04ed8f4462bbcb8ad5525d9f5c P dca0dc21d84544849a135ee920564b35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate debc8229474d4f23b8849834eb420c67 in term 1.
I20260808 04:41:08.696750 28644 raft_consensus.cc:2454] T 6aabac04ed8f4462bbcb8ad5525d9f5c P 2ee73ebe762945cd8d722e292ecc0506 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate debc8229474d4f23b8849834eb420c67 in term 1.
I20260808 04:41:08.696941 28739 leader_election.cc:302] T 6aabac04ed8f4462bbcb8ad5525d9f5c P debc8229474d4f23b8849834eb420c67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dca0dc21d84544849a135ee920564b35, debc8229474d4f23b8849834eb420c67; no voters:
I20260808 04:41:08.697096 28941 raft_consensus.cc:2781] T 6aabac04ed8f4462bbcb8ad5525d9f5c P debc8229474d4f23b8849834eb420c67 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:41:08.697289 28941 raft_consensus.cc:686] T 6aabac04ed8f4462bbcb8ad5525d9f5c P debc8229474d4f23b8849834eb420c67 [term 1 LEADER]: Becoming Leader. State: Replica: debc8229474d4f23b8849834eb420c67, State: Running, Role: LEADER
I20260808 04:41:08.697625 28941 consensus_queue.cc:237] T 6aabac04ed8f4462bbcb8ad5525d9f5c P debc8229474d4f23b8849834eb420c67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca0dc21d84544849a135ee920564b35" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39383 } } peers { permanent_uuid: "debc8229474d4f23b8849834eb420c67" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 32883 } } peers { permanent_uuid: "2ee73ebe762945cd8d722e292ecc0506" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40471 } }
I20260808 04:41:08.700942 28205 catalog_manager.cc:5495] T 6aabac04ed8f4462bbcb8ad5525d9f5c P debc8229474d4f23b8849834eb420c67 reported cstate change: term changed from 0 to 1, leader changed from <none> to debc8229474d4f23b8849834eb420c67 (127.12.148.67). New cstate: current_term: 1 leader_uuid: "debc8229474d4f23b8849834eb420c67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca0dc21d84544849a135ee920564b35" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "debc8229474d4f23b8849834eb420c67" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 32883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ee73ebe762945cd8d722e292ecc0506" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40471 } health_report { overall_health: UNKNOWN } } }
I20260808 04:41:08.767144 28958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:08.763530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43546 (local address 127.12.148.67:32883)
0808 04:41:08.763733 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:08.763736 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:08.763750 (+ 14us) server_negotiation.cc:407] Connection header received
0808 04:41:08.763880 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:08.763882 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:08.763948 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:08.764045 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:41:08.764234 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.764813 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.765710 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:08.765971 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:08.766050 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:08.766341 (+ 291us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:41:08.766777 (+ 436us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:41:08.766867 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:08.766971 (+ 104us) server_negotiation.cc:299] Negotiation successful
0808 04:41:08.767019 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":68,"threads_started":1}
I20260808 04:41:08.772950 28440 raft_consensus.cc:1261] T 6aabac04ed8f4462bbcb8ad5525d9f5c P dca0dc21d84544849a135ee920564b35 [term 1 FOLLOWER]: Refusing update from remote peer debc8229474d4f23b8849834eb420c67: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:41:08.772950 28644 raft_consensus.cc:1261] T 6aabac04ed8f4462bbcb8ad5525d9f5c P 2ee73ebe762945cd8d722e292ecc0506 [term 1 FOLLOWER]: Refusing update from remote peer debc8229474d4f23b8849834eb420c67: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:41:08.773805 28947 consensus_queue.cc:1035] T 6aabac04ed8f4462bbcb8ad5525d9f5c P debc8229474d4f23b8849834eb420c67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dca0dc21d84544849a135ee920564b35" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 39383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:41:08.773991 28941 consensus_queue.cc:1035] T 6aabac04ed8f4462bbcb8ad5525d9f5c P debc8229474d4f23b8849834eb420c67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ee73ebe762945cd8d722e292ecc0506" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:41:08.780748 28965 mvcc.cc:205] Tried to move back new op lower bound from 7316128025686388736 to 7316128025388122112. Current Snapshot: MvccSnapshot[applied={T|T < 7316128025686388736}]
I20260808 04:41:08.781790 28964 mvcc.cc:205] Tried to move back new op lower bound from 7316128025686388736 to 7316128025388122112. Current Snapshot: MvccSnapshot[applied={T|T < 7316128025686388736}]
I20260808 04:41:08.788161 28205 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52628:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:41:08.788303 28205 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52628:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:41:08.790526 28205 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8a4ffb7d1f7441a4bacc9ad364b5b713: Sending DeleteTablet for 3 replicas of tablet 6aabac04ed8f4462bbcb8ad5525d9f5c
I20260808 04:41:08.791208 28406 tablet_service.cc:1514] Processing DeleteTablet for tablet 6aabac04ed8f4462bbcb8ad5525d9f5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:41:08 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:36786
I20260808 04:41:08.791304 28611 tablet_service.cc:1514] Processing DeleteTablet for tablet 6aabac04ed8f4462bbcb8ad5525d9f5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:41:08 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:59012
I20260808 04:41:08.791368 28805 tablet_service.cc:1514] Processing DeleteTablet for tablet 6aabac04ed8f4462bbcb8ad5525d9f5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:41:08 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:43544
I20260808 04:41:08.791822 28976 tablet_replica.cc:330] T 6aabac04ed8f4462bbcb8ad5525d9f5c P debc8229474d4f23b8849834eb420c67: stopping tablet replica
I20260808 04:41:08.792119 28976 raft_consensus.cc:2229] T 6aabac04ed8f4462bbcb8ad5525d9f5c P debc8229474d4f23b8849834eb420c67 [term 1 LEADER]: Raft consensus shutting down.
I20260808 04:41:08.792297 28974 tablet_replica.cc:330] T 6aabac04ed8f4462bbcb8ad5525d9f5c P dca0dc21d84544849a135ee920564b35: stopping tablet replica
I20260808 04:41:08.792469 28976 raft_consensus.cc:2258] T 6aabac04ed8f4462bbcb8ad5525d9f5c P debc8229474d4f23b8849834eb420c67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:41:08.792675 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 28316
I20260808 04:41:08.792706 28974 raft_consensus.cc:2229] T 6aabac04ed8f4462bbcb8ad5525d9f5c P dca0dc21d84544849a135ee920564b35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:41:08.793757 28976 ts_tablet_manager.cc:1905] T 6aabac04ed8f4462bbcb8ad5525d9f5c P debc8229474d4f23b8849834eb420c67: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:41:08.796047 28976 ts_tablet_manager.cc:1918] T 6aabac04ed8f4462bbcb8ad5525d9f5c P debc8229474d4f23b8849834eb420c67: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:41:08.796125 28976 log.cc:1196] T 6aabac04ed8f4462bbcb8ad5525d9f5c P debc8229474d4f23b8849834eb420c67: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-2/wal/wals/6aabac04ed8f4462bbcb8ad5525d9f5c
I20260808 04:41:08.796355 28976 ts_tablet_manager.cc:1939] T 6aabac04ed8f4462bbcb8ad5525d9f5c P debc8229474d4f23b8849834eb420c67: Deleting consensus metadata
I20260808 04:41:08.797297 28181 catalog_manager.cc:4841] TS debc8229474d4f23b8849834eb420c67 (127.12.148.67:32883): tablet 6aabac04ed8f4462bbcb8ad5525d9f5c (table test-table [id=3d16a2e006434a83907be8043aa39ea1]) successfully deleted
I20260808 04:41:08.791952 28975 tablet_replica.cc:330] T 6aabac04ed8f4462bbcb8ad5525d9f5c P 2ee73ebe762945cd8d722e292ecc0506: stopping tablet replica
I20260808 04:41:08.801834 28975 raft_consensus.cc:2229] T 6aabac04ed8f4462bbcb8ad5525d9f5c P 2ee73ebe762945cd8d722e292ecc0506 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:41:08.802153 28975 raft_consensus.cc:2258] T 6aabac04ed8f4462bbcb8ad5525d9f5c P 2ee73ebe762945cd8d722e292ecc0506 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:41:08.803469 28975 ts_tablet_manager.cc:1905] T 6aabac04ed8f4462bbcb8ad5525d9f5c P 2ee73ebe762945cd8d722e292ecc0506: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:41:08.806074 28975 ts_tablet_manager.cc:1918] T 6aabac04ed8f4462bbcb8ad5525d9f5c P 2ee73ebe762945cd8d722e292ecc0506: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:41:08.806171 28975 log.cc:1196] T 6aabac04ed8f4462bbcb8ad5525d9f5c P 2ee73ebe762945cd8d722e292ecc0506: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786164004017495-12881-0/minicluster-data/ts-1/wal/wals/6aabac04ed8f4462bbcb8ad5525d9f5c
I20260808 04:41:08.806493 28975 ts_tablet_manager.cc:1939] T 6aabac04ed8f4462bbcb8ad5525d9f5c P 2ee73ebe762945cd8d722e292ecc0506: Deleting consensus metadata
W20260808 04:41:08.807106 28182 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.148.65:39383 (error 108)
I20260808 04:41:08.807338 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 28517
I20260808 04:41:08.817802 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 28714
I20260808 04:41:08.817978 28980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:08.807884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:39383 (local address 127.0.0.1:36800)
0808 04:41:08.817770 (+ 9886us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:08.817860 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.65:39383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":9793,"thread_start_us":942,"threads_started":1}
I20260808 04:41:08.819795 28980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:08.818137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:40471 (local address 127.0.0.1:59014)
0808 04:41:08.819660 (+ 1523us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:08.819720 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.66:40471: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1439}
W20260808 04:41:08.819989 28181 catalog_manager.cc:4584] TS 2ee73ebe762945cd8d722e292ecc0506 (127.12.148.66:40471): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6aabac04ed8f4462bbcb8ad5525d9f5c: Network error: Client connection negotiation failed: client connection to 127.12.148.66:40471: connect: Connection refused (error 111)
I20260808 04:41:08.826611 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 28160
2026-08-08T04:41:08Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2897 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:41:08 dist-test-slave-t7g5 krb5kdc[28983](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:41:08 dist-test-slave-t7g5 krb5kdc[28983](info): set up 2 sockets
Aug 08 04:41:08 dist-test-slave-t7g5 krb5kdc[28983](info): commencing operation
krb5kdc: starting...
W20260808 04:41:09.971664 12881 mini_kdc.cc:121] Time spent starting KDC: real 1.118s user 0.007s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Aug 08 04:41:10 dist-test-slave-t7g5 krb5kdc[28983](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164070, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:41:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:41:10Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.12.148.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.12.148.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.12.148.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/krb5kdc/rangeradmin_127.12.148.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.12.148.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/krb5kdc/rangeradmin_127.12.148.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.12.148.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.12.148.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.12.148.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/krb5kdc/rangerlookup_127.12.148.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.12.148.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/krb5kdc/rangerlookup_127.12.148.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.148.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.12.148.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.148.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/krb5kdc/HTTP_127.12.148.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.148.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/krb5kdc/HTTP_127.12.148.84@KRBTEST.COM.keytab.
I20260808 04:41:10.145046 12881 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskMuxZs2/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/postgres -l logfile start
2026-08-08 04:41:12.478 UTC [29033] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 04:41:12.478 UTC [29033] LOG: listening on IPv4 address "127.12.148.84", port 35439
2026-08-08 04:41:12.482 UTC [29033] LOG: listening on Unix socket "/tmp/.s.PGSQL.35439"
2026-08-08 04:41:12.502 UTC [29036] LOG: database system was shut down at 2026-08-08 04:41:11 UTC
2026-08-08 04:41:12.506 UTC [29033] LOG: database system is ready to accept connections
I20260808 04:41:13.558867 12881 mini_postgres.cc:96] Postgres bound to 35439
2026-08-08 04:41:13.566 UTC [29047] FATAL: database "slave" does not exist
127.12.148.84:35439 - accepting connections
I20260808 04:41:13.567593 12881 mini_ranger.cc:161] Starting Ranger...
I20260808 04:41:13.583276 12881 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 04:41:14.004822 12881 mini_ranger.cc:87] Created ranger Postgres database
I20260808 04:41:14.004928 12881 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ranger-admin
2026-08-08 04:41:14,325 [I] DB FLAVOR :POSTGRES
2026-08-08 04:41:14,325 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 04:41:14,326 [I] Checking connection..
2026-08-08 04:41:14,326 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:35439/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 04:41:14,596 [I] Checking connection passed.
2026-08-08 04:41:14,597 [I] --------- Verifying version history table ---------
2026-08-08 04:41:14,597 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:35439/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 04:41:14,834 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 04:41:14,835 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:35439/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 04:41:15,095 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 04:41:15,095 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 04:41:15,095 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:35439/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 04:41:15.347 UTC [29147] WARNING: there is no transaction in progress
2026-08-08 04:41:15,355 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 04:41:15,356 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:35439/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 04:41:15,595 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 04:41:15,595 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 04:41:15,595 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:35439/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 04:41:15,836 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:35439/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 04:41:16,075 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:35439/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-t7g5.c.gcp-upstream.internal','N') ;"
2026-08-08 04:41:16,309 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:35439/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 04:41:16,565 [I] Table x_portal_user does not exist in database ranger
2026-08-08 04:41:16,565 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:35439/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 04:41:16,811 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 04:41:16,812 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:35439/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 04:41:17,080 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:35439/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 04:41:17,316 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 04:41:17,317 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:35439/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 04:41:18.238 UTC [29298] WARNING: there is no transaction in progress
2026-08-08 04:41:18.253 UTC [29298] WARNING: there is no transaction in progress
2026-08-08 04:41:18.269 UTC [29298] WARNING: there is no transaction in progress
2026-08-08 04:41:18.284 UTC [29298] WARNING: there is no transaction in progress
2026-08-08 04:41:18.303 UTC [29298] WARNING: there is no transaction in progress
2026-08-08 04:41:18.320 UTC [29298] WARNING: there is no transaction in progress
2026-08-08 04:41:18.375 UTC [29298] WARNING: there is no transaction in progress
2026-08-08 04:41:18.381 UTC [29298] WARNING: there is no transaction in progress
2026-08-08 04:41:18.394 UTC [29298] WARNING: there is no transaction in progress
2026-08-08 04:41:18.403 UTC [29298] WARNING: there is no transaction in progress
2026-08-08 04:41:18.413 UTC [29298] WARNING: there is no transaction in progress
2026-08-08 04:41:18.426 UTC [29298] WARNING: there is no transaction in progress
2026-08-08 04:41:18.434 UTC [29298] WARNING: there is no transaction in progress
2026-08-08 04:41:18.440 UTC [29298] WARNING: there is no transaction in progress
2026-08-08 04:41:18.446 UTC [29298] WARNING: there is no transaction in progress
2026-08-08 04:41:18.452 UTC [29298] WARNING: there is no transaction in progress
2026-08-08 04:41:19,036 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 04:41:19,036 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:35439/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 04:41:19,287 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 04:41:19,287 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:35439/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 04:41:19,547 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 04:41:19,547 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:35439/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 04:41:19,788 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 04:41:19,788 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:35439/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 04:41:20,027 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:35439/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 04:41:20,273 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:35439/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-t7g5.c.gcp-upstream.internal';"
2026-08-08 04:41:20,517 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 04:41:20,517 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:35439/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 04:41:20,777 [I] DB_PATCHES have already been applied
I20260808 04:41:20.783289 12881 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ranger-admin:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskMuxZs2/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 04:41:20.783356 12881 mini_ranger.cc:193] Using host: 127.12.148.84
I20260808 04:41:20.787827 12881 mini_ranger.cc:227] Ranger admin URL: http://127.12.148.84:46635
Aug 08, 2026 4:41:21 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 4:41:21 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 4:41:21 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 4:41:21 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 4:41:21 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 4:41:21 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 4:41:21 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 04:41:22.005069 12881 mini_ranger.cc:160] Time spent starting Ranger: real 8.437s user 0.006s sys 0.006s
Aug 08, 2026 4:41:42 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 4:41:42 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 08, 2026 4:41:42 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 4:41:42 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 4:41:42 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 4:41:42 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 4:41:42 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 4:41:42 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 4:41:42 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 4:41:42 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 4:41:42 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 4:41:42 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 4:41:42 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 4:41:42 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 4:41:42 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 4:41:42 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 4:41:42 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 4:41:43 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 04:41:44.061168 12881 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.12.148.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.12.148.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.12.148.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/krb5kdc/rangerkms_127.12.148.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.12.148.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/krb5kdc/rangerkms_127.12.148.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.148.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.12.148.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.148.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/krb5kdc/HTTP_127.12.148.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.148.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/krb5kdc/HTTP_127.12.148.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 04:41:44 dist-test-slave-t7g5 krb5kdc[28983](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164104, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 04:41:44.149209 12881 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 04:41:44.158743 12881 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 04:41:44.976229 12881 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 04:41:44.976321 12881 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ranger-kms
I20260808 04:41:44.976416 12881 mini_ranger_kms.cc:227] Using postgres at 127.12.148.84:35439
2026-08-08 04:41:45,254 [I] DB FLAVOR :POSTGRES
2026-08-08 04:41:45,255 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 04:41:45,255 [I] Checking connection
2026-08-08 04:41:45,255 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:35439/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 04:41:45,493 [I] connection success
2026-08-08 04:41:45,494 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 04:41:45,494 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 04:41:45,494 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:35439/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 04:41:45,729 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 04:41:45,729 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 04:41:45,729 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 04:41:45,729 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:35439/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 04:41:45,986 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 04:41:46.425828 12881 mini_ranger_kms.cc:310] Created kms service
I20260808 04:41:46.655611 12881 mini_ranger_kms.cc:326] Created kudu user
I20260808 04:41:46.696285 12881 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 04:41:46 dist-test-slave-t7g5 krb5kdc[28983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164104, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.12.148.84@KRBTEST.COM
I20260808 04:41:47.078452 12881 mini_ranger_kms.cc:384] Added ranger policy
I20260808 04:41:47.078608 12881 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ranger-kms:/tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 04:41:47.078629 12881 mini_ranger_kms.cc:240] Using host: 127.12.148.84
I20260808 04:41:47.083343 12881 mini_ranger_kms.cc:276] Ranger KMS PID: 29560
I20260808 04:41:47.083492 12881 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.12.148.84:37793
Aug 08, 2026 4:41:48 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 4:41:48 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 4:41:48 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 4:41:48 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 4:41:48 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 4:41:48 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 08 04:41:49 dist-test-slave-t7g5 krb5kdc[28983](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786164109, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.148.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:41:49.619330 12881 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.470s user 0.011s sys 0.251s
I20260808 04:41:49.619455 12881 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 04:41:49.619568 12881 mini_ranger_kms.cc:401] 127.12.148.84:37793/kms/v1/keys
Aug 08 04:41:49 dist-test-slave-t7g5 krb5kdc[28983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164109, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.148.84@KRBTEST.COM for HTTP/127.12.148.84@KRBTEST.COM
Aug 08 04:41:50 dist-test-slave-t7g5 krb5kdc[28983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164109, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.148.84@KRBTEST.COM for HTTP/127.12.148.84@KRBTEST.COM
Aug 08 04:41:52 dist-test-slave-t7g5 krb5kdc[28983](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164112, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.12.148.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
I20260808 04:41:52.568701 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:41499
--webserver_interface=127.12.148.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:36791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:41499
--ranger_config_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.148.84:37793/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:41:52.706967 29639 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:41:52.707243 29639 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:41:52.707300 29639 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:41:52.711246 29639 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:41:52.711313 29639 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:41:52.711338 29639 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:41:52.711361 29639 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:41:52.711390 29639 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:41:52.716789 29639 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:36791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/master-0/wal
--ranger_kms_url=127.12.148.84:37793/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:41499
--ranger_config_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:41499
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29639
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:41:52.717867 29639 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:41:52.718858 29639 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:41:52.728538 29650 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:52.728633 29653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:52.728538 29651 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:41:52.728942 29639 server_base.cc:1034] running on GCE node
I20260808 04:41:52.729491 29639 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:41:52.730592 29639 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:41:52.731768 29639 hybrid_clock.cc:648] HybridClock initialized: now 1786164112731742 us; error 41 us; skew 500 ppm
Aug 08 04:41:52 dist-test-slave-t7g5 krb5kdc[28983](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164112, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:41:52.737012 29639 init.cc:377] Logged in from keytab as kudu/127.12.148.126@KRBTEST.COM (short username kudu)
I20260808 04:41:52.737982 29639 webserver.cc:460] Webserver started at http://127.12.148.126:44827/ using document root <none> and password file <none>
I20260808 04:41:52.738514 29639 fs_manager.cc:359] Metadata directory not provided
I20260808 04:41:52.738569 29639 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:41:52.738762 29639 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 04:41:52 dist-test-slave-t7g5 krb5kdc[28983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164112, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for HTTP/127.12.148.84@KRBTEST.COM
I20260808 04:41:52.798689 29639 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "ac8af18b7ba843bca2024647bbdd9d4b"
format_stamp: "Formatted at 2026-08-08 04:41:52 on dist-test-slave-t7g5"
server_key: "52de96eedc5150ff9cd35400b585f43b"
server_key_iv: "5abc14736ed58ef9281c570920533f3d"
server_key_version: "kuduclusterkey@0"
I20260808 04:41:52.799422 29639 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "ac8af18b7ba843bca2024647bbdd9d4b"
format_stamp: "Formatted at 2026-08-08 04:41:52 on dist-test-slave-t7g5"
server_key: "52de96eedc5150ff9cd35400b585f43b"
server_key_iv: "5abc14736ed58ef9281c570920533f3d"
server_key_version: "kuduclusterkey@0"
I20260808 04:41:52.803328 29639 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260808 04:41:52.817746 29667 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:52.819185 29639 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 04:41:52.819320 29639 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "ac8af18b7ba843bca2024647bbdd9d4b"
format_stamp: "Formatted at 2026-08-08 04:41:52 on dist-test-slave-t7g5"
server_key: "52de96eedc5150ff9cd35400b585f43b"
server_key_iv: "5abc14736ed58ef9281c570920533f3d"
server_key_version: "kuduclusterkey@0"
I20260808 04:41:52.819451 29639 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:41:52.834270 29639 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:41:52.836954 29639 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:41:52.837131 29639 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:41:52.844959 29639 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:41499
I20260808 04:41:52.845016 29753 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:41499 every 8 connection(s)
I20260808 04:41:52.845989 29639 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:41:52.847558 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 29639
I20260808 04:41:52.847681 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:41:52.847954 12881 external_mini_cluster.cc:1428] Setting key 78f4bcc4f67b7ad5b6f97e2a9fafde11
I20260808 04:41:52.849588 29755 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:41:52.856956 29755 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac8af18b7ba843bca2024647bbdd9d4b: Bootstrap starting.
I20260808 04:41:52.859789 29755 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ac8af18b7ba843bca2024647bbdd9d4b: Neither blocks nor log segments found. Creating new log.
Aug 08 04:41:52 dist-test-slave-t7g5 krb5kdc[28983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164112, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:41:52.860790 29755 log.cc:824] T 00000000000000000000000000000000 P ac8af18b7ba843bca2024647bbdd9d4b: Log is configured to *not* fsync() on all Append() calls
I20260808 04:41:52.863515 29755 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac8af18b7ba843bca2024647bbdd9d4b: No bootstrap required, opened a new log
I20260808 04:41:52.866930 29761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:52.849239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48402 (local address 127.12.148.126:41499)
0808 04:41:52.849631 (+ 392us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:52.849688 (+ 57us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:52.853326 (+ 3638us) server_negotiation.cc:407] Connection header received
0808 04:41:52.854172 (+ 846us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:52.854192 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:52.854532 (+ 340us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:52.854857 (+ 325us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:52.855728 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:52.856744 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:52.857730 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:52.858228 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:52.858428 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:52.860855 (+ 2427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:41:52.860862 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:41:52.860876 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:41:52.860910 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:41:52.863619 (+ 2709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:41:52.864135 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:41:52.864141 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:41:52.864147 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:41:52.864286 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:41:52.864564 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:41:52.864568 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:41:52.864569 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:41:52.865079 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:41:52.865282 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:52.865578 (+ 296us) server_negotiation.cc:299] Negotiation successful
0808 04:41:52.865942 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":118,"threads_started":1}
I20260808 04:41:52.867584 29755 raft_consensus.cc:348] T 00000000000000000000000000000000 P ac8af18b7ba843bca2024647bbdd9d4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac8af18b7ba843bca2024647bbdd9d4b" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41499 } }
I20260808 04:41:52.867851 29755 raft_consensus.cc:374] T 00000000000000000000000000000000 P ac8af18b7ba843bca2024647bbdd9d4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:41:52.867951 29755 raft_consensus.cc:729] T 00000000000000000000000000000000 P ac8af18b7ba843bca2024647bbdd9d4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac8af18b7ba843bca2024647bbdd9d4b, State: Initialized, Role: FOLLOWER
I20260808 04:41:52.868453 29755 consensus_queue.cc:260] T 00000000000000000000000000000000 P ac8af18b7ba843bca2024647bbdd9d4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac8af18b7ba843bca2024647bbdd9d4b" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41499 } }
I20260808 04:41:52.868574 29755 raft_consensus.cc:388] T 00000000000000000000000000000000 P ac8af18b7ba843bca2024647bbdd9d4b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:41:52.868613 29755 raft_consensus.cc:482] T 00000000000000000000000000000000 P ac8af18b7ba843bca2024647bbdd9d4b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:41:52.868677 29755 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ac8af18b7ba843bca2024647bbdd9d4b [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:41:52.869741 29755 raft_consensus.cc:504] T 00000000000000000000000000000000 P ac8af18b7ba843bca2024647bbdd9d4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac8af18b7ba843bca2024647bbdd9d4b" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41499 } }
I20260808 04:41:52.870077 29755 leader_election.cc:302] T 00000000000000000000000000000000 P ac8af18b7ba843bca2024647bbdd9d4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ac8af18b7ba843bca2024647bbdd9d4b; no voters:
I20260808 04:41:52.870388 29755 leader_election.cc:288] T 00000000000000000000000000000000 P ac8af18b7ba843bca2024647bbdd9d4b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:41:52.870518 29763 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ac8af18b7ba843bca2024647bbdd9d4b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:41:52.870743 29763 raft_consensus.cc:686] T 00000000000000000000000000000000 P ac8af18b7ba843bca2024647bbdd9d4b [term 1 LEADER]: Becoming Leader. State: Replica: ac8af18b7ba843bca2024647bbdd9d4b, State: Running, Role: LEADER
I20260808 04:41:52.871107 29763 consensus_queue.cc:237] T 00000000000000000000000000000000 P ac8af18b7ba843bca2024647bbdd9d4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac8af18b7ba843bca2024647bbdd9d4b" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41499 } }
I20260808 04:41:52.871615 29755 sys_catalog.cc:564] T 00000000000000000000000000000000 P ac8af18b7ba843bca2024647bbdd9d4b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:41:52.872340 29763 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac8af18b7ba843bca2024647bbdd9d4b [sys.catalog]: SysCatalogTable state changed. Reason: New leader ac8af18b7ba843bca2024647bbdd9d4b. Latest consensus state: current_term: 1 leader_uuid: "ac8af18b7ba843bca2024647bbdd9d4b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac8af18b7ba843bca2024647bbdd9d4b" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41499 } } }
I20260808 04:41:52.872457 29763 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac8af18b7ba843bca2024647bbdd9d4b [sys.catalog]: This master's current role is: LEADER
I20260808 04:41:52.873420 29772 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:41:52.874843 29764 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac8af18b7ba843bca2024647bbdd9d4b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ac8af18b7ba843bca2024647bbdd9d4b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac8af18b7ba843bca2024647bbdd9d4b" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41499 } } }
I20260808 04:41:52.874940 29764 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac8af18b7ba843bca2024647bbdd9d4b [sys.catalog]: This master's current role is: LEADER
I20260808 04:41:52.876703 29772 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:41:52.877226 29755 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 04:41:52.885878 29772 catalog_manager.cc:1347] Generated new cluster ID: 4b0767227b6c41cfb34f19738a91eba2
I20260808 04:41:52.885955 29772 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:41:52.906478 29772 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:41:52.907490 29772 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:41:52.912030 29772 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ac8af18b7ba843bca2024647bbdd9d4b: Generated new TSK 0
I20260808 04:41:52.913005 29772 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.148.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab.
Entry for principal kudu/127.12.148.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab.
I20260808 04:41:53.624294 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.148.84:37793/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.65:0
--local_ip_for_outbound_sockets=127.12.148.65
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:41499
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:36791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:41:53.762844 29822 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:41:53.763259 29822 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:41:53.763339 29822 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:41:53.769021 29822 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:41:53.769093 29822 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:41:53.769176 29822 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.65
I20260808 04:41:53.775810 29822 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:36791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.12.148.84:37793/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:41499
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29822
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.65
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:41:53.776872 29822 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:41:53.777949 29822 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:41:53.787806 29836 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:53.787808 29832 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:53.788112 29831 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:41:53.788499 29822 server_base.cc:1034] running on GCE node
I20260808 04:41:53.788894 29822 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:41:53.789520 29822 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:41:53.790694 29822 hybrid_clock.cc:648] HybridClock initialized: now 1786164113790667 us; error 43 us; skew 500 ppm
Aug 08 04:41:53 dist-test-slave-t7g5 krb5kdc[28983](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164113, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:41:53.793437 29822 init.cc:377] Logged in from keytab as kudu/127.12.148.65@KRBTEST.COM (short username kudu)
I20260808 04:41:53.794546 29822 webserver.cc:460] Webserver started at http://127.12.148.65:33233/ using document root <none> and password file <none>
I20260808 04:41:53.795266 29822 fs_manager.cc:359] Metadata directory not provided
I20260808 04:41:53.795359 29822 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:41:53.795617 29822 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 04:41:53 dist-test-slave-t7g5 krb5kdc[28983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164113, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for HTTP/127.12.148.84@KRBTEST.COM
I20260808 04:41:53.814551 29822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-0/data/instance:
uuid: "27444b71a04941348f7a636f8ae2f2be"
format_stamp: "Formatted at 2026-08-08 04:41:53 on dist-test-slave-t7g5"
server_key: "533776c5427c142758609ad0aaf120d7"
server_key_iv: "6cfdd38c35edb70583d528a7b8850bf6"
server_key_version: "kuduclusterkey@0"
I20260808 04:41:53.815217 29822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance:
uuid: "27444b71a04941348f7a636f8ae2f2be"
format_stamp: "Formatted at 2026-08-08 04:41:53 on dist-test-slave-t7g5"
server_key: "533776c5427c142758609ad0aaf120d7"
server_key_iv: "6cfdd38c35edb70583d528a7b8850bf6"
server_key_version: "kuduclusterkey@0"
I20260808 04:41:53.819482 29822 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 04:41:53.845234 29850 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:53.847093 29822 fs_manager.cc:725] Time spent opening block manager: real 0.011s user 0.002s sys 0.000s
I20260808 04:41:53.847337 29822 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-0/wal
uuid: "27444b71a04941348f7a636f8ae2f2be"
format_stamp: "Formatted at 2026-08-08 04:41:53 on dist-test-slave-t7g5"
server_key: "533776c5427c142758609ad0aaf120d7"
server_key_iv: "6cfdd38c35edb70583d528a7b8850bf6"
server_key_version: "kuduclusterkey@0"
I20260808 04:41:53.847597 29822 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:41:53.872220 29822 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:41:53.876118 29822 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:41:53.876422 29822 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:41:53.877298 29822 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:41:53.878553 29822 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:41:53.878675 29822 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:53.878837 29822 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:41:53.878934 29822 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:53.890447 29822 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.65:37929
I20260808 04:41:53.890496 30019 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.65:37929 every 8 connection(s)
I20260808 04:41:53.891527 29822 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
I20260808 04:41:53.894598 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 29822
I20260808 04:41:53.894745 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance
I20260808 04:41:53.895105 12881 external_mini_cluster.cc:1428] Setting key 791d5cef68563e0d724ab0fa80db0afd
Aug 08 04:41:53 dist-test-slave-t7g5 krb5kdc[28983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164113, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.148.66@KRBTEST.COM; defaulting to no policy
I20260808 04:41:53.908551 30023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:53.894101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41499 (local address 127.12.148.65:60705)
0808 04:41:53.894591 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:53.894648 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:53.895669 (+ 1021us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:53.896329 (+ 660us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:53.896337 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:53.896707 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:53.897236 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:53.897251 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:53.898256 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:53.898260 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:53.899369 (+ 1109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:53.899380 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:53.900008 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:53.900012 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:53.900209 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:53.900975 (+ 766us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:41:53.900994 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:53.902757 (+ 1763us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:41:53.904943 (+ 2186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:41:53.904950 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:41:53.904967 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:41:53.905386 (+ 419us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:41:53.905731 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:41:53.905735 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:41:53.905737 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:41:53.905936 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:41:53.906421 (+ 485us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:41:53.906429 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:41:53.906776 (+ 347us) client_negotiation.cc:769] Sending connection context
0808 04:41:53.907011 (+ 235us) client_negotiation.cc:240] Negotiation successful
0808 04:41:53.907373 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":120,"threads_started":1}
I20260808 04:41:53.909472 30024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:53.895088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:60705 (local address 127.12.148.126:41499)
0808 04:41:53.895427 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:53.895438 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:53.895478 (+ 40us) server_negotiation.cc:407] Connection header received
0808 04:41:53.895923 (+ 445us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:53.895928 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:53.895990 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:53.896104 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:53.897386 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:53.898116 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:53.899519 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:53.899842 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:53.900740 (+ 898us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:53.902944 (+ 2204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:41:53.902949 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:41:53.902951 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:41:53.902980 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:41:53.904805 (+ 1825us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:41:53.905507 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:41:53.905510 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:41:53.905512 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:41:53.905608 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:41:53.906049 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:41:53.906052 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:41:53.906054 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:41:53.906299 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:41:53.906403 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:53.909067 (+ 2664us) server_negotiation.cc:299] Negotiation successful
0808 04:41:53.909278 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":266,"thread_start_us":127,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.66@KRBTEST.COM" created.
I20260808 04:41:53.910691 30020 heartbeater.cc:347] Connected to a master server at 127.12.148.126:41499
I20260808 04:41:53.911022 30020 heartbeater.cc:464] Registering TS with master...
I20260808 04:41:53.911720 30020 heartbeater.cc:511] Master 127.12.148.126:41499 requested a full tablet report, sending...
I20260808 04:41:53.913554 29691 ts_manager.cc:194] Registered new tserver with Master: 27444b71a04941348f7a636f8ae2f2be (127.12.148.65:37929)
I20260808 04:41:53.914793 29691 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.65@KRBTEST.COM'} at 127.12.148.65:60705
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab.
Entry for principal kudu/127.12.148.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab.
I20260808 04:41:53.928540 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.148.84:37793/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.66:0
--local_ip_for_outbound_sockets=127.12.148.66
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:41499
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:36791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 04:41:53 dist-test-slave-t7g5 krb5kdc[28983](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786164113, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 04:41:54.082038 30032 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:41:54.082434 30032 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:41:54.082507 30032 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:41:54.088464 30032 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:41:54.088594 30032 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:41:54.088716 30032 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.66
I20260808 04:41:54.094925 30032 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:36791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.12.148.84:37793/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:41499
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30032
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.66
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:41:54.096009 30032 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:41:54.097007 30032 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:41:54.106453 30044 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:54.106467 30052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:41:54.107192 30032 server_base.cc:1034] running on GCE node
W20260808 04:41:54.106580 30046 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:41:54.110131 30032 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:41:54.110785 30032 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:41:54.111958 30032 hybrid_clock.cc:648] HybridClock initialized: now 1786164114111932 us; error 41 us; skew 500 ppm
Aug 08 04:41:54 dist-test-slave-t7g5 krb5kdc[28983](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164114, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:41:54.114766 30032 init.cc:377] Logged in from keytab as kudu/127.12.148.66@KRBTEST.COM (short username kudu)
I20260808 04:41:54.115731 30032 webserver.cc:460] Webserver started at http://127.12.148.66:35879/ using document root <none> and password file <none>
I20260808 04:41:54.116288 30032 fs_manager.cc:359] Metadata directory not provided
I20260808 04:41:54.116356 30032 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:41:54.116587 30032 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 04:41:54 dist-test-slave-t7g5 krb5kdc[28983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164114, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for HTTP/127.12.148.84@KRBTEST.COM
I20260808 04:41:54.138720 30032 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-1/data/instance:
uuid: "6f66b6563d494622991d41f5732b8967"
format_stamp: "Formatted at 2026-08-08 04:41:54 on dist-test-slave-t7g5"
server_key: "bffad1f53199e5b1d152cd44cd3560c2"
server_key_iv: "867986f176034af77afc4eecebc46dc2"
server_key_version: "kuduclusterkey@0"
I20260808 04:41:54.139902 30032 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance:
uuid: "6f66b6563d494622991d41f5732b8967"
format_stamp: "Formatted at 2026-08-08 04:41:54 on dist-test-slave-t7g5"
server_key: "bffad1f53199e5b1d152cd44cd3560c2"
server_key_iv: "867986f176034af77afc4eecebc46dc2"
server_key_version: "kuduclusterkey@0"
I20260808 04:41:54.150067 30032 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.004s sys 0.000s
I20260808 04:41:54.197863 30061 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:54.199752 30032 fs_manager.cc:725] Time spent opening block manager: real 0.016s user 0.003s sys 0.000s
I20260808 04:41:54.199903 30032 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-1/wal
uuid: "6f66b6563d494622991d41f5732b8967"
format_stamp: "Formatted at 2026-08-08 04:41:54 on dist-test-slave-t7g5"
server_key: "bffad1f53199e5b1d152cd44cd3560c2"
server_key_iv: "867986f176034af77afc4eecebc46dc2"
server_key_version: "kuduclusterkey@0"
I20260808 04:41:54.200047 30032 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:41:54.219165 30032 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:41:54.222121 30032 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:41:54.222317 30032 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:41:54.223094 30032 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:41:54.224030 30032 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:41:54.224080 30032 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:54.224133 30032 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:41:54.224161 30032 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:54.234387 30032 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.66:34313
I20260808 04:41:54.235674 30032 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
I20260808 04:41:54.237094 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 30032
I20260808 04:41:54.237221 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance
I20260808 04:41:54.237552 12881 external_mini_cluster.cc:1428] Setting key 95d0fbdf1bb3cf9bfb78e76ee71f4ae8
I20260808 04:41:54.249877 30229 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.66:34313 every 8 connection(s)
Aug 08 04:41:54 dist-test-slave-t7g5 krb5kdc[28983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164114, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.148.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.67@KRBTEST.COM" created.
I20260808 04:41:54.257457 30024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:54.244596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:51247 (local address 127.12.148.126:41499)
0808 04:41:54.244718 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:54.244723 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:54.244738 (+ 15us) server_negotiation.cc:407] Connection header received
0808 04:41:54.245572 (+ 834us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:54.245575 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:54.245629 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:54.245706 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:54.247455 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:54.248305 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:54.249776 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:54.250094 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:54.250201 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:54.253554 (+ 3353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:41:54.253559 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:41:54.253561 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:41:54.253593 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:41:54.255089 (+ 1496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:41:54.255745 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:41:54.255749 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:41:54.255750 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:41:54.255843 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:41:54.256280 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:41:54.256283 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:41:54.256284 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:41:54.256478 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:41:54.256537 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:54.257150 (+ 613us) server_negotiation.cc:299] Negotiation successful
0808 04:41:54.257300 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 04:41:54.258792 30236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:54.243647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41499 (local address 127.12.148.66:51247)
0808 04:41:54.244229 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:54.244284 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:54.245312 (+ 1028us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:54.246203 (+ 891us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:54.246213 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:54.246576 (+ 363us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:54.247273 (+ 697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:54.247294 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:54.248478 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:54.248481 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:54.249626 (+ 1145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:54.249637 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:54.250402 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:54.250406 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:54.250614 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:54.251246 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:41:54.251269 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:54.253344 (+ 2075us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:41:54.255221 (+ 1877us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:41:54.255239 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:41:54.255257 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:41:54.255624 (+ 367us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:41:54.255951 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:41:54.255953 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:41:54.255956 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:41:54.256146 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:41:54.256603 (+ 457us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:41:54.256608 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:41:54.256876 (+ 268us) client_negotiation.cc:769] Sending connection context
0808 04:41:54.257618 (+ 742us) client_negotiation.cc:240] Negotiation successful
0808 04:41:54.257987 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":114,"threads_started":1}
I20260808 04:41:54.259912 30232 heartbeater.cc:347] Connected to a master server at 127.12.148.126:41499
I20260808 04:41:54.260149 30232 heartbeater.cc:464] Registering TS with master...
I20260808 04:41:54.260645 30232 heartbeater.cc:511] Master 127.12.148.126:41499 requested a full tablet report, sending...
I20260808 04:41:54.261727 29691 ts_manager.cc:194] Registered new tserver with Master: 6f66b6563d494622991d41f5732b8967 (127.12.148.66:34313)
I20260808 04:41:54.262490 29691 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.66@KRBTEST.COM'} at 127.12.148.66:51247
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab.
Entry for principal kudu/127.12.148.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab.
I20260808 04:41:54.281198 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.148.84:37793/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.67:0
--local_ip_for_outbound_sockets=127.12.148.67
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:41499
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:36791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:41:54.437803 30239 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:41:54.438279 30239 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:41:54.438416 30239 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:41:54.444382 30239 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:41:54.444521 30239 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:41:54.444657 30239 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.67
I20260808 04:41:54.452275 30239 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:36791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.12.148.84:37793/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:41499
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30239
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.67
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:41:54.453913 30239 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:41:54.455260 30239 file_cache.cc:493] Constructed file cache file cache with capacity 419430
Aug 08 04:41:54 dist-test-slave-t7g5 krb5kdc[28983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164113, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for HTTP/127.12.148.84@KRBTEST.COM
W20260808 04:41:54.468437 30252 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:54.468439 30256 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:41:54.469295 30251 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:41:54.470099 30239 server_base.cc:1034] running on GCE node
I20260808 04:41:54.470695 30239 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:41:54.471470 30239 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:41:54.472635 30239 hybrid_clock.cc:648] HybridClock initialized: now 1786164114472567 us; error 80 us; skew 500 ppm
Aug 08 04:41:54 dist-test-slave-t7g5 krb5kdc[28983](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164114, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:41:54.476419 30239 init.cc:377] Logged in from keytab as kudu/127.12.148.67@KRBTEST.COM (short username kudu)
I20260808 04:41:54.477473 30239 webserver.cc:460] Webserver started at http://127.12.148.67:36261/ using document root <none> and password file <none>
I20260808 04:41:54.478173 30239 fs_manager.cc:359] Metadata directory not provided
I20260808 04:41:54.478293 30239 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:41:54.478582 30239 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 04:41:54 dist-test-slave-t7g5 krb5kdc[28983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164114, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for HTTP/127.12.148.84@KRBTEST.COM
I20260808 04:41:54.500141 30239 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-2/data/instance:
uuid: "65aa1a25f6bb4d4e8337dbdf685bbe4c"
format_stamp: "Formatted at 2026-08-08 04:41:54 on dist-test-slave-t7g5"
server_key: "88013d5f3dd99339dbb89f9783e631cc"
server_key_iv: "3da64d559e2a5eaf9c0768e67f03d0d0"
server_key_version: "kuduclusterkey@0"
I20260808 04:41:54.500963 30239 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance:
uuid: "65aa1a25f6bb4d4e8337dbdf685bbe4c"
format_stamp: "Formatted at 2026-08-08 04:41:54 on dist-test-slave-t7g5"
server_key: "88013d5f3dd99339dbb89f9783e631cc"
server_key_iv: "3da64d559e2a5eaf9c0768e67f03d0d0"
server_key_version: "kuduclusterkey@0"
I20260808 04:41:54.512524 30239 fs_manager.cc:691] Time spent creating directory manager: real 0.011s user 0.004s sys 0.000s
I20260808 04:41:54.541190 30268 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:54.543143 30239 fs_manager.cc:725] Time spent opening block manager: real 0.012s user 0.002s sys 0.000s
I20260808 04:41:54.543292 30239 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-2/wal
uuid: "65aa1a25f6bb4d4e8337dbdf685bbe4c"
format_stamp: "Formatted at 2026-08-08 04:41:54 on dist-test-slave-t7g5"
server_key: "88013d5f3dd99339dbb89f9783e631cc"
server_key_iv: "3da64d559e2a5eaf9c0768e67f03d0d0"
server_key_version: "kuduclusterkey@0"
I20260808 04:41:54.543537 30239 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:41:54.567065 30239 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:41:54.570783 30239 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:41:54.571069 30239 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:41:54.571846 30239 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:41:54.572949 30239 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:41:54.573067 30239 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:54.573173 30239 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:41:54.573248 30239 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:41:54.587159 30239 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.67:34311
I20260808 04:41:54.588459 30239 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
I20260808 04:41:54.594349 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 30239
I20260808 04:41:54.594491 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance
I20260808 04:41:54.594797 12881 external_mini_cluster.cc:1428] Setting key a22b177517f3b913f192b5bda9cc1be6
I20260808 04:41:54.589425 30440 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.67:34311 every 8 connection(s)
Aug 08 04:41:54 dist-test-slave-t7g5 krb5kdc[28983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164114, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:41:54.607692 30024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:54.593889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:50631 (local address 127.12.148.126:41499)
0808 04:41:54.594052 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:54.594057 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:54.594733 (+ 676us) server_negotiation.cc:407] Connection header received
0808 04:41:54.596201 (+ 1468us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:54.596205 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:54.596256 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:54.596306 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:54.598016 (+ 1710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:54.598836 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:54.600391 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:54.600699 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:54.600764 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:54.603747 (+ 2983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:41:54.603750 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:41:54.603753 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:41:54.603779 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:41:54.605368 (+ 1589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:41:54.606006 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:41:54.606010 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:41:54.606012 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:41:54.606100 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:41:54.606478 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:41:54.606481 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:41:54.606483 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:41:54.606690 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:41:54.606764 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:54.607409 (+ 645us) server_negotiation.cc:299] Negotiation successful
0808 04:41:54.607530 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 04:41:54.609508 30443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:54.592736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41499 (local address 127.12.148.67:50631)
0808 04:41:54.594314 (+ 1578us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:54.594373 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:54.595952 (+ 1579us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:54.596734 (+ 782us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:54.596743 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:54.597117 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:41:54.597848 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:54.597870 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:54.598996 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:54.598999 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:54.600257 (+ 1258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:54.600267 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:54.600963 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:54.600967 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:54.601150 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:54.601849 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:41:54.601870 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:41:54.603562 (+ 1692us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:41:54.605503 (+ 1941us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:41:54.605509 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:41:54.605526 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:41:54.605888 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:41:54.606199 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:41:54.606202 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:41:54.606204 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:41:54.606378 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:41:54.606839 (+ 461us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:41:54.606845 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:41:54.607149 (+ 304us) client_negotiation.cc:769] Sending connection context
0808 04:41:54.608134 (+ 985us) client_negotiation.cc:240] Negotiation successful
0808 04:41:54.608472 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1356,"thread_start_us":140,"threads_started":1}
I20260808 04:41:54.611038 30441 heartbeater.cc:347] Connected to a master server at 127.12.148.126:41499
I20260808 04:41:54.611282 30441 heartbeater.cc:464] Registering TS with master...
I20260808 04:41:54.611873 30441 heartbeater.cc:511] Master 127.12.148.126:41499 requested a full tablet report, sending...
I20260808 04:41:54.612999 29691 ts_manager.cc:194] Registered new tserver with Master: 65aa1a25f6bb4d4e8337dbdf685bbe4c (127.12.148.67:34311)
I20260808 04:41:54.613722 29691 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.67@KRBTEST.COM'} at 127.12.148.67:50631
I20260808 04:41:54.620402 12881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 04:41:54.631693 30024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:54.622898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34156 (local address 127.12.148.126:41499)
0808 04:41:54.623011 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:54.623015 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:54.623282 (+ 267us) server_negotiation.cc:407] Connection header received
0808 04:41:54.623431 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:54.623434 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:54.623495 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:54.623586 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:41:54.624447 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:54.625218 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:54.626462 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:54.626790 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:54.626899 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:54.628517 (+ 1618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:41:54.628521 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:41:54.628524 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:41:54.628553 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:41:54.630143 (+ 1590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:41:54.630624 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:41:54.630627 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:41:54.630628 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:41:54.630700 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:41:54.630962 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:41:54.630963 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:41:54.630964 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:41:54.631124 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:41:54.631229 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:54.631468 (+ 239us) server_negotiation.cc:299] Negotiation successful
0808 04:41:54.631568 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 04:41:54.635006 29691 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34156:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:41:54.639094 29691 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:41:54.660084 30458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:54.649431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.67:34311 (local address 127.0.0.1:50890)
0808 04:41:54.653991 (+ 4560us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:54.654047 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:54.654185 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:54.655020 (+ 835us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:54.655027 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:54.655054 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:41:54.655198 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:54.655205 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:54.656820 (+ 1615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:54.656824 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:54.658276 (+ 1452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:54.658289 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:54.659539 (+ 1250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:54.659543 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:54.659654 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:54.659695 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 04:41:54.659801 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 04:41:54.659925 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4358,"thread_start_us":116,"threads_started":1}
I20260808 04:41:54.660670 30459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:54.650395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50890 (local address 127.12.148.67:34311)
0808 04:41:54.650712 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:54.650724 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:54.654526 (+ 3802us) server_negotiation.cc:407] Connection header received
0808 04:41:54.654610 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:54.654616 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:54.654843 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:54.654996 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:41:54.655484 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:54.656674 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:54.658415 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:54.659187 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:54.659317 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:54.659475 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:54.660431 (+ 956us) server_negotiation.cc:299] Negotiation successful
0808 04:41:54.660536 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":210,"thread_start_us":102,"threads_started":1}
I20260808 04:41:54.663988 30340 tablet_service.cc:1467] Processing CreateTablet for tablet 07a723c87d6b4a1db580f706215bee77 (DEFAULT_TABLE table=test-table [id=2f5e403a69274d03a794ebe1383a1a98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:41:54.665172 30340 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07a723c87d6b4a1db580f706215bee77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:41:54.666621 30462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:54.651485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:37929 (local address 127.0.0.1:43492)
0808 04:41:54.654364 (+ 2879us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:54.654375 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:54.654441 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:54.662369 (+ 7928us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:54.662373 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:54.662393 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:41:54.662496 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:54.662502 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:54.663988 (+ 1486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:54.663991 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:54.665155 (+ 1164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:54.665166 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:54.666226 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:54.666230 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:54.666328 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:54.666356 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 04:41:54.666406 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 04:41:54.666474 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2826,"mutex_wait_us":64,"thread_start_us":90,"threads_started":1}
I20260808 04:41:54.666877 30460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:54.651246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:34313 (local address 127.0.0.1:39848)
0808 04:41:54.653993 (+ 2747us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:54.654113 (+ 120us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:54.654203 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:54.662532 (+ 8329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:54.662535 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:54.662553 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:41:54.662639 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:54.662645 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:54.663983 (+ 1338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:54.663986 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:54.665185 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:54.665196 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:54.666507 (+ 1311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:54.666510 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:54.666605 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:54.666629 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 04:41:54.666674 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 04:41:54.666737 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2566,"mutex_wait_us":8,"spinlock_wait_cycles":2944,"thread_start_us":104,"threads_started":1}
I20260808 04:41:54.667316 30464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:54.651643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43492 (local address 127.12.148.65:37929)
0808 04:41:54.661872 (+ 10229us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:54.661879 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:54.661905 (+ 26us) server_negotiation.cc:407] Connection header received
0808 04:41:54.661981 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:54.661986 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:54.662190 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:54.662649 (+ 459us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:41:54.662791 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:54.663849 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:54.665300 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:54.666088 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:54.666890 (+ 802us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:54.667037 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:54.667086 (+ 49us) server_negotiation.cc:299] Negotiation successful
0808 04:41:54.667171 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10109,"thread_start_us":69,"threads_started":1}
I20260808 04:41:54.667555 30465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:54.651660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39848 (local address 127.12.148.66:34313)
0808 04:41:54.661908 (+ 10248us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:54.661919 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:54.661944 (+ 25us) server_negotiation.cc:407] Connection header received
0808 04:41:54.662021 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:54.662026 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:54.662218 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:54.662386 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:41:54.662757 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:54.663859 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:54.665364 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:54.666376 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:54.667132 (+ 756us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:54.667285 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:54.667333 (+ 48us) server_negotiation.cc:299] Negotiation successful
0808 04:41:54.667421 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10137,"thread_start_us":112,"threads_started":1}
I20260808 04:41:54.670027 30132 tablet_service.cc:1467] Processing CreateTablet for tablet 07a723c87d6b4a1db580f706215bee77 (DEFAULT_TABLE table=test-table [id=2f5e403a69274d03a794ebe1383a1a98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:41:54.670140 29910 tablet_service.cc:1467] Processing CreateTablet for tablet 07a723c87d6b4a1db580f706215bee77 (DEFAULT_TABLE table=test-table [id=2f5e403a69274d03a794ebe1383a1a98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:41:54.671118 30132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07a723c87d6b4a1db580f706215bee77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:41:54.671128 29910 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07a723c87d6b4a1db580f706215bee77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:41:54.679296 30467 tablet_bootstrap.cc:492] T 07a723c87d6b4a1db580f706215bee77 P 6f66b6563d494622991d41f5732b8967: Bootstrap starting.
I20260808 04:41:54.679379 30468 tablet_bootstrap.cc:492] T 07a723c87d6b4a1db580f706215bee77 P 27444b71a04941348f7a636f8ae2f2be: Bootstrap starting.
I20260808 04:41:54.681989 30468 tablet_bootstrap.cc:654] T 07a723c87d6b4a1db580f706215bee77 P 27444b71a04941348f7a636f8ae2f2be: Neither blocks nor log segments found. Creating new log.
I20260808 04:41:54.682025 30467 tablet_bootstrap.cc:654] T 07a723c87d6b4a1db580f706215bee77 P 6f66b6563d494622991d41f5732b8967: Neither blocks nor log segments found. Creating new log.
I20260808 04:41:54.682950 30467 log.cc:824] T 07a723c87d6b4a1db580f706215bee77 P 6f66b6563d494622991d41f5732b8967: Log is configured to *not* fsync() on all Append() calls
I20260808 04:41:54.682993 30468 log.cc:824] T 07a723c87d6b4a1db580f706215bee77 P 27444b71a04941348f7a636f8ae2f2be: Log is configured to *not* fsync() on all Append() calls
I20260808 04:41:54.685043 30467 tablet_bootstrap.cc:492] T 07a723c87d6b4a1db580f706215bee77 P 6f66b6563d494622991d41f5732b8967: No bootstrap required, opened a new log
I20260808 04:41:54.685050 30468 tablet_bootstrap.cc:492] T 07a723c87d6b4a1db580f706215bee77 P 27444b71a04941348f7a636f8ae2f2be: No bootstrap required, opened a new log
I20260808 04:41:54.685230 30468 ts_tablet_manager.cc:1397] T 07a723c87d6b4a1db580f706215bee77 P 27444b71a04941348f7a636f8ae2f2be: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260808 04:41:54.685243 30467 ts_tablet_manager.cc:1397] T 07a723c87d6b4a1db580f706215bee77 P 6f66b6563d494622991d41f5732b8967: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 04:41:54.689360 30467 raft_consensus.cc:348] T 07a723c87d6b4a1db580f706215bee77 P 6f66b6563d494622991d41f5732b8967 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65aa1a25f6bb4d4e8337dbdf685bbe4c" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 34311 } } peers { permanent_uuid: "6f66b6563d494622991d41f5732b8967" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 34313 } } peers { permanent_uuid: "27444b71a04941348f7a636f8ae2f2be" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 37929 } }
I20260808 04:41:54.689579 30468 raft_consensus.cc:348] T 07a723c87d6b4a1db580f706215bee77 P 27444b71a04941348f7a636f8ae2f2be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65aa1a25f6bb4d4e8337dbdf685bbe4c" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 34311 } } peers { permanent_uuid: "6f66b6563d494622991d41f5732b8967" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 34313 } } peers { permanent_uuid: "27444b71a04941348f7a636f8ae2f2be" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 37929 } }
I20260808 04:41:54.689914 30468 raft_consensus.cc:374] T 07a723c87d6b4a1db580f706215bee77 P 27444b71a04941348f7a636f8ae2f2be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:41:54.690026 30468 raft_consensus.cc:729] T 07a723c87d6b4a1db580f706215bee77 P 27444b71a04941348f7a636f8ae2f2be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27444b71a04941348f7a636f8ae2f2be, State: Initialized, Role: FOLLOWER
I20260808 04:41:54.689632 30467 raft_consensus.cc:374] T 07a723c87d6b4a1db580f706215bee77 P 6f66b6563d494622991d41f5732b8967 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:41:54.690202 30467 raft_consensus.cc:729] T 07a723c87d6b4a1db580f706215bee77 P 6f66b6563d494622991d41f5732b8967 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f66b6563d494622991d41f5732b8967, State: Initialized, Role: FOLLOWER
I20260808 04:41:54.690618 30468 consensus_queue.cc:260] T 07a723c87d6b4a1db580f706215bee77 P 27444b71a04941348f7a636f8ae2f2be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65aa1a25f6bb4d4e8337dbdf685bbe4c" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 34311 } } peers { permanent_uuid: "6f66b6563d494622991d41f5732b8967" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 34313 } } peers { permanent_uuid: "27444b71a04941348f7a636f8ae2f2be" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 37929 } }
I20260808 04:41:54.690718 30467 consensus_queue.cc:260] T 07a723c87d6b4a1db580f706215bee77 P 6f66b6563d494622991d41f5732b8967 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65aa1a25f6bb4d4e8337dbdf685bbe4c" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 34311 } } peers { permanent_uuid: "6f66b6563d494622991d41f5732b8967" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 34313 } } peers { permanent_uuid: "27444b71a04941348f7a636f8ae2f2be" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 37929 } }
I20260808 04:41:54.691710 30467 ts_tablet_manager.cc:1428] T 07a723c87d6b4a1db580f706215bee77 P 6f66b6563d494622991d41f5732b8967: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260808 04:41:54.691792 30468 ts_tablet_manager.cc:1428] T 07a723c87d6b4a1db580f706215bee77 P 27444b71a04941348f7a636f8ae2f2be: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260808 04:41:54.692114 30232 heartbeater.cc:503] Master 127.12.148.126:41499 was elected leader, sending a full tablet report...
I20260808 04:41:54.692165 30020 heartbeater.cc:503] Master 127.12.148.126:41499 was elected leader, sending a full tablet report...
I20260808 04:41:54.693130 30466 tablet_bootstrap.cc:492] T 07a723c87d6b4a1db580f706215bee77 P 65aa1a25f6bb4d4e8337dbdf685bbe4c: Bootstrap starting.
I20260808 04:41:54.696264 30466 tablet_bootstrap.cc:654] T 07a723c87d6b4a1db580f706215bee77 P 65aa1a25f6bb4d4e8337dbdf685bbe4c: Neither blocks nor log segments found. Creating new log.
I20260808 04:41:54.697271 30466 log.cc:824] T 07a723c87d6b4a1db580f706215bee77 P 65aa1a25f6bb4d4e8337dbdf685bbe4c: Log is configured to *not* fsync() on all Append() calls
I20260808 04:41:54.699556 30466 tablet_bootstrap.cc:492] T 07a723c87d6b4a1db580f706215bee77 P 65aa1a25f6bb4d4e8337dbdf685bbe4c: No bootstrap required, opened a new log
I20260808 04:41:54.699743 30466 ts_tablet_manager.cc:1397] T 07a723c87d6b4a1db580f706215bee77 P 65aa1a25f6bb4d4e8337dbdf685bbe4c: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260808 04:41:54.703037 30466 raft_consensus.cc:348] T 07a723c87d6b4a1db580f706215bee77 P 65aa1a25f6bb4d4e8337dbdf685bbe4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65aa1a25f6bb4d4e8337dbdf685bbe4c" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 34311 } } peers { permanent_uuid: "6f66b6563d494622991d41f5732b8967" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 34313 } } peers { permanent_uuid: "27444b71a04941348f7a636f8ae2f2be" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 37929 } }
I20260808 04:41:54.703264 30466 raft_consensus.cc:374] T 07a723c87d6b4a1db580f706215bee77 P 65aa1a25f6bb4d4e8337dbdf685bbe4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:41:54.703339 30466 raft_consensus.cc:729] T 07a723c87d6b4a1db580f706215bee77 P 65aa1a25f6bb4d4e8337dbdf685bbe4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65aa1a25f6bb4d4e8337dbdf685bbe4c, State: Initialized, Role: FOLLOWER
I20260808 04:41:54.703758 30466 consensus_queue.cc:260] T 07a723c87d6b4a1db580f706215bee77 P 65aa1a25f6bb4d4e8337dbdf685bbe4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65aa1a25f6bb4d4e8337dbdf685bbe4c" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 34311 } } peers { permanent_uuid: "6f66b6563d494622991d41f5732b8967" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 34313 } } peers { permanent_uuid: "27444b71a04941348f7a636f8ae2f2be" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 37929 } }
I20260808 04:41:54.704375 30441 heartbeater.cc:503] Master 127.12.148.126:41499 was elected leader, sending a full tablet report...
I20260808 04:41:54.705705 30466 ts_tablet_manager.cc:1428] T 07a723c87d6b4a1db580f706215bee77 P 65aa1a25f6bb4d4e8337dbdf685bbe4c: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
W20260808 04:41:54.742061 30233 tablet.cc:2369] T 07a723c87d6b4a1db580f706215bee77 P 6f66b6563d494622991d41f5732b8967: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 04:41:54 dist-test-slave-t7g5 krb5kdc[28983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164113, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for HTTP/127.12.148.84@KRBTEST.COM
I20260808 04:41:54.833460 30476 raft_consensus.cc:482] T 07a723c87d6b4a1db580f706215bee77 P 65aa1a25f6bb4d4e8337dbdf685bbe4c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:41:54.833756 30476 raft_consensus.cc:504] T 07a723c87d6b4a1db580f706215bee77 P 65aa1a25f6bb4d4e8337dbdf685bbe4c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65aa1a25f6bb4d4e8337dbdf685bbe4c" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 34311 } } peers { permanent_uuid: "6f66b6563d494622991d41f5732b8967" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 34313 } } peers { permanent_uuid: "27444b71a04941348f7a636f8ae2f2be" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 37929 } }
I20260808 04:41:54.835269 30476 leader_election.cc:288] T 07a723c87d6b4a1db580f706215bee77 P 65aa1a25f6bb4d4e8337dbdf685bbe4c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f66b6563d494622991d41f5732b8967 (127.12.148.66:34313), 27444b71a04941348f7a636f8ae2f2be (127.12.148.65:37929)
W20260808 04:41:54.840775 30442 tablet.cc:2369] T 07a723c87d6b4a1db580f706215bee77 P 65aa1a25f6bb4d4e8337dbdf685bbe4c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:41:54.841100 30443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:54.835743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:34313 (local address 127.12.148.67:49107)
0808 04:41:54.835912 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:54.835930 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:54.836030 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:54.837077 (+ 1047us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:54.837080 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:54.837098 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:41:54.837222 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:54.837229 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:54.838286 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:54.838289 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:54.839472 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:54.839485 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:54.840694 (+ 1209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:54.840698 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:54.840793 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:54.840818 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 04:41:54.840892 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 04:41:54.840974 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260808 04:41:54.841507 30465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:54.836539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:49107 (local address 127.12.148.66:34313)
0808 04:41:54.836866 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:54.836870 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:54.836885 (+ 15us) server_negotiation.cc:407] Connection header received
0808 04:41:54.836937 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:54.836939 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:54.836978 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:54.837044 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:41:54.837374 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:54.838149 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:54.839625 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:54.840213 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:54.840350 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:54.840411 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:54.841268 (+ 857us) server_negotiation.cc:299] Negotiation successful
0808 04:41:54.841385 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":242}
I20260808 04:41:54.842941 30161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07a723c87d6b4a1db580f706215bee77" candidate_uuid: "65aa1a25f6bb4d4e8337dbdf685bbe4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f66b6563d494622991d41f5732b8967" is_pre_election: true
I20260808 04:41:54.843276 30161 raft_consensus.cc:2454] T 07a723c87d6b4a1db580f706215bee77 P 6f66b6563d494622991d41f5732b8967 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65aa1a25f6bb4d4e8337dbdf685bbe4c in term 0.
I20260808 04:41:54.843811 30269 leader_election.cc:302] T 07a723c87d6b4a1db580f706215bee77 P 65aa1a25f6bb4d4e8337dbdf685bbe4c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65aa1a25f6bb4d4e8337dbdf685bbe4c, 6f66b6563d494622991d41f5732b8967; no voters:
I20260808 04:41:54.844120 30476 raft_consensus.cc:2781] T 07a723c87d6b4a1db580f706215bee77 P 65aa1a25f6bb4d4e8337dbdf685bbe4c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:41:54.844239 30476 raft_consensus.cc:482] T 07a723c87d6b4a1db580f706215bee77 P 65aa1a25f6bb4d4e8337dbdf685bbe4c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:41:54.844300 30476 raft_consensus.cc:3037] T 07a723c87d6b4a1db580f706215bee77 P 65aa1a25f6bb4d4e8337dbdf685bbe4c [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:41:54.845847 30476 raft_consensus.cc:504] T 07a723c87d6b4a1db580f706215bee77 P 65aa1a25f6bb4d4e8337dbdf685bbe4c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65aa1a25f6bb4d4e8337dbdf685bbe4c" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 34311 } } peers { permanent_uuid: "6f66b6563d494622991d41f5732b8967" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 34313 } } peers { permanent_uuid: "27444b71a04941348f7a636f8ae2f2be" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 37929 } }
I20260808 04:41:54.846276 30476 leader_election.cc:288] T 07a723c87d6b4a1db580f706215bee77 P 65aa1a25f6bb4d4e8337dbdf685bbe4c [CANDIDATE]: Term 1 election: Requested vote from peers 6f66b6563d494622991d41f5732b8967 (127.12.148.66:34313), 27444b71a04941348f7a636f8ae2f2be (127.12.148.65:37929)
I20260808 04:41:54.847211 30161 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07a723c87d6b4a1db580f706215bee77" candidate_uuid: "65aa1a25f6bb4d4e8337dbdf685bbe4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f66b6563d494622991d41f5732b8967"
I20260808 04:41:54.847344 30161 raft_consensus.cc:3037] T 07a723c87d6b4a1db580f706215bee77 P 6f66b6563d494622991d41f5732b8967 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:41:54.848568 30464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:54.836720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:55541 (local address 127.12.148.65:37929)
0808 04:41:54.836856 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:54.836861 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:54.841134 (+ 4273us) server_negotiation.cc:407] Connection header received
0808 04:41:54.841508 (+ 374us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:54.841513 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:54.841570 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:54.841625 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:41:54.842147 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:54.842822 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:54.847120 (+ 4298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:54.847749 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:54.847866 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:54.847926 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:54.848320 (+ 394us) server_negotiation.cc:299] Negotiation successful
0808 04:41:54.848409 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 04:41:54.848575 30161 raft_consensus.cc:2454] T 07a723c87d6b4a1db580f706215bee77 P 6f66b6563d494622991d41f5732b8967 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65aa1a25f6bb4d4e8337dbdf685bbe4c in term 1.
I20260808 04:41:54.848942 30269 leader_election.cc:302] T 07a723c87d6b4a1db580f706215bee77 P 65aa1a25f6bb4d4e8337dbdf685bbe4c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65aa1a25f6bb4d4e8337dbdf685bbe4c, 6f66b6563d494622991d41f5732b8967; no voters:
I20260808 04:41:54.849099 30478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:54.836066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:37929 (local address 127.12.148.67:55541)
0808 04:41:54.841019 (+ 4953us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:54.841037 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 04:41:54.841355 (+ 318us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:41:54.841843 (+ 488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:41:54.841846 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:41:54.841868 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:41:54.842002 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:54.842009 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:54.842945 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:54.842949 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:54.846946 (+ 3997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:41:54.846958 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:41:54.848056 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:41:54.848060 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:41:54.848165 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:54.848190 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 04:41:54.848774 (+ 584us) client_negotiation.cc:240] Negotiation successful
0808 04:41:54.848865 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4865,"thread_start_us":154,"threads_started":1}
I20260808 04:41:54.849995 29950 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07a723c87d6b4a1db580f706215bee77" candidate_uuid: "65aa1a25f6bb4d4e8337dbdf685bbe4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27444b71a04941348f7a636f8ae2f2be" is_pre_election: true
I20260808 04:41:54.850323 29950 raft_consensus.cc:2454] T 07a723c87d6b4a1db580f706215bee77 P 27444b71a04941348f7a636f8ae2f2be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65aa1a25f6bb4d4e8337dbdf685bbe4c in term 0.
I20260808 04:41:54.850021 29948 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07a723c87d6b4a1db580f706215bee77" candidate_uuid: "65aa1a25f6bb4d4e8337dbdf685bbe4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27444b71a04941348f7a636f8ae2f2be"
I20260808 04:41:54.850462 29948 raft_consensus.cc:3037] T 07a723c87d6b4a1db580f706215bee77 P 27444b71a04941348f7a636f8ae2f2be [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:41:54.850754 30476 raft_consensus.cc:2781] T 07a723c87d6b4a1db580f706215bee77 P 65aa1a25f6bb4d4e8337dbdf685bbe4c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:41:54.850986 30476 raft_consensus.cc:686] T 07a723c87d6b4a1db580f706215bee77 P 65aa1a25f6bb4d4e8337dbdf685bbe4c [term 1 LEADER]: Becoming Leader. State: Replica: 65aa1a25f6bb4d4e8337dbdf685bbe4c, State: Running, Role: LEADER
I20260808 04:41:54.851321 30476 consensus_queue.cc:237] T 07a723c87d6b4a1db580f706215bee77 P 65aa1a25f6bb4d4e8337dbdf685bbe4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65aa1a25f6bb4d4e8337dbdf685bbe4c" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 34311 } } peers { permanent_uuid: "6f66b6563d494622991d41f5732b8967" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 34313 } } peers { permanent_uuid: "27444b71a04941348f7a636f8ae2f2be" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 37929 } }
I20260808 04:41:54.851799 29948 raft_consensus.cc:2454] T 07a723c87d6b4a1db580f706215bee77 P 27444b71a04941348f7a636f8ae2f2be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65aa1a25f6bb4d4e8337dbdf685bbe4c in term 1.
I20260808 04:41:54.854595 29691 catalog_manager.cc:5495] T 07a723c87d6b4a1db580f706215bee77 P 65aa1a25f6bb4d4e8337dbdf685bbe4c reported cstate change: term changed from 0 to 1, leader changed from <none> to 65aa1a25f6bb4d4e8337dbdf685bbe4c (127.12.148.67). New cstate: current_term: 1 leader_uuid: "65aa1a25f6bb4d4e8337dbdf685bbe4c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65aa1a25f6bb4d4e8337dbdf685bbe4c" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 34311 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f66b6563d494622991d41f5732b8967" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 34313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27444b71a04941348f7a636f8ae2f2be" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 37929 } health_report { overall_health: UNKNOWN } } }
W20260808 04:41:54.899310 30022 tablet.cc:2369] T 07a723c87d6b4a1db580f706215bee77 P 27444b71a04941348f7a636f8ae2f2be: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:41:54.903687 30459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:54.898456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50906 (local address 127.12.148.67:34311)
0808 04:41:54.898611 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 04:41:54.898617 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:41:54.898636 (+ 19us) server_negotiation.cc:407] Connection header received
0808 04:41:54.898752 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:41:54.898756 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:41:54.898841 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:41:54.898990 (+ 149us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:41:54.899304 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:54.900099 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:54.901248 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:41:54.901552 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:41:54.901647 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:41:54.902137 (+ 490us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:41:54.902672 (+ 535us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:41:54.902814 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0808 04:41:54.903482 (+ 668us) server_negotiation.cc:299] Negotiation successful
0808 04:41:54.903552 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 04:41:54.911448 29948 raft_consensus.cc:1261] T 07a723c87d6b4a1db580f706215bee77 P 27444b71a04941348f7a636f8ae2f2be [term 1 FOLLOWER]: Refusing update from remote peer 65aa1a25f6bb4d4e8337dbdf685bbe4c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:41:54.912261 30480 consensus_queue.cc:1035] T 07a723c87d6b4a1db580f706215bee77 P 65aa1a25f6bb4d4e8337dbdf685bbe4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "27444b71a04941348f7a636f8ae2f2be" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 37929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:41:54.920054 30161 raft_consensus.cc:1261] T 07a723c87d6b4a1db580f706215bee77 P 6f66b6563d494622991d41f5732b8967 [term 1 FOLLOWER]: Refusing update from remote peer 65aa1a25f6bb4d4e8337dbdf685bbe4c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:41:54.920866 30480 consensus_queue.cc:1035] T 07a723c87d6b4a1db580f706215bee77 P 65aa1a25f6bb4d4e8337dbdf685bbe4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f66b6563d494622991d41f5732b8967" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 34313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:41:54.939232 30489 mvcc.cc:205] Tried to move back new op lower bound from 7316128214668939264 to 7316128214433599488. Current Snapshot: MvccSnapshot[applied={T|T < 7316128214668939264}]
I20260808 04:41:54.949115 30493 mvcc.cc:205] Tried to move back new op lower bound from 7316128214668939264 to 7316128214433599488. Current Snapshot: MvccSnapshot[applied={T|T < 7316128214668939264}]
I20260808 04:41:54.959427 29691 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34156:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:41:54.959621 29691 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34156:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:41:54.962198 29691 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac8af18b7ba843bca2024647bbdd9d4b: Sending DeleteTablet for 3 replicas of tablet 07a723c87d6b4a1db580f706215bee77
I20260808 04:41:54.964131 30340 tablet_service.cc:1514] Processing DeleteTablet for tablet 07a723c87d6b4a1db580f706215bee77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:41:54 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:50890
I20260808 04:41:54.964702 29910 tablet_service.cc:1514] Processing DeleteTablet for tablet 07a723c87d6b4a1db580f706215bee77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:41:54 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:43492
I20260808 04:41:54.965304 30132 tablet_service.cc:1514] Processing DeleteTablet for tablet 07a723c87d6b4a1db580f706215bee77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:41:54 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:39848
I20260808 04:41:54.966864 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 29822
I20260808 04:41:54.982583 30508 tablet_replica.cc:330] T 07a723c87d6b4a1db580f706215bee77 P 65aa1a25f6bb4d4e8337dbdf685bbe4c: stopping tablet replica
I20260808 04:41:54.990227 30510 tablet_replica.cc:330] T 07a723c87d6b4a1db580f706215bee77 P 6f66b6563d494622991d41f5732b8967: stopping tablet replica
I20260808 04:41:54.993463 30508 raft_consensus.cc:2229] T 07a723c87d6b4a1db580f706215bee77 P 65aa1a25f6bb4d4e8337dbdf685bbe4c [term 1 LEADER]: Raft consensus shutting down.
I20260808 04:41:54.994019 30510 raft_consensus.cc:2229] T 07a723c87d6b4a1db580f706215bee77 P 6f66b6563d494622991d41f5732b8967 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:41:54.994566 30510 raft_consensus.cc:2258] T 07a723c87d6b4a1db580f706215bee77 P 6f66b6563d494622991d41f5732b8967 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:41:54.995177 30508 raft_consensus.cc:2258] T 07a723c87d6b4a1db580f706215bee77 P 65aa1a25f6bb4d4e8337dbdf685bbe4c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:41:54.997419 30510 ts_tablet_manager.cc:1905] T 07a723c87d6b4a1db580f706215bee77 P 6f66b6563d494622991d41f5732b8967: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:41:54.999068 30508 ts_tablet_manager.cc:1905] T 07a723c87d6b4a1db580f706215bee77 P 65aa1a25f6bb4d4e8337dbdf685bbe4c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:41:55.003167 30510 ts_tablet_manager.cc:1918] T 07a723c87d6b4a1db580f706215bee77 P 6f66b6563d494622991d41f5732b8967: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:41:55.013337 30510 log.cc:1196] T 07a723c87d6b4a1db580f706215bee77 P 6f66b6563d494622991d41f5732b8967: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-1/wal/wals/07a723c87d6b4a1db580f706215bee77
I20260808 04:41:55.015195 30510 ts_tablet_manager.cc:1939] T 07a723c87d6b4a1db580f706215bee77 P 6f66b6563d494622991d41f5732b8967: Deleting consensus metadata
I20260808 04:41:55.017060 29669 catalog_manager.cc:4841] TS 6f66b6563d494622991d41f5732b8967 (127.12.148.66:34313): tablet 07a723c87d6b4a1db580f706215bee77 (table test-table [id=2f5e403a69274d03a794ebe1383a1a98]) successfully deleted
W20260808 04:41:55.017859 29671 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.148.65:37929 (error 108)
I20260808 04:41:55.018625 30508 ts_tablet_manager.cc:1918] T 07a723c87d6b4a1db580f706215bee77 P 65aa1a25f6bb4d4e8337dbdf685bbe4c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:41:55.018770 30508 log.cc:1196] T 07a723c87d6b4a1db580f706215bee77 P 65aa1a25f6bb4d4e8337dbdf685bbe4c: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786164004017495-12881-0/minicluster-data/ts-2/wal/wals/07a723c87d6b4a1db580f706215bee77
I20260808 04:41:55.019157 30508 ts_tablet_manager.cc:1939] T 07a723c87d6b4a1db580f706215bee77 P 65aa1a25f6bb4d4e8337dbdf685bbe4c: Deleting consensus metadata
I20260808 04:41:55.019954 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 30032
I20260808 04:41:55.025774 29671 catalog_manager.cc:4841] TS 65aa1a25f6bb4d4e8337dbdf685bbe4c (127.12.148.67:34311): tablet 07a723c87d6b4a1db580f706215bee77 (table test-table [id=2f5e403a69274d03a794ebe1383a1a98]) successfully deleted
I20260808 04:41:55.034785 30460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:41:55.034373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:37929 (local address 127.0.0.1:43496)
0808 04:41:55.034595 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0808 04:41:55.034679 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.65:37929: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141}
W20260808 04:41:55.035303 29671 catalog_manager.cc:4584] TS 27444b71a04941348f7a636f8ae2f2be (127.12.148.65:37929): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 07a723c87d6b4a1db580f706215bee77: Network error: Client connection negotiation failed: client connection to 127.12.148.65:37929: connect: Connection refused (error 111)
I20260808 04:41:55.040102 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 30239
I20260808 04:41:55.086205 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 29639
I20260808 04:41:55.100327 12881 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 04:41:55.446772 12881 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 04:41:55.446909 12881 mini_ranger.cc:66] Stopping Ranger...
I20260808 04:41:55.791280 12881 mini_ranger.cc:68] Stopped Ranger
2026-08-08 04:41:55.791 UTC [29033] LOG: received smart shutdown request
2026-08-08 04:41:55.795 UTC [29033] LOG: background worker "logical replication launcher" (PID 29045) exited with exit code 1
2026-08-08 04:41:55.795 UTC [29038] LOG: shutting down
2026-08-08 04:41:55.952 UTC [29033] LOG: database system is shut down
2026-08-08T04:41:55Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (47212 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:41:56 dist-test-slave-t7g5 krb5kdc[30526](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:41:56 dist-test-slave-t7g5 krb5kdc[30526](info): set up 2 sockets
Aug 08 04:41:56 dist-test-slave-t7g5 krb5kdc[30526](info): commencing operation
krb5kdc: starting...
W20260808 04:41:57.196419 12881 mini_kdc.cc:121] Time spent starting KDC: real 1.130s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Aug 08 04:41:57 dist-test-slave-t7g5 krb5kdc[30526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164117, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:41:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:41:57Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.12.148.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.12.148.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.12.148.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/rangeradmin_127.12.148.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.12.148.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/rangeradmin_127.12.148.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.12.148.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.12.148.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.12.148.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/rangerlookup_127.12.148.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.12.148.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/rangerlookup_127.12.148.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.148.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.12.148.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.148.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/HTTP_127.12.148.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.148.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/HTTP_127.12.148.84@KRBTEST.COM.keytab.
I20260808 04:41:57.371714 12881 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskMuxZs2/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/postgres -l logfile start
2026-08-08 04:41:59.712 UTC [30573] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 04:41:59.712 UTC [30573] LOG: listening on IPv4 address "127.12.148.84", port 56893
2026-08-08 04:41:59.715 UTC [30573] LOG: listening on Unix socket "/tmp/.s.PGSQL.56893"
2026-08-08 04:41:59.743 UTC [30578] LOG: database system was shut down at 2026-08-08 04:41:58 UTC
2026-08-08 04:41:59.747 UTC [30573] LOG: database system is ready to accept connections
I20260808 04:42:00.797435 12881 mini_postgres.cc:96] Postgres bound to 56893
2026-08-08 04:42:00.804 UTC [30588] FATAL: database "slave" does not exist
127.12.148.84:56893 - accepting connections
I20260808 04:42:00.805263 12881 mini_ranger.cc:161] Starting Ranger...
I20260808 04:42:00.820600 12881 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 04:42:01.238601 12881 mini_ranger.cc:87] Created ranger Postgres database
I20260808 04:42:01.238678 12881 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ranger-admin
2026-08-08 04:42:01,494 [I] DB FLAVOR :POSTGRES
2026-08-08 04:42:01,495 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 04:42:01,495 [I] Checking connection..
2026-08-08 04:42:01,495 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:56893/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 04:42:01,747 [I] Checking connection passed.
2026-08-08 04:42:01,747 [I] --------- Verifying version history table ---------
2026-08-08 04:42:01,747 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:56893/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 04:42:02,001 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 04:42:02,001 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:56893/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 04:42:02,258 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 04:42:02,258 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 04:42:02,258 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:56893/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 04:42:02.504 UTC [30696] WARNING: there is no transaction in progress
2026-08-08 04:42:02,512 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 04:42:02,513 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:56893/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 04:42:02,749 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 04:42:02,749 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 04:42:02,749 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:56893/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 04:42:02,997 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:56893/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 04:42:03,257 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:56893/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-t7g5.c.gcp-upstream.internal','N') ;"
2026-08-08 04:42:03,494 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:56893/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 04:42:03,751 [I] Table x_portal_user does not exist in database ranger
2026-08-08 04:42:03,751 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:56893/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 04:42:04,022 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 04:42:04,023 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:56893/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 04:42:04,284 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:56893/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 04:42:04,543 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 04:42:04,543 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:56893/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 04:42:05.464 UTC [30864] WARNING: there is no transaction in progress
2026-08-08 04:42:05.481 UTC [30864] WARNING: there is no transaction in progress
2026-08-08 04:42:05.496 UTC [30864] WARNING: there is no transaction in progress
2026-08-08 04:42:05.512 UTC [30864] WARNING: there is no transaction in progress
2026-08-08 04:42:05.527 UTC [30864] WARNING: there is no transaction in progress
2026-08-08 04:42:05.545 UTC [30864] WARNING: there is no transaction in progress
2026-08-08 04:42:05.605 UTC [30864] WARNING: there is no transaction in progress
2026-08-08 04:42:05.612 UTC [30864] WARNING: there is no transaction in progress
2026-08-08 04:42:05.625 UTC [30864] WARNING: there is no transaction in progress
2026-08-08 04:42:05.635 UTC [30864] WARNING: there is no transaction in progress
2026-08-08 04:42:05.645 UTC [30864] WARNING: there is no transaction in progress
2026-08-08 04:42:05.659 UTC [30864] WARNING: there is no transaction in progress
2026-08-08 04:42:05.668 UTC [30864] WARNING: there is no transaction in progress
2026-08-08 04:42:05.674 UTC [30864] WARNING: there is no transaction in progress
2026-08-08 04:42:05.680 UTC [30864] WARNING: there is no transaction in progress
2026-08-08 04:42:05.686 UTC [30864] WARNING: there is no transaction in progress
2026-08-08 04:42:06,258 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 04:42:06,259 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:56893/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 04:42:06,488 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 04:42:06,489 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:56893/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 04:42:06,729 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 04:42:06,730 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:56893/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 04:42:06,988 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 04:42:06,989 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:56893/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 04:42:07,243 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:56893/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 04:42:07,488 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:56893/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-t7g5.c.gcp-upstream.internal';"
2026-08-08 04:42:07,723 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 04:42:07,723 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:56893/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 04:42:07,995 [I] DB_PATCHES have already been applied
I20260808 04:42:08.000751 12881 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ranger-admin:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskMuxZs2/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 04:42:08.000823 12881 mini_ranger.cc:193] Using host: 127.12.148.84
I20260808 04:42:08.005242 12881 mini_ranger.cc:227] Ranger admin URL: http://127.12.148.84:52449
Aug 08, 2026 4:42:08 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 4:42:08 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 4:42:08 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 4:42:08 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 4:42:08 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 4:42:08 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 4:42:08 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 04:42:09.246908 12881 mini_ranger.cc:160] Time spent starting Ranger: real 8.442s user 0.000s sys 0.011s
Aug 08, 2026 4:42:28 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 4:42:28 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 08, 2026 4:42:28 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 4:42:28 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 4:42:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 4:42:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 4:42:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 4:42:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 4:42:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 4:42:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 4:42:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 4:42:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 4:42:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 4:42:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 4:42:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 4:42:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 4:42:29 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 4:42:29 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 04:42:30.495389 12881 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.12.148.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.12.148.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.12.148.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/rangerkms_127.12.148.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.12.148.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/rangerkms_127.12.148.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.148.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.12.148.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.148.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/HTTP_127.12.148.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.148.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/HTTP_127.12.148.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 04:42:30 dist-test-slave-t7g5 krb5kdc[30526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164150, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 04:42:30.580687 12881 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 04:42:30.590798 12881 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 04:42:31.364420 12881 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 04:42:31.364498 12881 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ranger-kms
I20260808 04:42:31.364511 12881 mini_ranger_kms.cc:227] Using postgres at 127.12.148.84:56893
2026-08-08 04:42:31,522 [I] DB FLAVOR :POSTGRES
2026-08-08 04:42:31,522 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 04:42:31,522 [I] Checking connection
2026-08-08 04:42:31,522 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:56893/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 04:42:31,788 [I] connection success
2026-08-08 04:42:31,788 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 04:42:31,788 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 04:42:31,788 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:56893/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 04:42:32,021 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 04:42:32,021 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 04:42:32,021 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 04:42:32,022 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.148.84:56893/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 04:42:32,287 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 04:42:32.731079 12881 mini_ranger_kms.cc:310] Created kms service
I20260808 04:42:32.900475 12881 mini_ranger_kms.cc:326] Created kudu user
I20260808 04:42:32.943277 12881 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 04:42:32 dist-test-slave-t7g5 krb5kdc[30526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164150, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.12.148.84@KRBTEST.COM
I20260808 04:42:33.318810 12881 mini_ranger_kms.cc:384] Added ranger policy
I20260808 04:42:33.318987 12881 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ranger-kms:/tmp/dist-test-taskMuxZs2/build/debug/bin/postgresql.jar:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskMuxZs2/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 04:42:33.319020 12881 mini_ranger_kms.cc:240] Using host: 127.12.148.84
I20260808 04:42:33.323729 12881 mini_ranger_kms.cc:276] Ranger KMS PID: 31159
I20260808 04:42:33.323824 12881 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.12.148.84:57549
Aug 08, 2026 4:42:34 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 4:42:34 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 4:42:34 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 4:42:34 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 4:42:35 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 4:42:35 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260808 04:42:35.856503 12881 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.276s user 0.002s sys 0.141s
I20260808 04:42:35.856621 12881 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 04:42:35.856694 12881 mini_ranger_kms.cc:401] 127.12.148.84:57549/kms/v1/keys
Aug 08 04:42:35 dist-test-slave-t7g5 krb5kdc[30526](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786164155, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.148.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 08 04:42:36 dist-test-slave-t7g5 krb5kdc[30526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164155, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.148.84@KRBTEST.COM for HTTP/127.12.148.84@KRBTEST.COM
Aug 08 04:42:36 dist-test-slave-t7g5 krb5kdc[30526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164155, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.148.84@KRBTEST.COM for HTTP/127.12.148.84@KRBTEST.COM
Aug 08 04:42:39 dist-test-slave-t7g5 krb5kdc[30526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164159, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.12.148.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
I20260808 04:42:39.098970 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:35981
--webserver_interface=127.12.148.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:38875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:35981
--ranger_config_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.148.84:57549/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:42:39.219341 31234 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:42:39.219621 31234 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:42:39.219660 31234 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:42:39.223783 31234 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:42:39.223858 31234 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:42:39.223877 31234 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:42:39.223892 31234 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:42:39.223905 31234 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:42:39.229470 31234 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:38875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/master-0/wal
--ranger_kms_url=127.12.148.84:57549/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:35981
--ranger_config_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:35981
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31234
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:42:39.230579 31234 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:42:39.231606 31234 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:42:39.240247 31240 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:39.240263 31244 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:39.240357 31242 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:39.240339 31234 server_base.cc:1034] running on GCE node
I20260808 04:42:39.241117 31234 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:42:39.242234 31234 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:42:39.243423 31234 hybrid_clock.cc:648] HybridClock initialized: now 1786164159243397 us; error 40 us; skew 500 ppm
Aug 08 04:42:39 dist-test-slave-t7g5 krb5kdc[30526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164159, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:42:39.246235 31234 init.cc:377] Logged in from keytab as kudu/127.12.148.126@KRBTEST.COM (short username kudu)
I20260808 04:42:39.247099 31234 webserver.cc:460] Webserver started at http://127.12.148.126:46693/ using document root <none> and password file <none>
I20260808 04:42:39.247610 31234 fs_manager.cc:359] Metadata directory not provided
I20260808 04:42:39.247663 31234 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:42:39.247840 31234 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 04:42:39 dist-test-slave-t7g5 krb5kdc[30526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164159, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for HTTP/127.12.148.84@KRBTEST.COM
I20260808 04:42:39.303297 31234 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "b766f889cc4f410a98b6882933cb4e6e"
format_stamp: "Formatted at 2026-08-08 04:42:39 on dist-test-slave-t7g5"
server_key: "7395dec58a5d7a443ddf378d9218ed85"
server_key_iv: "31ee332db4e647440f4623a3356b590e"
server_key_version: "kuduclusterkey@0"
I20260808 04:42:39.303928 31234 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "b766f889cc4f410a98b6882933cb4e6e"
format_stamp: "Formatted at 2026-08-08 04:42:39 on dist-test-slave-t7g5"
server_key: "7395dec58a5d7a443ddf378d9218ed85"
server_key_iv: "31ee332db4e647440f4623a3356b590e"
server_key_version: "kuduclusterkey@0"
I20260808 04:42:39.307942 31234 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 04:42:39.327278 31254 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:39.328704 31234 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 04:42:39.328836 31234 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "b766f889cc4f410a98b6882933cb4e6e"
format_stamp: "Formatted at 2026-08-08 04:42:39 on dist-test-slave-t7g5"
server_key: "7395dec58a5d7a443ddf378d9218ed85"
server_key_iv: "31ee332db4e647440f4623a3356b590e"
server_key_version: "kuduclusterkey@0"
I20260808 04:42:39.329001 31234 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:42:39.345373 31234 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:42:39.348381 31234 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:42:39.348567 31234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:42:39.356037 31234 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:35981
I20260808 04:42:39.356062 31336 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:35981 every 8 connection(s)
I20260808 04:42:39.356980 31234 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:42:39.357903 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 31234
I20260808 04:42:39.358026 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:42:39.358330 12881 external_mini_cluster.cc:1428] Setting key 59bff4efa077506e17f51da7b832c7af
I20260808 04:42:39.361054 31339 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:42:39.367408 31339 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e: Bootstrap starting.
Aug 08 04:42:39 dist-test-slave-t7g5 krb5kdc[30526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164159, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:42:39.369971 31339 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e: Neither blocks nor log segments found. Creating new log.
I20260808 04:42:39.370754 31339 log.cc:824] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e: Log is configured to *not* fsync() on all Append() calls
I20260808 04:42:39.372828 31339 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e: No bootstrap required, opened a new log
I20260808 04:42:39.374934 31342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:39.359667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42364 (local address 127.12.148.126:35981)
0808 04:42:39.360047 (+ 380us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:39.360065 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:39.360107 (+ 42us) server_negotiation.cc:407] Connection header received
0808 04:42:39.360928 (+ 821us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:39.360952 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:39.361354 (+ 402us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:39.361735 (+ 381us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:39.362558 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:39.364045 (+ 1487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:39.365254 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:39.365990 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:39.366142 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:39.369130 (+ 2988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:39.369136 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:39.369153 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:39.369184 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:39.371669 (+ 2485us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:39.372209 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:39.372215 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:39.372221 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:39.372369 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:39.372663 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:39.372666 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:39.372668 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:39.373174 (+ 506us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:39.373390 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:39.373682 (+ 292us) server_negotiation.cc:299] Negotiation successful
0808 04:42:39.373977 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":250,"thread_start_us":102,"threads_started":1}
I20260808 04:42:39.376150 31339 raft_consensus.cc:348] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b766f889cc4f410a98b6882933cb4e6e" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 35981 } }
I20260808 04:42:39.376448 31339 raft_consensus.cc:374] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:42:39.376540 31339 raft_consensus.cc:729] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b766f889cc4f410a98b6882933cb4e6e, State: Initialized, Role: FOLLOWER
I20260808 04:42:39.377000 31339 consensus_queue.cc:260] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b766f889cc4f410a98b6882933cb4e6e" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 35981 } }
I20260808 04:42:39.377256 31339 raft_consensus.cc:388] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:42:39.377393 31339 raft_consensus.cc:482] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:42:39.377539 31339 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:42:39.378451 31339 raft_consensus.cc:504] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b766f889cc4f410a98b6882933cb4e6e" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 35981 } }
I20260808 04:42:39.378765 31339 leader_election.cc:302] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b766f889cc4f410a98b6882933cb4e6e; no voters:
I20260808 04:42:39.379096 31339 leader_election.cc:288] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:42:39.379180 31344 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:42:39.379383 31344 raft_consensus.cc:686] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e [term 1 LEADER]: Becoming Leader. State: Replica: b766f889cc4f410a98b6882933cb4e6e, State: Running, Role: LEADER
I20260808 04:42:39.379731 31344 consensus_queue.cc:237] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b766f889cc4f410a98b6882933cb4e6e" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 35981 } }
I20260808 04:42:39.380453 31339 sys_catalog.cc:564] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:42:39.381019 31344 sys_catalog.cc:455] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e [sys.catalog]: SysCatalogTable state changed. Reason: New leader b766f889cc4f410a98b6882933cb4e6e. Latest consensus state: current_term: 1 leader_uuid: "b766f889cc4f410a98b6882933cb4e6e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b766f889cc4f410a98b6882933cb4e6e" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 35981 } } }
I20260808 04:42:39.381141 31344 sys_catalog.cc:458] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e [sys.catalog]: This master's current role is: LEADER
I20260808 04:42:39.381505 31355 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:42:39.382763 31346 sys_catalog.cc:455] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b766f889cc4f410a98b6882933cb4e6e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b766f889cc4f410a98b6882933cb4e6e" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 35981 } } }
I20260808 04:42:39.382933 31346 sys_catalog.cc:458] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e [sys.catalog]: This master's current role is: LEADER
I20260808 04:42:39.384733 31355 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:42:39.385174 31339 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 04:42:39.399466 31355 catalog_manager.cc:1347] Generated new cluster ID: 6be772a34eba43c7871a8d12f7f4651e
I20260808 04:42:39.399561 31355 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:42:39.426791 31355 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:42:39.428187 31355 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:42:39.439256 31355 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e: Generated new TSK 0
I20260808 04:42:39.440111 31355 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.148.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab.
Entry for principal kudu/127.12.148.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab.
I20260808 04:42:40.107285 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.148.84:57549/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.65:0
--local_ip_for_outbound_sockets=127.12.148.65
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:35981
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:38875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:42:40.234652 31410 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:42:40.234930 31410 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:42:40.234992 31410 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:42:40.240617 31410 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:42:40.240687 31410 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:42:40.240770 31410 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.65
I20260808 04:42:40.247308 31410 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:38875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.12.148.84:57549/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:35981
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31410
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.65
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:42:40.248395 31410 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:42:40.249400 31410 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:42:40.259438 31423 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:40.259580 31420 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:40.259454 31421 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:40.260646 31410 server_base.cc:1034] running on GCE node
I20260808 04:42:40.261041 31410 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:42:40.261695 31410 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:42:40.262897 31410 hybrid_clock.cc:648] HybridClock initialized: now 1786164160262871 us; error 37 us; skew 500 ppm
Aug 08 04:42:40 dist-test-slave-t7g5 krb5kdc[30526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164160, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:42:40.265733 31410 init.cc:377] Logged in from keytab as kudu/127.12.148.65@KRBTEST.COM (short username kudu)
I20260808 04:42:40.266659 31410 webserver.cc:460] Webserver started at http://127.12.148.65:42265/ using document root <none> and password file <none>
I20260808 04:42:40.267210 31410 fs_manager.cc:359] Metadata directory not provided
I20260808 04:42:40.267280 31410 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:42:40.267473 31410 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 04:42:40 dist-test-slave-t7g5 krb5kdc[30526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164160, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for HTTP/127.12.148.84@KRBTEST.COM
I20260808 04:42:40.284722 31410 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-0/data/instance:
uuid: "44f30722209c42fab03aae8b41020bef"
format_stamp: "Formatted at 2026-08-08 04:42:40 on dist-test-slave-t7g5"
server_key: "a478050ef01d4465af60ec922cc47a73"
server_key_iv: "165ecfbea5ea999810055b14e4475d22"
server_key_version: "kuduclusterkey@0"
I20260808 04:42:40.286433 31410 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance:
uuid: "44f30722209c42fab03aae8b41020bef"
format_stamp: "Formatted at 2026-08-08 04:42:40 on dist-test-slave-t7g5"
server_key: "a478050ef01d4465af60ec922cc47a73"
server_key_iv: "165ecfbea5ea999810055b14e4475d22"
server_key_version: "kuduclusterkey@0"
I20260808 04:42:40.290530 31410 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 04:42:40.309427 31431 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:40.311345 31410 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.000s
I20260808 04:42:40.311578 31410 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-0/wal
uuid: "44f30722209c42fab03aae8b41020bef"
format_stamp: "Formatted at 2026-08-08 04:42:40 on dist-test-slave-t7g5"
server_key: "a478050ef01d4465af60ec922cc47a73"
server_key_iv: "165ecfbea5ea999810055b14e4475d22"
server_key_version: "kuduclusterkey@0"
I20260808 04:42:40.311776 31410 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:42:40.330021 31410 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:42:40.333871 31410 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:42:40.334123 31410 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:42:40.334859 31410 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:42:40.335985 31410 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:42:40.336100 31410 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:40.336227 31410 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:42:40.336306 31410 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:40.350185 31410 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.65:35519
I20260808 04:42:40.351123 31410 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
I20260808 04:42:40.351665 31613 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.65:35519 every 8 connection(s)
I20260808 04:42:40.356366 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 31410
I20260808 04:42:40.356498 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance
I20260808 04:42:40.356792 12881 external_mini_cluster.cc:1428] Setting key 8e522f24da376e4f854ac6b806ee5059
Aug 08 04:42:40 dist-test-slave-t7g5 krb5kdc[30526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164160, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:42:40.372287 31621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:40.353614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:56335 (local address 127.12.148.126:35981)
0808 04:42:40.353962 (+ 348us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:40.353971 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:40.354810 (+ 839us) server_negotiation.cc:407] Connection header received
0808 04:42:40.356057 (+ 1247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:40.356061 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:40.356129 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:40.356200 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:40.357969 (+ 1769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:40.358855 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:40.364284 (+ 5429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:40.364635 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:40.364713 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:40.367853 (+ 3140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:40.367857 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:40.367860 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:40.367888 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:40.369690 (+ 1802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:40.370306 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:40.370310 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:40.370312 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:40.370404 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:40.370912 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:40.370915 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:40.370917 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:40.371181 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:40.371292 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:40.371958 (+ 666us) server_negotiation.cc:299] Negotiation successful
0808 04:42:40.372098 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":248,"thread_start_us":140,"threads_started":1}
I20260808 04:42:40.373252 31624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:40.354121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:35981 (local address 127.12.148.65:56335)
0808 04:42:40.354624 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:40.354683 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:40.355745 (+ 1062us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:40.356628 (+ 883us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:40.356638 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:40.356998 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:42:40.357797 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:40.357820 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:40.362674 (+ 4854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:40.362677 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:40.364140 (+ 1463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:40.364152 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:40.364943 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:40.364946 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:40.365154 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:40.365901 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:42:40.365927 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:42:40.367641 (+ 1714us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:42:40.369836 (+ 2195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:40.369842 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:40.369859 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:40.370193 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:40.370502 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:40.370504 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:40.370556 (+ 52us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:40.370757 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:40.371307 (+ 550us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:42:40.371315 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:42:40.371653 (+ 338us) client_negotiation.cc:769] Sending connection context
0808 04:42:40.371872 (+ 219us) client_negotiation.cc:240] Negotiation successful
0808 04:42:40.372226 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":104,"threads_started":1}
I20260808 04:42:40.374720 31615 heartbeater.cc:347] Connected to a master server at 127.12.148.126:35981
I20260808 04:42:40.374989 31615 heartbeater.cc:464] Registering TS with master...
I20260808 04:42:40.375564 31615 heartbeater.cc:511] Master 127.12.148.126:35981 requested a full tablet report, sending...
I20260808 04:42:40.377393 31279 ts_manager.cc:194] Registered new tserver with Master: 44f30722209c42fab03aae8b41020bef (127.12.148.65:35519)
I20260808 04:42:40.379038 31279 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.65@KRBTEST.COM'} at 127.12.148.65:56335
WARNING: no policy specified for kudu/127.12.148.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab.
Entry for principal kudu/127.12.148.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab.
I20260808 04:42:40.399988 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.148.84:57549/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.66:0
--local_ip_for_outbound_sockets=127.12.148.66
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:35981
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:38875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 04:42:40 dist-test-slave-t7g5 krb5kdc[30526](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786164160, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 04:42:40.529793 31630 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:42:40.530072 31630 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:42:40.530133 31630 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:42:40.534791 31630 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:42:40.534868 31630 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:42:40.534951 31630 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.66
I20260808 04:42:40.540433 31630 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:38875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.12.148.84:57549/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:35981
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31630
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.66
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:42:40.541934 31630 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:42:40.543175 31630 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:42:40.552587 31644 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:40.552675 31643 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:40.552975 31630 server_base.cc:1034] running on GCE node
W20260808 04:42:40.553138 31649 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:40.553529 31630 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:42:40.554196 31630 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:42:40.555413 31630 hybrid_clock.cc:648] HybridClock initialized: now 1786164160555337 us; error 92 us; skew 500 ppm
Aug 08 04:42:40 dist-test-slave-t7g5 krb5kdc[30526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164160, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:42:40.558591 31630 init.cc:377] Logged in from keytab as kudu/127.12.148.66@KRBTEST.COM (short username kudu)
I20260808 04:42:40.559648 31630 webserver.cc:460] Webserver started at http://127.12.148.66:42633/ using document root <none> and password file <none>
I20260808 04:42:40.560215 31630 fs_manager.cc:359] Metadata directory not provided
I20260808 04:42:40.560282 31630 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:42:40.560477 31630 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 04:42:40 dist-test-slave-t7g5 krb5kdc[30526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164160, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for HTTP/127.12.148.84@KRBTEST.COM
I20260808 04:42:40.579362 31630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-1/data/instance:
uuid: "304966c9500b4d99a9dfe0a41303e36f"
format_stamp: "Formatted at 2026-08-08 04:42:40 on dist-test-slave-t7g5"
server_key: "121071036108caac54bc297e3d236b54"
server_key_iv: "e8d16ea94baf5a2e7c42e56439f8648b"
server_key_version: "kuduclusterkey@0"
I20260808 04:42:40.580245 31630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance:
uuid: "304966c9500b4d99a9dfe0a41303e36f"
format_stamp: "Formatted at 2026-08-08 04:42:40 on dist-test-slave-t7g5"
server_key: "121071036108caac54bc297e3d236b54"
server_key_iv: "e8d16ea94baf5a2e7c42e56439f8648b"
server_key_version: "kuduclusterkey@0"
I20260808 04:42:40.595472 31630 fs_manager.cc:691] Time spent creating directory manager: real 0.013s user 0.004s sys 0.000s
I20260808 04:42:40.616194 31658 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:40.618300 31630 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.004s sys 0.000s
I20260808 04:42:40.619248 31630 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-1/wal
uuid: "304966c9500b4d99a9dfe0a41303e36f"
format_stamp: "Formatted at 2026-08-08 04:42:40 on dist-test-slave-t7g5"
server_key: "121071036108caac54bc297e3d236b54"
server_key_iv: "e8d16ea94baf5a2e7c42e56439f8648b"
server_key_version: "kuduclusterkey@0"
I20260808 04:42:40.619529 31630 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:42:40.653354 31630 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:42:40.657353 31630 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:42:40.657642 31630 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:42:40.658557 31630 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:42:40.659765 31630 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:42:40.660256 31630 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20260808 04:42:40.660385 31630 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:42:40.660471 31630 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:40.672482 31630 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.66:41147
I20260808 04:42:40.678238 31630 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
I20260808 04:42:40.679327 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 31630
I20260808 04:42:40.679456 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance
I20260808 04:42:40.679766 12881 external_mini_cluster.cc:1428] Setting key 383a5b294b22e0867e9603541709417e
I20260808 04:42:40.676895 31821 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.66:41147 every 8 connection(s)
Aug 08 04:42:40 dist-test-slave-t7g5 krb5kdc[30526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164160, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:42:40.706239 31621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:40.681832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:36607 (local address 127.12.148.126:35981)
0808 04:42:40.681968 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:40.681973 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:40.683732 (+ 1759us) server_negotiation.cc:407] Connection header received
0808 04:42:40.685225 (+ 1493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:40.685230 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:40.685285 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:40.685341 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:40.687650 (+ 2309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:40.688521 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:40.693793 (+ 5272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:40.694192 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:40.694298 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:40.698491 (+ 4193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:40.698495 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:40.698498 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:40.698533 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:40.700357 (+ 1824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:40.701130 (+ 773us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:40.701134 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:40.701136 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:40.701237 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:40.701757 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:40.701761 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:40.701762 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:40.702019 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:40.702110 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:40.705838 (+ 3728us) server_negotiation.cc:299] Negotiation successful
0808 04:42:40.706052 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 04:42:40.708420 31826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:40.682239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:35981 (local address 127.12.148.66:36607)
0808 04:42:40.683555 (+ 1316us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:40.683621 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:40.684957 (+ 1336us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:40.685859 (+ 902us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:40.685869 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:40.686264 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:42:40.687029 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:40.687053 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:40.688704 (+ 1651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:40.688707 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:40.690238 (+ 1531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:40.690251 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:40.694588 (+ 4337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:40.694592 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:40.694858 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:40.696214 (+ 1356us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:42:40.696241 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:42:40.698209 (+ 1968us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:42:40.700542 (+ 2333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:40.700549 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:40.700570 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:40.700993 (+ 423us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:40.701359 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:40.701362 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:40.701363 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:40.701597 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:40.702185 (+ 588us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:42:40.702192 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:42:40.702588 (+ 396us) client_negotiation.cc:769] Sending connection context
0808 04:42:40.706778 (+ 4190us) client_negotiation.cc:240] Negotiation successful
0808 04:42:40.707206 (+ 428us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1059,"thread_start_us":168,"threads_started":1}
I20260808 04:42:40.710207 31824 heartbeater.cc:347] Connected to a master server at 127.12.148.126:35981
I20260808 04:42:40.710489 31824 heartbeater.cc:464] Registering TS with master...
I20260808 04:42:40.711120 31824 heartbeater.cc:511] Master 127.12.148.126:35981 requested a full tablet report, sending...
I20260808 04:42:40.712370 31279 ts_manager.cc:194] Registered new tserver with Master: 304966c9500b4d99a9dfe0a41303e36f (127.12.148.66:41147)
I20260808 04:42:40.713160 31279 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.66@KRBTEST.COM'} at 127.12.148.66:36607
WARNING: no policy specified for kudu/127.12.148.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab.
Entry for principal kudu/127.12.148.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab.
I20260808 04:42:40.740908 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.148.84:57549/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.67:0
--local_ip_for_outbound_sockets=127.12.148.67
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:35981
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:38875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:42:40.913297 31833 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:42:40.913724 31833 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:42:40.913801 31833 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:42:40.920606 31833 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:42:40.920742 31833 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:42:40.920876 31833 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.67
I20260808 04:42:40.929041 31833 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:38875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.12.148.84:57549/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:35981
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31833
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.67
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:42:40.930810 31833 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:42:40.932684 31833 file_cache.cc:493] Constructed file cache file cache with capacity 419430
Aug 08 04:42:40 dist-test-slave-t7g5 krb5kdc[30526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164160, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for HTTP/127.12.148.84@KRBTEST.COM
W20260808 04:42:40.962563 31842 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:40.963090 31850 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:40.964141 31840 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:40.966925 31833 server_base.cc:1034] running on GCE node
I20260808 04:42:40.967389 31833 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:42:40.968083 31833 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:42:40.969255 31833 hybrid_clock.cc:648] HybridClock initialized: now 1786164160969173 us; error 94 us; skew 500 ppm
Aug 08 04:42:40 dist-test-slave-t7g5 krb5kdc[30526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164160, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:42:40.972934 31833 init.cc:377] Logged in from keytab as kudu/127.12.148.67@KRBTEST.COM (short username kudu)
I20260808 04:42:40.974013 31833 webserver.cc:460] Webserver started at http://127.12.148.67:41611/ using document root <none> and password file <none>
I20260808 04:42:40.974793 31833 fs_manager.cc:359] Metadata directory not provided
I20260808 04:42:40.974961 31833 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:42:40.975274 31833 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 04:42:40 dist-test-slave-t7g5 krb5kdc[30526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164160, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for HTTP/127.12.148.84@KRBTEST.COM
I20260808 04:42:40.997592 31833 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-2/data/instance:
uuid: "7d3d6b72e5764fa29f5860d5aea90bdb"
format_stamp: "Formatted at 2026-08-08 04:42:40 on dist-test-slave-t7g5"
server_key: "3bff64c8d0537058f56326d06496efae"
server_key_iv: "d22ce427c6c87a53dc63c4b6e4edfa46"
server_key_version: "kuduclusterkey@0"
I20260808 04:42:40.998656 31833 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance:
uuid: "7d3d6b72e5764fa29f5860d5aea90bdb"
format_stamp: "Formatted at 2026-08-08 04:42:40 on dist-test-slave-t7g5"
server_key: "3bff64c8d0537058f56326d06496efae"
server_key_iv: "d22ce427c6c87a53dc63c4b6e4edfa46"
server_key_version: "kuduclusterkey@0"
I20260808 04:42:41.019553 31833 fs_manager.cc:691] Time spent creating directory manager: real 0.020s user 0.004s sys 0.000s
I20260808 04:42:41.056943 31864 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:41.058791 31833 fs_manager.cc:725] Time spent opening block manager: real 0.015s user 0.003s sys 0.000s
I20260808 04:42:41.058936 31833 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-2/wal
uuid: "7d3d6b72e5764fa29f5860d5aea90bdb"
format_stamp: "Formatted at 2026-08-08 04:42:40 on dist-test-slave-t7g5"
server_key: "3bff64c8d0537058f56326d06496efae"
server_key_iv: "d22ce427c6c87a53dc63c4b6e4edfa46"
server_key_version: "kuduclusterkey@0"
I20260808 04:42:41.059078 31833 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:42:41.095160 31833 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:42:41.098773 31833 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:42:41.098997 31833 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:42:41.099747 31833 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:42:41.100804 31833 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:42:41.100867 31833 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:41.100976 31833 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:42:41.101007 31833 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:41.114526 31833 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.67:45865
I20260808 04:42:41.115794 31833 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
I20260808 04:42:41.117146 32038 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.67:45865 every 8 connection(s)
I20260808 04:42:41.117638 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 31833
I20260808 04:42:41.117780 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance
I20260808 04:42:41.118095 12881 external_mini_cluster.cc:1428] Setting key 11d54ee2fa795a72df490cfa4ebcc584
Aug 08 04:42:41 dist-test-slave-t7g5 krb5kdc[30526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164160, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:42:41.139830 31621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:41.123520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:45329 (local address 127.12.148.126:35981)
0808 04:42:41.123641 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:41.123645 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:41.124129 (+ 484us) server_negotiation.cc:407] Connection header received
0808 04:42:41.125382 (+ 1253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:41.125386 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:41.125438 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:41.125488 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:41.127376 (+ 1888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:41.128208 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:41.129950 (+ 1742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:41.130302 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:41.130387 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:41.135563 (+ 5176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:41.135567 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:41.135570 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:41.135600 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:41.137319 (+ 1719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:41.137993 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:41.137997 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:41.137999 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:41.138094 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:41.138509 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:41.138513 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:41.138514 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:41.138746 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:41.138824 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:41.139520 (+ 696us) server_negotiation.cc:299] Negotiation successful
0808 04:42:41.139661 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 04:42:41.141824 32042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:41.122411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:35981 (local address 127.12.148.67:45329)
0808 04:42:41.123981 (+ 1570us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:41.124040 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:41.125109 (+ 1069us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:41.126002 (+ 893us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:41.126011 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:41.126400 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:42:41.127193 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:41.127213 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:41.128375 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:41.128378 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:41.129811 (+ 1433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:41.129822 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:41.130598 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:41.130601 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:41.130803 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:41.133280 (+ 2477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:42:41.133302 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:42:41.135325 (+ 2023us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:42:41.137465 (+ 2140us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:41.137471 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:41.137489 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:41.137870 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:41.138195 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:41.138198 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:41.138200 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:41.138401 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:41.138891 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:42:41.138898 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:42:41.139228 (+ 330us) client_negotiation.cc:769] Sending connection context
0808 04:42:41.140329 (+ 1101us) client_negotiation.cc:240] Negotiation successful
0808 04:42:41.140696 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1345,"thread_start_us":146,"threads_started":1}
I20260808 04:42:41.144837 32040 heartbeater.cc:347] Connected to a master server at 127.12.148.126:35981
I20260808 04:42:41.145088 32040 heartbeater.cc:464] Registering TS with master...
I20260808 04:42:41.145714 32040 heartbeater.cc:511] Master 127.12.148.126:35981 requested a full tablet report, sending...
I20260808 04:42:41.146915 31279 ts_manager.cc:194] Registered new tserver with Master: 7d3d6b72e5764fa29f5860d5aea90bdb (127.12.148.67:45865)
I20260808 04:42:41.147652 31279 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.67@KRBTEST.COM'} at 127.12.148.67:45329
I20260808 04:42:41.158056 12881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 04:42:41.158854 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 31410
I20260808 04:42:41.167327 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 31630
I20260808 04:42:41.188050 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 31833
I20260808 04:42:41.201429 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 31234
I20260808 04:42:41.218638 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:35981
--webserver_interface=127.12.148.126
--webserver_port=46693
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:38875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:35981
--ranger_config_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.148.84:57549/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.148.84:57549/kms with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:42:41.329632 32044 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:42:41.329913 32044 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:42:41.329952 32044 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:42:41.333925 32044 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:42:41.333982 32044 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:42:41.334002 32044 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:42:41.334017 32044 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:42:41.334030 32044 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:42:41.339459 32044 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:38875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.148.84:57549/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:35981
--ranger_config_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:35981
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=46693
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32044
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:42:41.340476 32044 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:42:41.341503 32044 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:42:41.349851 32053 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:41.349814 32056 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:41.349821 32059 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:41.349855 32044 server_base.cc:1034] running on GCE node
I20260808 04:42:41.350579 32044 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:42:41.351655 32044 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:42:41.352820 32044 hybrid_clock.cc:648] HybridClock initialized: now 1786164161352800 us; error 31 us; skew 500 ppm
Aug 08 04:42:41 dist-test-slave-t7g5 krb5kdc[30526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164161, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:42:41.355767 32044 init.cc:377] Logged in from keytab as kudu/127.12.148.126@KRBTEST.COM (short username kudu)
I20260808 04:42:41.356673 32044 webserver.cc:460] Webserver started at http://127.12.148.126:46693/ using document root <none> and password file <none>
I20260808 04:42:41.357193 32044 fs_manager.cc:359] Metadata directory not provided
I20260808 04:42:41.357280 32044 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 04:42:41 dist-test-slave-t7g5 krb5kdc[30526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164161, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for HTTP/127.12.148.84@KRBTEST.COM
I20260808 04:42:41.399142 32044 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 04:42:41.401556 32071 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:41.402932 32044 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 04:42:41.403066 32044 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "b766f889cc4f410a98b6882933cb4e6e"
format_stamp: "Formatted at 2026-08-08 04:42:39 on dist-test-slave-t7g5"
server_key: "7395dec58a5d7a443ddf378d9218ed85"
server_key_iv: "31ee332db4e647440f4623a3356b590e"
server_key_version: "kuduclusterkey@0"
I20260808 04:42:41.403640 32044 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:42:41.414495 32044 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:42:41.417312 32044 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:42:41.417495 32044 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:42:41.424469 32153 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:35981 every 8 connection(s)
I20260808 04:42:41.424494 32044 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:35981
I20260808 04:42:41.425622 32044 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:42:41.429900 32154 sys_catalog.cc:263] Verifying existing consensus state
I20260808 04:42:41.431550 32154 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e: Bootstrap starting.
I20260808 04:42:41.435889 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 32044
I20260808 04:42:41.436304 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.148.84:57549/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.65:35519
--local_ip_for_outbound_sockets=127.12.148.65
--tserver_master_addrs=127.12.148.126:35981
--webserver_port=42265
--webserver_interface=127.12.148.65
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:38875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.148.84:57549/kms with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 04:42:41.450879 32154 log.cc:824] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e: Log is configured to *not* fsync() on all Append() calls
I20260808 04:42:41.459512 32154 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 04:42:41.459991 32154 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e: Bootstrap complete.
I20260808 04:42:41.465602 32154 raft_consensus.cc:348] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b766f889cc4f410a98b6882933cb4e6e" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 35981 } }
I20260808 04:42:41.466220 32154 raft_consensus.cc:729] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b766f889cc4f410a98b6882933cb4e6e, State: Initialized, Role: FOLLOWER
I20260808 04:42:41.466815 32154 consensus_queue.cc:260] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b766f889cc4f410a98b6882933cb4e6e" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 35981 } }
I20260808 04:42:41.466974 32154 raft_consensus.cc:388] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:42:41.467042 32154 raft_consensus.cc:482] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:42:41.467139 32154 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e [term 1 FOLLOWER]: Advancing to term 2
I20260808 04:42:41.469700 32154 raft_consensus.cc:504] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b766f889cc4f410a98b6882933cb4e6e" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 35981 } }
I20260808 04:42:41.470098 32154 leader_election.cc:302] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b766f889cc4f410a98b6882933cb4e6e; no voters:
I20260808 04:42:41.470464 32154 leader_election.cc:288] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 04:42:41.470582 32163 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e [term 2 FOLLOWER]: Leader election won for term 2
I20260808 04:42:41.470865 32163 raft_consensus.cc:686] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e [term 2 LEADER]: Becoming Leader. State: Replica: b766f889cc4f410a98b6882933cb4e6e, State: Running, Role: LEADER
I20260808 04:42:41.471192 32163 consensus_queue.cc:237] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b766f889cc4f410a98b6882933cb4e6e" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 35981 } }
I20260808 04:42:41.471753 32154 sys_catalog.cc:564] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:42:41.472707 32165 sys_catalog.cc:455] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e [sys.catalog]: SysCatalogTable state changed. Reason: New leader b766f889cc4f410a98b6882933cb4e6e. Latest consensus state: current_term: 2 leader_uuid: "b766f889cc4f410a98b6882933cb4e6e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b766f889cc4f410a98b6882933cb4e6e" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 35981 } } }
I20260808 04:42:41.472838 32165 sys_catalog.cc:458] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e [sys.catalog]: This master's current role is: LEADER
I20260808 04:42:41.473196 32174 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:42:41.473179 32164 sys_catalog.cc:455] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "b766f889cc4f410a98b6882933cb4e6e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b766f889cc4f410a98b6882933cb4e6e" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 35981 } } }
I20260808 04:42:41.473284 32164 sys_catalog.cc:458] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e [sys.catalog]: This master's current role is: LEADER
I20260808 04:42:41.476596 32174 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:42:41.477147 32154 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 04:42:41.477281 32174 catalog_manager.cc:1259] Loaded cluster ID: 6be772a34eba43c7871a8d12f7f4651e
I20260808 04:42:41.477344 32174 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:42:41.479907 32174 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:42:41.480593 32174 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e: Loaded TSK: 0
I20260808 04:42:41.481920 32174 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 04:42:41.597646 32159 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:42:41.598058 32159 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:42:41.598134 32159 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:42:41.604192 32159 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:42:41.604274 32159 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:42:41.604360 32159 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.65
I20260808 04:42:41.612291 32159 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:38875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.148.84:57549/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.65:35519
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.148.65
--webserver_port=42265
--tserver_master_addrs=127.12.148.126:35981
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32159
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.65
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:42:41.613742 32159 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:42:41.615162 32159 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:42:41.628304 32215 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:41.628364 32213 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:41.628376 32212 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:41.629035 32159 server_base.cc:1034] running on GCE node
I20260808 04:42:41.629436 32159 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:42:41.630095 32159 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:42:41.631275 32159 hybrid_clock.cc:648] HybridClock initialized: now 1786164161631241 us; error 34 us; skew 500 ppm
Aug 08 04:42:41 dist-test-slave-t7g5 krb5kdc[30526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164161, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:42:41.634855 32159 init.cc:377] Logged in from keytab as kudu/127.12.148.65@KRBTEST.COM (short username kudu)
I20260808 04:42:41.635933 32159 webserver.cc:460] Webserver started at http://127.12.148.65:42265/ using document root <none> and password file <none>
I20260808 04:42:41.636631 32159 fs_manager.cc:359] Metadata directory not provided
I20260808 04:42:41.636736 32159 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 04:42:41 dist-test-slave-t7g5 krb5kdc[30526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164161, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for HTTP/127.12.148.84@KRBTEST.COM
I20260808 04:42:41.661113 32159 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 04:42:41.667229 32225 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:41.669008 32159 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.002s sys 0.000s
I20260808 04:42:41.669245 32159 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-0/wal
uuid: "44f30722209c42fab03aae8b41020bef"
format_stamp: "Formatted at 2026-08-08 04:42:40 on dist-test-slave-t7g5"
server_key: "a478050ef01d4465af60ec922cc47a73"
server_key_iv: "165ecfbea5ea999810055b14e4475d22"
server_key_version: "kuduclusterkey@0"
I20260808 04:42:41.670063 32159 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:42:41.690979 32159 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:42:41.694800 32159 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:42:41.695032 32159 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:42:41.695789 32159 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:42:41.696882 32159 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:42:41.696933 32159 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:41.696985 32159 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:42:41.697006 32159 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:41.707901 32159 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.65:35519
I20260808 04:42:41.707953 32407 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.65:35519 every 8 connection(s)
I20260808 04:42:41.709265 32159 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
I20260808 04:42:41.717082 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 32159
I20260808 04:42:41.717620 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.148.84:57549/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.66:41147
--local_ip_for_outbound_sockets=127.12.148.66
--tserver_master_addrs=127.12.148.126:35981
--webserver_port=42633
--webserver_interface=127.12.148.66
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:38875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.148.84:57549/kms with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 04:42:41 dist-test-slave-t7g5 krb5kdc[30526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164161, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:42:41.744688 32414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:41.716917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:48957 (local address 127.12.148.126:35981)
0808 04:42:41.717717 (+ 800us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:41.717740 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:41.717793 (+ 53us) server_negotiation.cc:407] Connection header received
0808 04:42:41.718120 (+ 327us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:41.718138 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:41.718583 (+ 445us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:41.718924 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:41.720303 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:41.721778 (+ 1475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:41.723445 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:41.724180 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:41.724324 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:41.728713 (+ 4389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:41.728721 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:41.728742 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:41.728782 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:41.731141 (+ 2359us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:41.731844 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:41.731851 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:41.731857 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:41.732011 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:41.737626 (+ 5615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:41.737631 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:41.737633 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:41.738197 (+ 564us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:41.738308 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:41.743210 (+ 4902us) server_negotiation.cc:299] Negotiation successful
0808 04:42:41.743588 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":623,"thread_start_us":121,"threads_started":1}
I20260808 04:42:41.746804 32413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:41.711946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:35981 (local address 127.12.148.65:48957)
0808 04:42:41.713222 (+ 1276us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:41.713282 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:41.714355 (+ 1073us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:41.719019 (+ 4664us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:41.719027 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:41.719404 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:42:41.720091 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:41.720111 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:41.721948 (+ 1837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:41.721951 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:41.723284 (+ 1333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:41.723296 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:41.724618 (+ 1322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:41.724623 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:41.724823 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:41.725704 (+ 881us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:42:41.725729 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:42:41.728434 (+ 2705us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:42:41.731297 (+ 2863us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:41.731304 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:41.731323 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:41.731699 (+ 376us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:41.732122 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:41.732125 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:41.732127 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:41.732698 (+ 571us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:41.738408 (+ 5710us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:42:41.738415 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:42:41.742768 (+ 4353us) client_negotiation.cc:769] Sending connection context
0808 04:42:41.745533 (+ 2765us) client_negotiation.cc:240] Negotiation successful
0808 04:42:41.745904 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1042,"thread_start_us":146,"threads_started":1}
I20260808 04:42:41.749984 32409 heartbeater.cc:347] Connected to a master server at 127.12.148.126:35981
I20260808 04:42:41.750216 32409 heartbeater.cc:464] Registering TS with master...
I20260808 04:42:41.750780 32409 heartbeater.cc:511] Master 127.12.148.126:35981 requested a full tablet report, sending...
W20260808 04:42:41.753109 32409 heartbeater.cc:644] Failed to heartbeat to 127.12.148.126:35981 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 04:42:41.753237 32409 heartbeater.cc:464] Registering TS with master...
I20260808 04:42:41.753428 32409 heartbeater.cc:511] Master 127.12.148.126:35981 requested a full tablet report, sending...
I20260808 04:42:41.754408 32409 heartbeater.cc:464] Registering TS with master...
I20260808 04:42:41.754580 32409 heartbeater.cc:511] Master 127.12.148.126:35981 requested a full tablet report, sending...
W20260808 04:42:41.755438 32409 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 04:42:41.854954 32415 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:42:41.855248 32415 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:42:41.855322 32415 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:42:41.859361 32415 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:42:41.859428 32415 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:42:41.859486 32415 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.66
I20260808 04:42:41.864820 32415 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:38875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.148.84:57549/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.66:41147
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.148.66
--webserver_port=42633
--tserver_master_addrs=127.12.148.126:35981
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32415
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.66
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:42:41.865965 32415 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:42:41.866968 32415 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:42:41.877079 32426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:41.877267 32415 server_base.cc:1034] running on GCE node
W20260808 04:42:41.877089 32422 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:41.877813 32428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:41.878224 32415 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:42:41.878839 32415 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:42:41.880012 32415 hybrid_clock.cc:648] HybridClock initialized: now 1786164161879986 us; error 41 us; skew 500 ppm
Aug 08 04:42:41 dist-test-slave-t7g5 krb5kdc[30526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164161, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:42:41.882972 32415 init.cc:377] Logged in from keytab as kudu/127.12.148.66@KRBTEST.COM (short username kudu)
I20260808 04:42:41.883867 32415 webserver.cc:460] Webserver started at http://127.12.148.66:42633/ using document root <none> and password file <none>
I20260808 04:42:41.884431 32415 fs_manager.cc:359] Metadata directory not provided
I20260808 04:42:41.884510 32415 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 04:42:41 dist-test-slave-t7g5 krb5kdc[30526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164161, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for HTTP/127.12.148.84@KRBTEST.COM
I20260808 04:42:41.907413 32415 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.003s sys 0.000s
I20260808 04:42:41.910563 32440 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:41.912313 32415 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260808 04:42:41.912473 32415 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-1/wal
uuid: "304966c9500b4d99a9dfe0a41303e36f"
format_stamp: "Formatted at 2026-08-08 04:42:40 on dist-test-slave-t7g5"
server_key: "121071036108caac54bc297e3d236b54"
server_key_iv: "e8d16ea94baf5a2e7c42e56439f8648b"
server_key_version: "kuduclusterkey@0"
I20260808 04:42:41.913278 32415 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:42:41.931257 32415 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:42:41.934840 32415 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:42:41.935053 32415 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:42:41.935806 32415 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:42:41.936759 32415 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:42:41.936832 32415 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:41.936896 32415 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:42:41.936928 32415 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:41.947710 32415 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.66:41147
I20260808 04:42:41.947964 32625 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.66:41147 every 8 connection(s)
I20260808 04:42:41.949026 32415 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
I20260808 04:42:41.957285 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 32415
I20260808 04:42:41.957867 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.148.84:57549/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.67:45865
--local_ip_for_outbound_sockets=127.12.148.67
--tserver_master_addrs=127.12.148.126:35981
--webserver_port=41611
--webserver_interface=127.12.148.67
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:38875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.148.84:57549/kms with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 04:42:41 dist-test-slave-t7g5 krb5kdc[30526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164161, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:42:41.965616 32629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:41.952228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:35981 (local address 127.12.148.66:59737)
0808 04:42:41.952695 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:41.952749 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:41.953705 (+ 956us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:41.954253 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:41.954260 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:41.954538 (+ 278us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:42:41.955037 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:41.955051 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:41.955872 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:41.955875 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:41.956757 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:41.956766 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:41.957569 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:41.957574 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:41.957809 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:41.958604 (+ 795us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:42:41.958627 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:42:41.960240 (+ 1613us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:42:41.962219 (+ 1979us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:41.962225 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:41.962243 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:41.962593 (+ 350us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:41.962910 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:41.962913 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:41.962915 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:41.963099 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:41.963582 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:42:41.963588 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:42:41.963903 (+ 315us) client_negotiation.cc:769] Sending connection context
0808 04:42:41.964104 (+ 201us) client_negotiation.cc:240] Negotiation successful
0808 04:42:41.964433 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":103,"threads_started":1}
I20260808 04:42:41.966215 32414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:41.951713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:59737 (local address 127.12.148.126:35981)
0808 04:42:41.951852 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:41.951856 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:41.952857 (+ 1001us) server_negotiation.cc:407] Connection header received
0808 04:42:41.953916 (+ 1059us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:41.953920 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:41.953981 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:41.954058 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:41.955192 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:41.955745 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:41.956883 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:41.957200 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:41.957321 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:41.960423 (+ 3102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:41.960427 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:41.960430 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:41.960462 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:41.962080 (+ 1618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:41.962713 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:41.962717 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:41.962718 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:41.962811 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:41.963205 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:41.963209 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:41.963210 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:41.963427 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:41.963529 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:41.965907 (+ 2378us) server_negotiation.cc:299] Negotiation successful
0808 04:42:41.966054 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 04:42:41.967743 32626 heartbeater.cc:347] Connected to a master server at 127.12.148.126:35981
I20260808 04:42:41.967993 32626 heartbeater.cc:464] Registering TS with master...
I20260808 04:42:41.968492 32626 heartbeater.cc:511] Master 127.12.148.126:35981 requested a full tablet report, sending...
W20260808 04:42:41.970122 32626 heartbeater.cc:644] Failed to heartbeat to 127.12.148.126:35981 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 04:42:41.970242 32626 heartbeater.cc:464] Registering TS with master...
I20260808 04:42:41.970408 32626 heartbeater.cc:511] Master 127.12.148.126:35981 requested a full tablet report, sending...
I20260808 04:42:41.971266 32626 heartbeater.cc:464] Registering TS with master...
I20260808 04:42:41.971439 32626 heartbeater.cc:511] Master 127.12.148.126:35981 requested a full tablet report, sending...
W20260808 04:42:41.972189 32626 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 04:42:42.119256 32631 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:42:42.119562 32631 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:42:42.119626 32631 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:42:42.123823 32631 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:42:42.123898 32631 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:42:42.123979 32631 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.67
I20260808 04:42:42.130035 32631 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:38875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.148.84:57549/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.67:45865
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.148.67
--webserver_port=41611
--tserver_master_addrs=127.12.148.126:35981
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32631
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.67
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:42:42.131508 32631 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:42:42.132925 32631 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:42:42.144956 32644 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:42.145044 32643 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:42.145318 32646 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:42.145879 32631 server_base.cc:1034] running on GCE node
I20260808 04:42:42.146298 32631 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:42:42.147002 32631 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:42:42.148185 32631 hybrid_clock.cc:648] HybridClock initialized: now 1786164162148149 us; error 55 us; skew 500 ppm
Aug 08 04:42:42 dist-test-slave-t7g5 krb5kdc[30526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164162, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:42:42.151086 32631 init.cc:377] Logged in from keytab as kudu/127.12.148.67@KRBTEST.COM (short username kudu)
I20260808 04:42:42.152074 32631 webserver.cc:460] Webserver started at http://127.12.148.67:41611/ using document root <none> and password file <none>
I20260808 04:42:42.152633 32631 fs_manager.cc:359] Metadata directory not provided
I20260808 04:42:42.152719 32631 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 04:42:42 dist-test-slave-t7g5 krb5kdc[30526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164162, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for HTTP/127.12.148.84@KRBTEST.COM
I20260808 04:42:42.180455 32631 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 04:42:42.183878 32664 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:42.185493 32631 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260808 04:42:42.185645 32631 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-2/wal
uuid: "7d3d6b72e5764fa29f5860d5aea90bdb"
format_stamp: "Formatted at 2026-08-08 04:42:40 on dist-test-slave-t7g5"
server_key: "3bff64c8d0537058f56326d06496efae"
server_key_iv: "d22ce427c6c87a53dc63c4b6e4edfa46"
server_key_version: "kuduclusterkey@0"
I20260808 04:42:42.186486 32631 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:42:42.204695 32631 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:42:42.208346 32631 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:42:42.208582 32631 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:42:42.209425 32631 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:42:42.210431 32631 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:42:42.210484 32631 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:42.210529 32631 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:42:42.210559 32631 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:42.221961 32631 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.67:45865
I20260808 04:42:42.223308 32631 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
I20260808 04:42:42.226044 384 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.67:45865 every 8 connection(s)
I20260808 04:42:42.230099 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 32631
Aug 08 04:42:42 dist-test-slave-t7g5 krb5kdc[30526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164162, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:42:42.241010 32414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:42.227428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:58031 (local address 127.12.148.126:35981)
0808 04:42:42.227586 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:42.227591 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:42.227777 (+ 186us) server_negotiation.cc:407] Connection header received
0808 04:42:42.228911 (+ 1134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:42.228915 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:42.228975 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:42.229071 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:42.230415 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:42.231219 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:42.232979 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:42.233341 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:42.233425 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:42.236590 (+ 3165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:42.236594 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:42.236597 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:42.236629 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:42.238461 (+ 1832us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:42.239138 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:42.239142 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:42.239144 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:42.239242 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:42.239674 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:42.239677 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:42.239679 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:42.239917 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:42.240014 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:42.240688 (+ 674us) server_negotiation.cc:299] Negotiation successful
0808 04:42:42.240825 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 04:42:42.242740 387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:42.226153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:35981 (local address 127.12.148.67:58031)
0808 04:42:42.227628 (+ 1475us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:42.227673 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:42.228634 (+ 961us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:42.229282 (+ 648us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:42.229292 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:42.229574 (+ 282us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:42:42.230248 (+ 674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:42.230269 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:42.231397 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:42.231401 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:42.232834 (+ 1433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:42.232847 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:42.233644 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:42.233673 (+ 29us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:42.233891 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:42.234528 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:42:42.234549 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:42:42.236382 (+ 1833us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:42:42.238595 (+ 2213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:42.238601 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:42.238619 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:42.239021 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:42.239342 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:42.239345 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:42.239347 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:42.239568 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:42.240027 (+ 459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:42:42.240034 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:42:42.240376 (+ 342us) client_negotiation.cc:769] Sending connection context
0808 04:42:42.240619 (+ 243us) client_negotiation.cc:240] Negotiation successful
0808 04:42:42.240983 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1239,"thread_start_us":164,"threads_started":1}
I20260808 04:42:42.244724 385 heartbeater.cc:347] Connected to a master server at 127.12.148.126:35981
I20260808 04:42:42.244997 385 heartbeater.cc:464] Registering TS with master...
I20260808 04:42:42.245633 385 heartbeater.cc:511] Master 127.12.148.126:35981 requested a full tablet report, sending...
W20260808 04:42:42.247484 385 heartbeater.cc:644] Failed to heartbeat to 127.12.148.126:35981 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 04:42:42.247623 385 heartbeater.cc:464] Registering TS with master...
I20260808 04:42:42.247812 385 heartbeater.cc:511] Master 127.12.148.126:35981 requested a full tablet report, sending...
I20260808 04:42:42.248705 385 heartbeater.cc:464] Registering TS with master...
I20260808 04:42:42.248929 385 heartbeater.cc:511] Master 127.12.148.126:35981 requested a full tablet report, sending...
W20260808 04:42:42.249814 385 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 04:42:42.255226 389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:42.231154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42368 (local address 127.12.148.126:35981)
0808 04:42:42.231766 (+ 612us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:42.231769 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:42.231779 (+ 10us) server_negotiation.cc:407] Connection header received
0808 04:42:42.231806 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:42.231808 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:42.231842 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:42.231918 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:42.232622 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:42.233310 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:42.241742 (+ 8432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:42.242239 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:42.242363 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:42.251161 (+ 8798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:42.251165 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:42.251168 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:42.251197 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:42.253127 (+ 1930us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:42.253719 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:42.253723 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:42.253725 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:42.253862 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:42.254218 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:42.254221 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:42.254223 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:42.254468 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:42.254720 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:42.254933 (+ 213us) server_negotiation.cc:299] Negotiation successful
0808 04:42:42.255053 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":552,"thread_start_us":69,"threads_started":1}
Aug 08 04:42:42 dist-test-slave-t7g5 krb5kdc[30526](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786164162, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:42:42.755692 32409 heartbeater.cc:464] Registering TS with master...
I20260808 04:42:42.756043 32409 heartbeater.cc:511] Master 127.12.148.126:35981 requested a full tablet report, sending...
I20260808 04:42:42.757227 32101 ts_manager.cc:194] Registered new tserver with Master: 44f30722209c42fab03aae8b41020bef (127.12.148.65:35519)
I20260808 04:42:42.758575 32101 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.65@KRBTEST.COM'} at 127.12.148.65:48957
I20260808 04:42:42.972404 32626 heartbeater.cc:464] Registering TS with master...
I20260808 04:42:42.972703 32626 heartbeater.cc:511] Master 127.12.148.126:35981 requested a full tablet report, sending...
I20260808 04:42:42.973515 32101 ts_manager.cc:194] Registered new tserver with Master: 304966c9500b4d99a9dfe0a41303e36f (127.12.148.66:41147)
I20260808 04:42:42.974339 32101 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.66@KRBTEST.COM'} at 127.12.148.66:59737
Aug 08 04:42:43 dist-test-slave-t7g5 krb5kdc[30526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164162, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for HTTP/127.12.148.84@KRBTEST.COM
I20260808 04:42:43.250072 385 heartbeater.cc:464] Registering TS with master...
I20260808 04:42:43.250427 385 heartbeater.cc:511] Master 127.12.148.126:35981 requested a full tablet report, sending...
I20260808 04:42:43.251312 32101 ts_manager.cc:194] Registered new tserver with Master: 7d3d6b72e5764fa29f5860d5aea90bdb (127.12.148.67:45865)
I20260808 04:42:43.252082 32101 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.67@KRBTEST.COM'} at 127.12.148.67:58031
I20260808 04:42:43.252230 12881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 04:42:43.269191 420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:43.255029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42374 (local address 127.12.148.126:35981)
0808 04:42:43.256012 (+ 983us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:43.256016 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:43.256029 (+ 13us) server_negotiation.cc:407] Connection header received
0808 04:42:43.256067 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:43.256070 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:43.256113 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:43.257056 (+ 943us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:43.257156 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:43.258014 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:43.259222 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:43.259585 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:43.260084 (+ 499us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:43.265162 (+ 5078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:43.265166 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:43.265169 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:43.265198 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:43.266933 (+ 1735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:43.267452 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:43.267456 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:43.267458 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:43.267544 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:43.267821 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:43.267824 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:43.267826 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:43.268048 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:43.268801 (+ 753us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:43.268878 (+ 77us) server_negotiation.cc:299] Negotiation successful
0808 04:42:43.269010 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":900,"thread_start_us":106,"threads_started":1}
I20260808 04:42:43.273729 32101 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42374:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:42:43.278679 32101 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:42:43.311059 430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:43.301114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:41147 (local address 127.0.0.1:33716)
0808 04:42:43.303257 (+ 2143us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:43.303269 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:43.303356 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:43.304206 (+ 850us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:43.304212 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:43.304238 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:42:43.304374 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:43.304381 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:43.306871 (+ 2490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:43.306874 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:43.308434 (+ 1560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:43.308445 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:43.310505 (+ 2060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:43.310509 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:43.310611 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:43.310656 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 04:42:43.310761 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 04:42:43.310901 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2083,"thread_start_us":82,"threads_started":1}
I20260808 04:42:43.311328 429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:43.297979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49256 (local address 127.12.148.67:45865)
0808 04:42:43.298276 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:43.298282 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:43.306550 (+ 8268us) server_negotiation.cc:407] Connection header received
0808 04:42:43.306641 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:43.306647 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:43.306878 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:43.307033 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:42:43.307417 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:43.308543 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:43.309812 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:43.310576 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:43.310648 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:43.310779 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:43.311089 (+ 310us) server_negotiation.cc:299] Negotiation successful
0808 04:42:43.311203 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":87,"threads_started":1}
I20260808 04:42:43.311811 434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:43.300261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:35519 (local address 127.0.0.1:44420)
0808 04:42:43.302641 (+ 2380us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:43.302701 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:43.302846 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:43.307328 (+ 4482us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:43.307331 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:43.307352 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:42:43.307530 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:43.307538 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:43.308959 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:43.308962 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:43.310121 (+ 1159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:43.310133 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:43.311378 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:43.311382 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:43.311491 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:43.311522 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 04:42:43.311598 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 04:42:43.311667 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2266,"thread_start_us":108,"threads_started":1}
I20260808 04:42:43.311934 436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:43.301305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33716 (local address 127.12.148.66:41147)
0808 04:42:43.302681 (+ 1376us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:43.302687 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:43.303453 (+ 766us) server_negotiation.cc:407] Connection header received
0808 04:42:43.303545 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:43.303551 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:43.303799 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:43.303983 (+ 184us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:42:43.304518 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:43.306747 (+ 2229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:43.308575 (+ 1828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:43.310184 (+ 1609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:43.310284 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:43.310438 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:43.311693 (+ 1255us) server_negotiation.cc:299] Negotiation successful
0808 04:42:43.311791 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1277,"thread_start_us":105,"threads_started":1}
I20260808 04:42:43.312407 433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:43.300685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44420 (local address 127.12.148.65:35519)
0808 04:42:43.301062 (+ 377us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:43.301069 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:43.302795 (+ 1726us) server_negotiation.cc:407] Connection header received
0808 04:42:43.306758 (+ 3963us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:43.306765 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:43.306981 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:43.307143 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:42:43.307679 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:43.308822 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:43.310272 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:43.311057 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:43.311159 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:43.311309 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:43.312148 (+ 839us) server_negotiation.cc:299] Negotiation successful
0808 04:42:43.312251 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267,"thread_start_us":62,"threads_started":1}
I20260808 04:42:43.311861 432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:43.298482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.67:45865 (local address 127.0.0.1:49256)
0808 04:42:43.302997 (+ 4515us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:43.303009 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:43.303080 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:43.307176 (+ 4096us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:43.307179 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:43.307197 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:42:43.307278 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:43.307283 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:43.308663 (+ 1380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:43.308666 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:43.309684 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:43.309695 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:43.310863 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:43.310866 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:43.310939 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:43.310960 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 04:42:43.311654 (+ 694us) client_negotiation.cc:240] Negotiation successful
0808 04:42:43.311732 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3032,"mutex_wait_us":1,"thread_start_us":90,"threads_started":1}
I20260808 04:42:43.315258 32297 tablet_service.cc:1467] Processing CreateTablet for tablet bd710b9cc2354d74abcd86cd6f2fa659 (DEFAULT_TABLE table=test-table [id=eb925e43d2594b4487349df11339af12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:42:43.315155 32496 tablet_service.cc:1467] Processing CreateTablet for tablet bd710b9cc2354d74abcd86cd6f2fa659 (DEFAULT_TABLE table=test-table [id=eb925e43d2594b4487349df11339af12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:42:43.315518 32713 tablet_service.cc:1467] Processing CreateTablet for tablet bd710b9cc2354d74abcd86cd6f2fa659 (DEFAULT_TABLE table=test-table [id=eb925e43d2594b4487349df11339af12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:42:43.316340 32297 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd710b9cc2354d74abcd86cd6f2fa659. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:42:43.316340 32496 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd710b9cc2354d74abcd86cd6f2fa659. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:42:43.316505 32713 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd710b9cc2354d74abcd86cd6f2fa659. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:42:43.325688 439 tablet_bootstrap.cc:492] T bd710b9cc2354d74abcd86cd6f2fa659 P 44f30722209c42fab03aae8b41020bef: Bootstrap starting.
I20260808 04:42:43.325857 441 tablet_bootstrap.cc:492] T bd710b9cc2354d74abcd86cd6f2fa659 P 7d3d6b72e5764fa29f5860d5aea90bdb: Bootstrap starting.
I20260808 04:42:43.326117 438 tablet_bootstrap.cc:492] T bd710b9cc2354d74abcd86cd6f2fa659 P 304966c9500b4d99a9dfe0a41303e36f: Bootstrap starting.
I20260808 04:42:43.328147 441 tablet_bootstrap.cc:654] T bd710b9cc2354d74abcd86cd6f2fa659 P 7d3d6b72e5764fa29f5860d5aea90bdb: Neither blocks nor log segments found. Creating new log.
I20260808 04:42:43.328147 439 tablet_bootstrap.cc:654] T bd710b9cc2354d74abcd86cd6f2fa659 P 44f30722209c42fab03aae8b41020bef: Neither blocks nor log segments found. Creating new log.
I20260808 04:42:43.329109 438 tablet_bootstrap.cc:654] T bd710b9cc2354d74abcd86cd6f2fa659 P 304966c9500b4d99a9dfe0a41303e36f: Neither blocks nor log segments found. Creating new log.
I20260808 04:42:43.329111 439 log.cc:824] T bd710b9cc2354d74abcd86cd6f2fa659 P 44f30722209c42fab03aae8b41020bef: Log is configured to *not* fsync() on all Append() calls
I20260808 04:42:43.329975 438 log.cc:824] T bd710b9cc2354d74abcd86cd6f2fa659 P 304966c9500b4d99a9dfe0a41303e36f: Log is configured to *not* fsync() on all Append() calls
I20260808 04:42:43.332017 439 tablet_bootstrap.cc:492] T bd710b9cc2354d74abcd86cd6f2fa659 P 44f30722209c42fab03aae8b41020bef: No bootstrap required, opened a new log
I20260808 04:42:43.332202 439 ts_tablet_manager.cc:1397] T bd710b9cc2354d74abcd86cd6f2fa659 P 44f30722209c42fab03aae8b41020bef: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260808 04:42:43.332624 441 log.cc:824] T bd710b9cc2354d74abcd86cd6f2fa659 P 7d3d6b72e5764fa29f5860d5aea90bdb: Log is configured to *not* fsync() on all Append() calls
I20260808 04:42:43.334997 438 tablet_bootstrap.cc:492] T bd710b9cc2354d74abcd86cd6f2fa659 P 304966c9500b4d99a9dfe0a41303e36f: No bootstrap required, opened a new log
I20260808 04:42:43.335175 438 ts_tablet_manager.cc:1397] T bd710b9cc2354d74abcd86cd6f2fa659 P 304966c9500b4d99a9dfe0a41303e36f: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20260808 04:42:43.336158 439 raft_consensus.cc:348] T bd710b9cc2354d74abcd86cd6f2fa659 P 44f30722209c42fab03aae8b41020bef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3d6b72e5764fa29f5860d5aea90bdb" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 45865 } } peers { permanent_uuid: "44f30722209c42fab03aae8b41020bef" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 35519 } } peers { permanent_uuid: "304966c9500b4d99a9dfe0a41303e36f" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41147 } }
I20260808 04:42:43.336439 439 raft_consensus.cc:374] T bd710b9cc2354d74abcd86cd6f2fa659 P 44f30722209c42fab03aae8b41020bef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:42:43.336508 439 raft_consensus.cc:729] T bd710b9cc2354d74abcd86cd6f2fa659 P 44f30722209c42fab03aae8b41020bef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44f30722209c42fab03aae8b41020bef, State: Initialized, Role: FOLLOWER
I20260808 04:42:43.337342 439 consensus_queue.cc:260] T bd710b9cc2354d74abcd86cd6f2fa659 P 44f30722209c42fab03aae8b41020bef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3d6b72e5764fa29f5860d5aea90bdb" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 45865 } } peers { permanent_uuid: "44f30722209c42fab03aae8b41020bef" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 35519 } } peers { permanent_uuid: "304966c9500b4d99a9dfe0a41303e36f" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41147 } }
I20260808 04:42:43.338588 439 ts_tablet_manager.cc:1428] T bd710b9cc2354d74abcd86cd6f2fa659 P 44f30722209c42fab03aae8b41020bef: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260808 04:42:43.339020 32409 heartbeater.cc:503] Master 127.12.148.126:35981 was elected leader, sending a full tablet report...
I20260808 04:42:43.338982 438 raft_consensus.cc:348] T bd710b9cc2354d74abcd86cd6f2fa659 P 304966c9500b4d99a9dfe0a41303e36f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3d6b72e5764fa29f5860d5aea90bdb" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 45865 } } peers { permanent_uuid: "44f30722209c42fab03aae8b41020bef" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 35519 } } peers { permanent_uuid: "304966c9500b4d99a9dfe0a41303e36f" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41147 } }
I20260808 04:42:43.339226 438 raft_consensus.cc:374] T bd710b9cc2354d74abcd86cd6f2fa659 P 304966c9500b4d99a9dfe0a41303e36f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:42:43.339274 438 raft_consensus.cc:729] T bd710b9cc2354d74abcd86cd6f2fa659 P 304966c9500b4d99a9dfe0a41303e36f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 304966c9500b4d99a9dfe0a41303e36f, State: Initialized, Role: FOLLOWER
I20260808 04:42:43.339694 438 consensus_queue.cc:260] T bd710b9cc2354d74abcd86cd6f2fa659 P 304966c9500b4d99a9dfe0a41303e36f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3d6b72e5764fa29f5860d5aea90bdb" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 45865 } } peers { permanent_uuid: "44f30722209c42fab03aae8b41020bef" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 35519 } } peers { permanent_uuid: "304966c9500b4d99a9dfe0a41303e36f" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41147 } }
I20260808 04:42:43.340647 438 ts_tablet_manager.cc:1428] T bd710b9cc2354d74abcd86cd6f2fa659 P 304966c9500b4d99a9dfe0a41303e36f: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260808 04:42:43.340972 32626 heartbeater.cc:503] Master 127.12.148.126:35981 was elected leader, sending a full tablet report...
I20260808 04:42:43.346880 441 tablet_bootstrap.cc:492] T bd710b9cc2354d74abcd86cd6f2fa659 P 7d3d6b72e5764fa29f5860d5aea90bdb: No bootstrap required, opened a new log
I20260808 04:42:43.347167 441 ts_tablet_manager.cc:1397] T bd710b9cc2354d74abcd86cd6f2fa659 P 7d3d6b72e5764fa29f5860d5aea90bdb: Time spent bootstrapping tablet: real 0.021s user 0.005s sys 0.000s
I20260808 04:42:43.351373 441 raft_consensus.cc:348] T bd710b9cc2354d74abcd86cd6f2fa659 P 7d3d6b72e5764fa29f5860d5aea90bdb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3d6b72e5764fa29f5860d5aea90bdb" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 45865 } } peers { permanent_uuid: "44f30722209c42fab03aae8b41020bef" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 35519 } } peers { permanent_uuid: "304966c9500b4d99a9dfe0a41303e36f" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41147 } }
I20260808 04:42:43.351790 441 raft_consensus.cc:374] T bd710b9cc2354d74abcd86cd6f2fa659 P 7d3d6b72e5764fa29f5860d5aea90bdb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:42:43.351903 441 raft_consensus.cc:729] T bd710b9cc2354d74abcd86cd6f2fa659 P 7d3d6b72e5764fa29f5860d5aea90bdb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d3d6b72e5764fa29f5860d5aea90bdb, State: Initialized, Role: FOLLOWER
I20260808 04:42:43.352479 441 consensus_queue.cc:260] T bd710b9cc2354d74abcd86cd6f2fa659 P 7d3d6b72e5764fa29f5860d5aea90bdb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3d6b72e5764fa29f5860d5aea90bdb" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 45865 } } peers { permanent_uuid: "44f30722209c42fab03aae8b41020bef" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 35519 } } peers { permanent_uuid: "304966c9500b4d99a9dfe0a41303e36f" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41147 } }
I20260808 04:42:43.353720 441 ts_tablet_manager.cc:1428] T bd710b9cc2354d74abcd86cd6f2fa659 P 7d3d6b72e5764fa29f5860d5aea90bdb: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 04:42:43.354130 385 heartbeater.cc:503] Master 127.12.148.126:35981 was elected leader, sending a full tablet report...
Aug 08 04:42:43 dist-test-slave-t7g5 krb5kdc[30526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164162, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for HTTP/127.12.148.84@KRBTEST.COM
W20260808 04:42:43.451552 32628 tablet.cc:2369] T bd710b9cc2354d74abcd86cd6f2fa659 P 304966c9500b4d99a9dfe0a41303e36f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 04:42:43.468923 32410 tablet.cc:2369] T bd710b9cc2354d74abcd86cd6f2fa659 P 44f30722209c42fab03aae8b41020bef: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 04:42:43.477522 386 tablet.cc:2369] T bd710b9cc2354d74abcd86cd6f2fa659 P 7d3d6b72e5764fa29f5860d5aea90bdb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:42:43.512542 450 raft_consensus.cc:482] T bd710b9cc2354d74abcd86cd6f2fa659 P 7d3d6b72e5764fa29f5860d5aea90bdb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:42:43.512814 450 raft_consensus.cc:504] T bd710b9cc2354d74abcd86cd6f2fa659 P 7d3d6b72e5764fa29f5860d5aea90bdb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3d6b72e5764fa29f5860d5aea90bdb" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 45865 } } peers { permanent_uuid: "44f30722209c42fab03aae8b41020bef" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 35519 } } peers { permanent_uuid: "304966c9500b4d99a9dfe0a41303e36f" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41147 } }
I20260808 04:42:43.514086 450 leader_election.cc:288] T bd710b9cc2354d74abcd86cd6f2fa659 P 7d3d6b72e5764fa29f5860d5aea90bdb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44f30722209c42fab03aae8b41020bef (127.12.148.65:35519), 304966c9500b4d99a9dfe0a41303e36f (127.12.148.66:41147)
I20260808 04:42:43.516799 449 raft_consensus.cc:482] T bd710b9cc2354d74abcd86cd6f2fa659 P 304966c9500b4d99a9dfe0a41303e36f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:42:43.516974 449 raft_consensus.cc:504] T bd710b9cc2354d74abcd86cd6f2fa659 P 304966c9500b4d99a9dfe0a41303e36f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3d6b72e5764fa29f5860d5aea90bdb" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 45865 } } peers { permanent_uuid: "44f30722209c42fab03aae8b41020bef" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 35519 } } peers { permanent_uuid: "304966c9500b4d99a9dfe0a41303e36f" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41147 } }
I20260808 04:42:43.518272 449 leader_election.cc:288] T bd710b9cc2354d74abcd86cd6f2fa659 P 304966c9500b4d99a9dfe0a41303e36f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d3d6b72e5764fa29f5860d5aea90bdb (127.12.148.67:45865), 44f30722209c42fab03aae8b41020bef (127.12.148.65:35519)
I20260808 04:42:43.519955 433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:43.514723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:53521 (local address 127.12.148.65:35519)
0808 04:42:43.514854 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:43.514859 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:43.515111 (+ 252us) server_negotiation.cc:407] Connection header received
0808 04:42:43.515658 (+ 547us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:43.515661 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:43.515710 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:43.515756 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:42:43.516201 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:43.516917 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:43.518526 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:43.519060 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:43.519146 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:43.519198 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:43.519737 (+ 539us) server_negotiation.cc:299] Negotiation successful
0808 04:42:43.519824 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 04:42:43.520586 452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:43.514346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:35519 (local address 127.12.148.67:53521)
0808 04:42:43.515018 (+ 672us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:43.515033 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:43.515516 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:43.515892 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:43.515895 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:43.515914 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:42:43.516062 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:43.516070 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:43.517092 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:43.517095 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:43.518389 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:43.518400 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:43.519312 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:43.519316 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:43.519585 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:43.519614 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 04:42:43.520348 (+ 734us) client_negotiation.cc:240] Negotiation successful
0808 04:42:43.520430 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":603,"thread_start_us":130,"threads_started":1}
I20260808 04:42:43.521368 32335 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd710b9cc2354d74abcd86cd6f2fa659" candidate_uuid: "7d3d6b72e5764fa29f5860d5aea90bdb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44f30722209c42fab03aae8b41020bef" is_pre_election: true
I20260808 04:42:43.521711 32335 raft_consensus.cc:2454] T bd710b9cc2354d74abcd86cd6f2fa659 P 44f30722209c42fab03aae8b41020bef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3d6b72e5764fa29f5860d5aea90bdb in term 0.
I20260808 04:42:43.522323 32670 leader_election.cc:302] T bd710b9cc2354d74abcd86cd6f2fa659 P 7d3d6b72e5764fa29f5860d5aea90bdb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44f30722209c42fab03aae8b41020bef, 7d3d6b72e5764fa29f5860d5aea90bdb; no voters:
I20260808 04:42:43.522641 450 raft_consensus.cc:2781] T bd710b9cc2354d74abcd86cd6f2fa659 P 7d3d6b72e5764fa29f5860d5aea90bdb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:42:43.522725 450 raft_consensus.cc:482] T bd710b9cc2354d74abcd86cd6f2fa659 P 7d3d6b72e5764fa29f5860d5aea90bdb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:42:43.522771 450 raft_consensus.cc:3037] T bd710b9cc2354d74abcd86cd6f2fa659 P 7d3d6b72e5764fa29f5860d5aea90bdb [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:42:43.523155 436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:43.514926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:59373 (local address 127.12.148.66:41147)
0808 04:42:43.515082 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:43.515087 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:43.515331 (+ 244us) server_negotiation.cc:407] Connection header received
0808 04:42:43.515503 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:43.515506 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:43.515563 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:43.515655 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:42:43.519788 (+ 4133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:43.520462 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:43.521945 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:43.522470 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:43.522559 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:43.522604 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:43.522952 (+ 348us) server_negotiation.cc:299] Negotiation successful
0808 04:42:43.523047 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 04:42:43.523506 453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:43.514559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:41147 (local address 127.12.148.67:59373)
0808 04:42:43.515256 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:43.515268 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:43.515384 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:43.516276 (+ 892us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:43.516279 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:43.516299 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:42:43.516468 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:43.516477 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:43.520596 (+ 4119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:43.520599 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:43.521808 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:43.521819 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:43.522696 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:43.522699 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:43.522810 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:43.522834 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 04:42:43.523307 (+ 473us) client_negotiation.cc:240] Negotiation successful
0808 04:42:43.523378 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":622,"thread_start_us":92,"threads_started":1}
I20260808 04:42:43.524063 32555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd710b9cc2354d74abcd86cd6f2fa659" candidate_uuid: "7d3d6b72e5764fa29f5860d5aea90bdb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "304966c9500b4d99a9dfe0a41303e36f" is_pre_election: true
I20260808 04:42:43.524267 32555 raft_consensus.cc:2454] T bd710b9cc2354d74abcd86cd6f2fa659 P 304966c9500b4d99a9dfe0a41303e36f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d3d6b72e5764fa29f5860d5aea90bdb in term 0.
I20260808 04:42:43.524446 450 raft_consensus.cc:504] T bd710b9cc2354d74abcd86cd6f2fa659 P 7d3d6b72e5764fa29f5860d5aea90bdb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3d6b72e5764fa29f5860d5aea90bdb" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 45865 } } peers { permanent_uuid: "44f30722209c42fab03aae8b41020bef" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 35519 } } peers { permanent_uuid: "304966c9500b4d99a9dfe0a41303e36f" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41147 } }
I20260808 04:42:43.524781 450 leader_election.cc:288] T bd710b9cc2354d74abcd86cd6f2fa659 P 7d3d6b72e5764fa29f5860d5aea90bdb [CANDIDATE]: Term 1 election: Requested vote from peers 44f30722209c42fab03aae8b41020bef (127.12.148.65:35519), 304966c9500b4d99a9dfe0a41303e36f (127.12.148.66:41147)
I20260808 04:42:43.525133 32555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd710b9cc2354d74abcd86cd6f2fa659" candidate_uuid: "7d3d6b72e5764fa29f5860d5aea90bdb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "304966c9500b4d99a9dfe0a41303e36f"
I20260808 04:42:43.525245 32555 raft_consensus.cc:3037] T bd710b9cc2354d74abcd86cd6f2fa659 P 304966c9500b4d99a9dfe0a41303e36f [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:42:43.525521 32335 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd710b9cc2354d74abcd86cd6f2fa659" candidate_uuid: "7d3d6b72e5764fa29f5860d5aea90bdb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44f30722209c42fab03aae8b41020bef"
I20260808 04:42:43.525633 32335 raft_consensus.cc:3037] T bd710b9cc2354d74abcd86cd6f2fa659 P 44f30722209c42fab03aae8b41020bef [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:42:43.526504 32555 raft_consensus.cc:2454] T bd710b9cc2354d74abcd86cd6f2fa659 P 304966c9500b4d99a9dfe0a41303e36f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3d6b72e5764fa29f5860d5aea90bdb in term 1.
I20260808 04:42:43.526862 32665 leader_election.cc:302] T bd710b9cc2354d74abcd86cd6f2fa659 P 7d3d6b72e5764fa29f5860d5aea90bdb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 304966c9500b4d99a9dfe0a41303e36f, 7d3d6b72e5764fa29f5860d5aea90bdb; no voters:
I20260808 04:42:43.526892 32335 raft_consensus.cc:2454] T bd710b9cc2354d74abcd86cd6f2fa659 P 44f30722209c42fab03aae8b41020bef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d3d6b72e5764fa29f5860d5aea90bdb in term 1.
I20260808 04:42:43.527302 450 raft_consensus.cc:2781] T bd710b9cc2354d74abcd86cd6f2fa659 P 7d3d6b72e5764fa29f5860d5aea90bdb [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:42:43.527509 450 raft_consensus.cc:686] T bd710b9cc2354d74abcd86cd6f2fa659 P 7d3d6b72e5764fa29f5860d5aea90bdb [term 1 LEADER]: Becoming Leader. State: Replica: 7d3d6b72e5764fa29f5860d5aea90bdb, State: Running, Role: LEADER
I20260808 04:42:43.527861 450 consensus_queue.cc:237] T bd710b9cc2354d74abcd86cd6f2fa659 P 7d3d6b72e5764fa29f5860d5aea90bdb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3d6b72e5764fa29f5860d5aea90bdb" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 45865 } } peers { permanent_uuid: "44f30722209c42fab03aae8b41020bef" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 35519 } } peers { permanent_uuid: "304966c9500b4d99a9dfe0a41303e36f" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41147 } }
I20260808 04:42:43.531533 32100 catalog_manager.cc:5495] T bd710b9cc2354d74abcd86cd6f2fa659 P 7d3d6b72e5764fa29f5860d5aea90bdb reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d3d6b72e5764fa29f5860d5aea90bdb (127.12.148.67). New cstate: current_term: 1 leader_uuid: "7d3d6b72e5764fa29f5860d5aea90bdb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d3d6b72e5764fa29f5860d5aea90bdb" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 45865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44f30722209c42fab03aae8b41020bef" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 35519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "304966c9500b4d99a9dfe0a41303e36f" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41147 } health_report { overall_health: UNKNOWN } } }
I20260808 04:42:43.531924 429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:43.519525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:52251 (local address 127.12.148.67:45865)
0808 04:42:43.519656 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:43.519660 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:43.527912 (+ 8252us) server_negotiation.cc:407] Connection header received
0808 04:42:43.528070 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:43.528073 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:43.528115 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:43.528156 (+ 41us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:42:43.528548 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:43.529218 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:43.530733 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:43.531231 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:43.531316 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:43.531360 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:43.531749 (+ 389us) server_negotiation.cc:299] Negotiation successful
0808 04:42:43.531819 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 04:42:43.532251 458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:43.519480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.67:45865 (local address 127.12.148.66:52251)
0808 04:42:43.527833 (+ 8353us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:43.527845 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:43.527971 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:43.528277 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:43.528280 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:43.528296 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:42:43.528418 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:43.528425 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:43.529354 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:43.529357 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:43.530599 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:43.530609 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:43.531457 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:43.531460 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:43.531593 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:43.531617 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 04:42:43.532031 (+ 414us) client_negotiation.cc:240] Negotiation successful
0808 04:42:43.532104 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8294,"thread_start_us":97,"threads_started":1}
I20260808 04:42:43.533027 313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd710b9cc2354d74abcd86cd6f2fa659" candidate_uuid: "304966c9500b4d99a9dfe0a41303e36f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d3d6b72e5764fa29f5860d5aea90bdb" is_pre_election: true
I20260808 04:42:43.536512 433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:43.519091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:37337 (local address 127.12.148.65:35519)
0808 04:42:43.520109 (+ 1018us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:43.520113 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:43.528466 (+ 8353us) server_negotiation.cc:407] Connection header received
0808 04:42:43.528511 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:43.528514 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:43.528555 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:43.528615 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:42:43.533238 (+ 4623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:43.533894 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:43.535295 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:43.535861 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:43.535959 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:43.536005 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:43.536341 (+ 336us) server_negotiation.cc:299] Negotiation successful
0808 04:42:43.536412 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":964,"thread_start_us":115,"threads_started":1}
I20260808 04:42:43.536864 455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:43.518619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:35519 (local address 127.12.148.66:37337)
0808 04:42:43.527500 (+ 8881us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:43.527515 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:43.527612 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:43.532852 (+ 5240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:43.532856 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:43.532874 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:42:43.533102 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:43.533110 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:43.534031 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:43.534034 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:43.535156 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:43.535167 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:43.536101 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:43.536105 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:43.536204 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:43.536226 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 04:42:43.536687 (+ 461us) client_negotiation.cc:240] Negotiation successful
0808 04:42:43.536764 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8812,"thread_start_us":127,"threads_started":1}
I20260808 04:42:43.537243 32335 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd710b9cc2354d74abcd86cd6f2fa659" candidate_uuid: "304966c9500b4d99a9dfe0a41303e36f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44f30722209c42fab03aae8b41020bef" is_pre_election: true
I20260808 04:42:43.537429 32335 raft_consensus.cc:2379] T bd710b9cc2354d74abcd86cd6f2fa659 P 44f30722209c42fab03aae8b41020bef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 304966c9500b4d99a9dfe0a41303e36f in current term 1: Already voted for candidate 7d3d6b72e5764fa29f5860d5aea90bdb in this term.
I20260808 04:42:43.537904 32444 leader_election.cc:302] T bd710b9cc2354d74abcd86cd6f2fa659 P 304966c9500b4d99a9dfe0a41303e36f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 304966c9500b4d99a9dfe0a41303e36f; no voters: 44f30722209c42fab03aae8b41020bef, 7d3d6b72e5764fa29f5860d5aea90bdb
I20260808 04:42:43.538133 449 raft_consensus.cc:2726] T bd710b9cc2354d74abcd86cd6f2fa659 P 304966c9500b4d99a9dfe0a41303e36f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260808 04:42:43.558355 429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:43.553712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49262 (local address 127.12.148.67:45865)
0808 04:42:43.553830 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:43.553835 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:43.553848 (+ 13us) server_negotiation.cc:407] Connection header received
0808 04:42:43.553947 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:43.553950 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:43.554017 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:43.554132 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:42:43.554381 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:43.555145 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:43.556383 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:43.556593 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:43.556690 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:43.557016 (+ 326us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:42:43.557569 (+ 553us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:42:43.557709 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:43.558127 (+ 418us) server_negotiation.cc:299] Negotiation successful
0808 04:42:43.558182 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 04:42:43.565462 32335 raft_consensus.cc:1261] T bd710b9cc2354d74abcd86cd6f2fa659 P 44f30722209c42fab03aae8b41020bef [term 1 FOLLOWER]: Refusing update from remote peer 7d3d6b72e5764fa29f5860d5aea90bdb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:42:43.565501 32555 raft_consensus.cc:1261] T bd710b9cc2354d74abcd86cd6f2fa659 P 304966c9500b4d99a9dfe0a41303e36f [term 1 FOLLOWER]: Refusing update from remote peer 7d3d6b72e5764fa29f5860d5aea90bdb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:42:43.566218 450 consensus_queue.cc:1035] T bd710b9cc2354d74abcd86cd6f2fa659 P 7d3d6b72e5764fa29f5860d5aea90bdb [LEADER]: Connected to new peer: Peer: permanent_uuid: "304966c9500b4d99a9dfe0a41303e36f" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:42:43.566684 450 consensus_queue.cc:1035] T bd710b9cc2354d74abcd86cd6f2fa659 P 7d3d6b72e5764fa29f5860d5aea90bdb [LEADER]: Connected to new peer: Peer: permanent_uuid: "44f30722209c42fab03aae8b41020bef" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 35519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:42:43.579376 466 mvcc.cc:205] Tried to move back new op lower bound from 7316128413954539520 to 7316128413814415360. Current Snapshot: MvccSnapshot[applied={T|T < 7316128413954539520}]
I20260808 04:42:43.583770 470 mvcc.cc:205] Tried to move back new op lower bound from 7316128413954539520 to 7316128413814415360. Current Snapshot: MvccSnapshot[applied={T|T < 7316128413954539520}]
I20260808 04:42:43.585143 468 mvcc.cc:205] Tried to move back new op lower bound from 7316128413954539520 to 7316128413814415360. Current Snapshot: MvccSnapshot[applied={T|T < 7316128413954539520}]
I20260808 04:42:43.595965 32101 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42374:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:42:43.596153 32101 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42374:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:42:43.599126 32101 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b766f889cc4f410a98b6882933cb4e6e: Sending DeleteTablet for 3 replicas of tablet bd710b9cc2354d74abcd86cd6f2fa659
I20260808 04:42:43.600461 32297 tablet_service.cc:1514] Processing DeleteTablet for tablet bd710b9cc2354d74abcd86cd6f2fa659 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:42:43 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:44420
I20260808 04:42:43.601265 32496 tablet_service.cc:1514] Processing DeleteTablet for tablet bd710b9cc2354d74abcd86cd6f2fa659 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:42:43 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:33716
I20260808 04:42:43.602339 32713 tablet_service.cc:1514] Processing DeleteTablet for tablet bd710b9cc2354d74abcd86cd6f2fa659 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:42:43 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:49256
I20260808 04:42:43.603636 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 32159
I20260808 04:42:43.608302 479 tablet_replica.cc:330] T bd710b9cc2354d74abcd86cd6f2fa659 P 304966c9500b4d99a9dfe0a41303e36f: stopping tablet replica
I20260808 04:42:43.608657 479 raft_consensus.cc:2229] T bd710b9cc2354d74abcd86cd6f2fa659 P 304966c9500b4d99a9dfe0a41303e36f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:42:43.608964 479 raft_consensus.cc:2258] T bd710b9cc2354d74abcd86cd6f2fa659 P 304966c9500b4d99a9dfe0a41303e36f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:42:43.609548 480 tablet_replica.cc:330] T bd710b9cc2354d74abcd86cd6f2fa659 P 7d3d6b72e5764fa29f5860d5aea90bdb: stopping tablet replica
I20260808 04:42:43.609827 480 raft_consensus.cc:2229] T bd710b9cc2354d74abcd86cd6f2fa659 P 7d3d6b72e5764fa29f5860d5aea90bdb [term 1 LEADER]: Raft consensus shutting down.
I20260808 04:42:43.610175 480 raft_consensus.cc:2258] T bd710b9cc2354d74abcd86cd6f2fa659 P 7d3d6b72e5764fa29f5860d5aea90bdb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:42:43.618348 479 ts_tablet_manager.cc:1905] T bd710b9cc2354d74abcd86cd6f2fa659 P 304966c9500b4d99a9dfe0a41303e36f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:42:43.621644 479 ts_tablet_manager.cc:1918] T bd710b9cc2354d74abcd86cd6f2fa659 P 304966c9500b4d99a9dfe0a41303e36f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:42:43.621788 479 log.cc:1196] T bd710b9cc2354d74abcd86cd6f2fa659 P 304966c9500b4d99a9dfe0a41303e36f: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-1/wal/wals/bd710b9cc2354d74abcd86cd6f2fa659
I20260808 04:42:43.622156 479 ts_tablet_manager.cc:1939] T bd710b9cc2354d74abcd86cd6f2fa659 P 304966c9500b4d99a9dfe0a41303e36f: Deleting consensus metadata
I20260808 04:42:43.624426 480 ts_tablet_manager.cc:1905] T bd710b9cc2354d74abcd86cd6f2fa659 P 7d3d6b72e5764fa29f5860d5aea90bdb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:42:43.627365 480 ts_tablet_manager.cc:1918] T bd710b9cc2354d74abcd86cd6f2fa659 P 7d3d6b72e5764fa29f5860d5aea90bdb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:42:43.627570 480 log.cc:1196] T bd710b9cc2354d74abcd86cd6f2fa659 P 7d3d6b72e5764fa29f5860d5aea90bdb: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786164004017495-12881-0/minicluster-data/ts-2/wal/wals/bd710b9cc2354d74abcd86cd6f2fa659
I20260808 04:42:43.627970 480 ts_tablet_manager.cc:1939] T bd710b9cc2354d74abcd86cd6f2fa659 P 7d3d6b72e5764fa29f5860d5aea90bdb: Deleting consensus metadata
I20260808 04:42:43.629570 32072 catalog_manager.cc:4841] TS 304966c9500b4d99a9dfe0a41303e36f (127.12.148.66:41147): tablet bd710b9cc2354d74abcd86cd6f2fa659 (table test-table [id=eb925e43d2594b4487349df11339af12]) successfully deleted
W20260808 04:42:43.630653 32075 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.148.65:35519 (error 108)
I20260808 04:42:43.631206 32074 catalog_manager.cc:4841] TS 7d3d6b72e5764fa29f5860d5aea90bdb (127.12.148.67:45865): tablet bd710b9cc2354d74abcd86cd6f2fa659 (table test-table [id=eb925e43d2594b4487349df11339af12]) successfully deleted
I20260808 04:42:43.631857 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 32415
I20260808 04:42:43.647425 434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:43.647026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:35519 (local address 127.0.0.1:44424)
0808 04:42:43.647230 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:43.647311 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.65:35519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125}
W20260808 04:42:43.647766 32075 catalog_manager.cc:4584] TS 44f30722209c42fab03aae8b41020bef (127.12.148.65:35519): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet bd710b9cc2354d74abcd86cd6f2fa659: Network error: Client connection negotiation failed: client connection to 127.12.148.65:35519: connect: Connection refused (error 111)
I20260808 04:42:43.655714 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 32631
I20260808 04:42:43.671195 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 32044
I20260808 04:42:43.686519 12881 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 04:42:44.030766 12881 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 04:42:44.030885 12881 mini_ranger.cc:66] Stopping Ranger...
I20260808 04:42:44.375425 12881 mini_ranger.cc:68] Stopped Ranger
2026-08-08 04:42:44.375 UTC [30573] LOG: received smart shutdown request
2026-08-08 04:42:44.379 UTC [30573] LOG: background worker "logical replication launcher" (PID 30586) exited with exit code 1
2026-08-08 04:42:44.380 UTC [30579] LOG: shutting down
2026-08-08 04:42:44.519 UTC [30573] LOG: database system is shut down
2026-08-08T04:42:44Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (48575 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:42:44 dist-test-slave-t7g5 krb5kdc[506](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:42:44 dist-test-slave-t7g5 krb5kdc[506](info): set up 2 sockets
Aug 08 04:42:44 dist-test-slave-t7g5 krb5kdc[506](info): commencing operation
krb5kdc: starting...
W20260808 04:42:45.778735 12881 mini_kdc.cc:121] Time spent starting KDC: real 1.137s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Aug 08 04:42:45 dist-test-slave-t7g5 krb5kdc[506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164165, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:42:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:42:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.148.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
I20260808 04:42:45.902760 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:45223
--webserver_interface=127.12.148.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:41451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:45223,127.12.148.125:33579,127.12.148.124:45039
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:42:46.015833 524 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:42:46.016137 524 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:42:46.016198 524 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:42:46.020268 524 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:42:46.020345 524 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:42:46.020373 524 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:42:46.020395 524 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:42:46.020416 524 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:42:46.025830 524 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:41451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:45223,127.12.148.125:33579,127.12.148.124:45039
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:45223
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.524
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:42:46.026934 524 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:42:46.027992 524 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:42:46.036206 529 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:46.036196 530 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:46.036194 533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:46.036569 524 server_base.cc:1034] running on GCE node
I20260808 04:42:46.037135 524 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:42:46.038317 524 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:42:46.039502 524 hybrid_clock.cc:648] HybridClock initialized: now 1786164166039480 us; error 36 us; skew 500 ppm
Aug 08 04:42:46 dist-test-slave-t7g5 krb5kdc[506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164166, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:42:46.042308 524 init.cc:377] Logged in from keytab as kudu/127.12.148.126@KRBTEST.COM (short username kudu)
I20260808 04:42:46.043210 524 webserver.cc:460] Webserver started at http://127.12.148.126:44199/ using document root <none> and password file <none>
I20260808 04:42:46.043733 524 fs_manager.cc:359] Metadata directory not provided
I20260808 04:42:46.043802 524 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:42:46.043984 524 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:42:46.046029 524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "347c2fa876f9410495b55cdd6d89772b"
format_stamp: "Formatted at 2026-08-08 04:42:46 on dist-test-slave-t7g5"
server_key: "6e4c06eb8db3ca06edd14de1c3b88f68"
server_key_iv: "e33f47c3dce5ee55035805b3bf44dc7e"
server_key_version: "encryptionkey@0"
I20260808 04:42:46.046550 524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "347c2fa876f9410495b55cdd6d89772b"
format_stamp: "Formatted at 2026-08-08 04:42:46 on dist-test-slave-t7g5"
server_key: "6e4c06eb8db3ca06edd14de1c3b88f68"
server_key_iv: "e33f47c3dce5ee55035805b3bf44dc7e"
server_key_version: "encryptionkey@0"
I20260808 04:42:46.050403 524 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 04:42:46.052881 542 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:46.054225 524 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:42:46.054332 524 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "347c2fa876f9410495b55cdd6d89772b"
format_stamp: "Formatted at 2026-08-08 04:42:46 on dist-test-slave-t7g5"
server_key: "6e4c06eb8db3ca06edd14de1c3b88f68"
server_key_iv: "e33f47c3dce5ee55035805b3bf44dc7e"
server_key_version: "encryptionkey@0"
I20260808 04:42:46.054423 524 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:42:46.065223 524 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:42:46.068135 524 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:42:46.068295 524 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:42:46.075167 524 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:45223
I20260808 04:42:46.075495 620 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:45223 every 8 connection(s)
I20260808 04:42:46.076126 524 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:42:46.078910 621 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:42:46.079424 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 524
I20260808 04:42:46.079531 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:42:46.079843 12881 external_mini_cluster.cc:1428] Setting key 44662cc1a799e02cc7fb67cbe992a542
I20260808 04:42:46.082762 621 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45223 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.12.148.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.125@KRBTEST.COM" created.
Aug 08 04:42:46 dist-test-slave-t7g5 krb5kdc[506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164166, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:42:46.097426 627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:46.084916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45970 (local address 127.12.148.126:45223)
0808 04:42:46.085444 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:46.085455 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:46.085557 (+ 102us) server_negotiation.cc:407] Connection header received
0808 04:42:46.086596 (+ 1039us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:46.086602 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:46.086839 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:46.087035 (+ 196us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:46.087780 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.089044 (+ 1264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.090090 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.090454 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.090596 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:46.092967 (+ 2371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:46.092972 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:46.092981 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:46.093001 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:46.094436 (+ 1435us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:46.094891 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:46.094896 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:46.094898 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:46.095000 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:46.095279 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:46.095282 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:46.095284 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:46.095648 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:46.095766 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:46.096174 (+ 408us) server_negotiation.cc:299] Negotiation successful
0808 04:42:46.096488 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":68,"server-negotiator.queue_time_us":405,"thread_start_us":123,"threads_started":1}
I20260808 04:42:46.097426 626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:46.084915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:45223 (local address 127.0.0.1:45970)
0808 04:42:46.085388 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:46.085439 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:46.086290 (+ 851us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:46.087057 (+ 767us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:46.087061 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:46.087386 (+ 325us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:42:46.087634 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:46.087646 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.089179 (+ 1533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.089182 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:46.089984 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:46.089994 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.090582 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.090586 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:46.090697 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:46.091255 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:42:46.091270 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:42:46.092830 (+ 1560us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:42:46.094546 (+ 1716us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:46.094556 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:46.094566 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:46.094789 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:46.095084 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:46.095087 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:46.095089 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:46.095195 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:46.095758 (+ 563us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:42:46.095763 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:42:46.095891 (+ 128us) client_negotiation.cc:769] Sending connection context
0808 04:42:46.096062 (+ 171us) client_negotiation.cc:240] Negotiation successful
0808 04:42:46.096388 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":109,"threads_started":1}
I20260808 04:42:46.100765 621 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.148.125" port: 33579 } has no permanent_uuid. Determining permanent_uuid...
I20260808 04:42:46.101464 626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:46.101208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.125:33579 (local address 127.0.0.1:33356)
0808 04:42:46.101322 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:46.101390 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.125:33579: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260808 04:42:46.101680 543 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.148.125:33579: connect: Connection refused (error 111)
I20260808 04:42:46.102450 626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:46.102242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.125:33579 (local address 127.0.0.1:33370)
0808 04:42:46.102347 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:46.102388 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.125:33579: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260808 04:42:46.102576 621 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.148.125:33579: Network error: Client connection negotiation failed: client connection to 127.12.148.125:33579: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.125.keytab.
Entry for principal kudu/127.12.148.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.125.keytab.
I20260808 04:42:46.106921 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.125:33579
--webserver_interface=127.12.148.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.125.keytab
--principal=kudu/127.12.148.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:41451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:45223,127.12.148.125:33579,127.12.148.124:45039
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 04:42:46.151803 621 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.148.125" port: 33579 } attempt: 1
I20260808 04:42:46.152637 626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:46.152327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.125:33579 (local address 127.0.0.1:33376)
0808 04:42:46.152490 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:46.152554 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.125:33579: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260808 04:42:46.153402 626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:46.153181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.125:33579 (local address 127.0.0.1:33384)
0808 04:42:46.153267 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:46.153323 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.125:33579: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260808 04:42:46.153539 621 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.148.125:33579: Network error: Client connection negotiation failed: client connection to 127.12.148.125:33579: connect: Connection refused (error 111)
W20260808 04:42:46.220474 633 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:42:46.220734 633 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:42:46.220777 633 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260808 04:42:46.221688 621 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.148.125" port: 33579 } attempt: 2
I20260808 04:42:46.222528 626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:46.222205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.125:33579 (local address 127.0.0.1:33394)
0808 04:42:46.222360 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:46.222437 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.125:33579: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260808 04:42:46.223145 626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:46.222959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.125:33579 (local address 127.0.0.1:33398)
0808 04:42:46.223043 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:46.223087 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.125:33579: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260808 04:42:46.223264 621 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.148.125:33579: Network error: Client connection negotiation failed: client connection to 127.12.148.125:33579: connect: Connection refused (error 111)
W20260808 04:42:46.225056 633 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:42:46.225111 633 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:42:46.225131 633 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:42:46.225160 633 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:42:46.225189 633 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:42:46.230341 633 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:41451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:45223,127.12.148.125:33579,127.12.148.124:45039
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.125.keytab
--principal=kudu/127.12.148.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.125:33579
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.148.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.633
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:42:46.231300 633 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:42:46.232242 633 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:42:46.240319 643 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:46.240334 645 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:46.240319 642 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:46.240621 633 server_base.cc:1034] running on GCE node
I20260808 04:42:46.241194 633 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:42:46.242297 633 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:42:46.243453 633 hybrid_clock.cc:648] HybridClock initialized: now 1786164166243436 us; error 34 us; skew 500 ppm
Aug 08 04:42:46 dist-test-slave-t7g5 krb5kdc[506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164166, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:42:46.246129 633 init.cc:377] Logged in from keytab as kudu/127.12.148.125@KRBTEST.COM (short username kudu)
I20260808 04:42:46.247040 633 webserver.cc:460] Webserver started at http://127.12.148.125:43905/ using document root <none> and password file <none>
I20260808 04:42:46.247567 633 fs_manager.cc:359] Metadata directory not provided
I20260808 04:42:46.247635 633 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:42:46.247874 633 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:42:46.249948 633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-1/data/instance:
uuid: "86990f563f9c4c98b193fa5bf02fca5a"
format_stamp: "Formatted at 2026-08-08 04:42:46 on dist-test-slave-t7g5"
server_key: "5afd767737927c598a03cf433ae115d0"
server_key_iv: "6c8af7e9f5c3fd83eb547050b2fd9304"
server_key_version: "encryptionkey@0"
I20260808 04:42:46.250506 633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-1/wal/instance:
uuid: "86990f563f9c4c98b193fa5bf02fca5a"
format_stamp: "Formatted at 2026-08-08 04:42:46 on dist-test-slave-t7g5"
server_key: "5afd767737927c598a03cf433ae115d0"
server_key_iv: "6c8af7e9f5c3fd83eb547050b2fd9304"
server_key_version: "encryptionkey@0"
I20260808 04:42:46.254204 633 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.002s
I20260808 04:42:46.256618 657 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:46.257905 633 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:42:46.258024 633 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-1/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-1/wal
uuid: "86990f563f9c4c98b193fa5bf02fca5a"
format_stamp: "Formatted at 2026-08-08 04:42:46 on dist-test-slave-t7g5"
server_key: "5afd767737927c598a03cf433ae115d0"
server_key_iv: "6c8af7e9f5c3fd83eb547050b2fd9304"
server_key_version: "encryptionkey@0"
I20260808 04:42:46.258127 633 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:42:46.270294 633 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:42:46.273017 633 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:42:46.273198 633 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:42:46.280002 633 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.125:33579
I20260808 04:42:46.280268 734 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.125:33579 every 8 connection(s)
I20260808 04:42:46.280951 633 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-1/data/info.pb
I20260808 04:42:46.283468 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 633
I20260808 04:42:46.283607 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-1/wal/instance
I20260808 04:42:46.283834 736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:42:46.283948 12881 external_mini_cluster.cc:1428] Setting key 70d75c5d1db85673a029e56910cb3ffa
I20260808 04:42:46.288033 736 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45223 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.12.148.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.124@KRBTEST.COM" created.
Aug 08 04:42:46 dist-test-slave-t7g5 krb5kdc[506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164166, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.125@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:42:46.301631 627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:46.289968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45980 (local address 127.12.148.126:45223)
0808 04:42:46.290124 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:46.290129 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:46.291049 (+ 920us) server_negotiation.cc:407] Connection header received
0808 04:42:46.291972 (+ 923us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:46.291976 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:46.292036 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:46.292142 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:46.293321 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.293918 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.295056 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.295343 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.295468 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:46.298085 (+ 2617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:46.298088 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:46.298090 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:46.298116 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:46.299451 (+ 1335us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:46.300048 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:46.300051 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:46.300052 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:46.300135 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:46.300472 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:46.300475 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:46.300477 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:46.300670 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:46.300756 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:46.301320 (+ 564us) server_negotiation.cc:299] Negotiation successful
0808 04:42:46.301456 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 04:42:46.302596 742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:46.290363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:45223 (local address 127.0.0.1:45980)
0808 04:42:46.290864 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:46.290918 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:46.291756 (+ 838us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:46.292274 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:46.292281 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:46.292641 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:42:46.293164 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:46.293179 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.294026 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.294028 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:46.294908 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:46.294917 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.295516 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.295519 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:46.295685 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:46.296268 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:42:46.296285 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:42:46.297904 (+ 1619us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:42:46.299577 (+ 1673us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:46.299584 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:46.299602 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:46.299946 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:46.300221 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:46.300224 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:46.300226 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:46.300380 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:46.300774 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:42:46.300781 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:42:46.301066 (+ 285us) client_negotiation.cc:769] Sending connection context
0808 04:42:46.301244 (+ 178us) client_negotiation.cc:240] Negotiation successful
0808 04:42:46.301608 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":126,"threads_started":1}
I20260808 04:42:46.304337 736 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.148.125" port: 33579 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 04:42:46 dist-test-slave-t7g5 krb5kdc[506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164166, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.125@KRBTEST.COM for kudu/127.12.148.125@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.124.keytab.
Entry for principal kudu/127.12.148.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.124.keytab.
I20260808 04:42:46.312758 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.124:45039
--webserver_interface=127.12.148.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.124.keytab
--principal=kudu/127.12.148.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:41451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:45223,127.12.148.125:33579,127.12.148.124:45039
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 04:42:46.313337 742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:46.304860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.125:33579 (local address 127.0.0.1:33400)
0808 04:42:46.304987 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:46.304999 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:46.305064 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:46.305618 (+ 554us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:46.305621 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:46.305825 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:42:46.305915 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:46.305921 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.306879 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.306883 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:46.307464 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:46.307474 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.308053 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.308056 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:46.308141 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:46.308563 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:42:46.308574 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:42:46.309847 (+ 1273us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:42:46.311562 (+ 1715us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:46.311565 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:46.311567 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:46.311827 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:46.312194 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:46.312196 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:46.312197 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:46.312279 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:46.312885 (+ 606us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:42:46.312888 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:42:46.312999 (+ 111us) client_negotiation.cc:769] Sending connection context
0808 04:42:46.313103 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 04:42:46.313215 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260808 04:42:46.313527 744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:46.304952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33400 (local address 127.12.148.125:33579)
0808 04:42:46.305287 (+ 335us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:46.305295 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:46.305313 (+ 18us) server_negotiation.cc:407] Connection header received
0808 04:42:46.305345 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:46.305350 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:46.305504 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:46.305622 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:46.306016 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.306778 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.307566 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.307953 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.308045 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:46.309979 (+ 1934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:46.309988 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:46.310000 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:46.310024 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:46.311436 (+ 1412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:46.311965 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:46.311970 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:46.311972 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:46.312089 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:46.312361 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:46.312364 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:46.312366 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:46.312719 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:46.312911 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:46.313206 (+ 295us) server_negotiation.cc:299] Negotiation successful
0808 04:42:46.313361 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":149,"threads_started":1}
I20260808 04:42:46.314420 621 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.148.125" port: 33579 } attempt: 3
I20260808 04:42:46.315412 736 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.148.124" port: 45039 } has no permanent_uuid. Determining permanent_uuid...
I20260808 04:42:46.316243 742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:46.315925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:45039 (local address 127.0.0.1:49858)
0808 04:42:46.316089 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:46.316171 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.124:45039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
W20260808 04:42:46.316424 660 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.148.124:45039: connect: Connection refused (error 111)
I20260808 04:42:46.317299 742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:46.317079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:45039 (local address 127.0.0.1:49872)
0808 04:42:46.317179 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:46.317230 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.124:45039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260808 04:42:46.317437 736 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.148.124:45039: Network error: Client connection negotiation failed: client connection to 127.12.148.124:45039: connect: Connection refused (error 111)
Aug 08 04:42:46 dist-test-slave-t7g5 krb5kdc[506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164166, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for kudu/127.12.148.125@KRBTEST.COM
I20260808 04:42:46.322990 744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:46.314954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33410 (local address 127.12.148.125:33579)
0808 04:42:46.315065 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:46.315069 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:46.315177 (+ 108us) server_negotiation.cc:407] Connection header received
0808 04:42:46.315389 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:46.315392 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:46.315439 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:46.315528 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:46.315976 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.316514 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.317505 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.317833 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.317934 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:46.320116 (+ 2182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:46.320120 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:46.320123 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:46.320147 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:46.321425 (+ 1278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:46.321913 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:46.321917 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:46.321919 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:46.321993 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:46.322242 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:46.322245 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:46.322246 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:46.322424 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:46.322509 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:46.322756 (+ 247us) server_negotiation.cc:299] Negotiation successful
0808 04:42:46.322856 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 04:42:46.323004 626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:46.314912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.125:33579 (local address 127.0.0.1:33410)
0808 04:42:46.315106 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:46.315121 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:46.315212 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:46.315576 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:46.315580 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:46.315751 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:42:46.315858 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:46.315864 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.316618 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.316622 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:46.317372 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:46.317385 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.317941 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.317946 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:46.318055 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:46.318481 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:42:46.318496 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:42:46.319989 (+ 1493us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:42:46.321529 (+ 1540us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:46.321532 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:46.321534 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:46.321826 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:46.322075 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:46.322078 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:46.322080 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:46.322163 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:46.322515 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:42:46.322518 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:42:46.322612 (+ 94us) client_negotiation.cc:769] Sending connection context
0808 04:42:46.322696 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 04:42:46.322832 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119}
I20260808 04:42:46.323971 621 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.148.124" port: 45039 } has no permanent_uuid. Determining permanent_uuid...
I20260808 04:42:46.324673 626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:46.324453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:45039 (local address 127.0.0.1:49886)
0808 04:42:46.324564 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:46.324611 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.124:45039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260808 04:42:46.325320 626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:46.325091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:45039 (local address 127.0.0.1:49888)
0808 04:42:46.325225 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:46.325270 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.124:45039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
W20260808 04:42:46.325451 621 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.148.124:45039: Network error: Client connection negotiation failed: client connection to 127.12.148.124:45039: connect: Connection refused (error 111)
I20260808 04:42:46.356608 621 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.148.124" port: 45039 } attempt: 1
I20260808 04:42:46.358222 626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:46.357842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:45039 (local address 127.0.0.1:49896)
0808 04:42:46.358007 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:46.358096 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.124:45039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260808 04:42:46.358933 626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:46.358700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:45039 (local address 127.0.0.1:49902)
0808 04:42:46.358809 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:46.358857 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.124:45039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260808 04:42:46.359056 621 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.148.124:45039: Network error: Client connection negotiation failed: client connection to 127.12.148.124:45039: connect: Connection refused (error 111)
I20260808 04:42:46.366693 736 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.148.124" port: 45039 } attempt: 1
I20260808 04:42:46.367573 742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:46.367200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:45039 (local address 127.0.0.1:49904)
0808 04:42:46.367399 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:46.367473 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.124:45039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260808 04:42:46.368387 742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:46.368140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:45039 (local address 127.0.0.1:49916)
0808 04:42:46.368261 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:46.368317 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.124:45039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260808 04:42:46.368539 736 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.148.124:45039: Network error: Client connection negotiation failed: client connection to 127.12.148.124:45039: connect: Connection refused (error 111)
W20260808 04:42:46.428519 746 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:42:46.428808 746 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:42:46.428850 746 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:42:46.432821 746 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:42:46.432895 746 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:42:46.432921 746 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:42:46.432941 746 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:42:46.432961 746 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:42:46.434203 621 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.148.124" port: 45039 } attempt: 2
I20260808 04:42:46.434962 626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:46.434677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:45039 (local address 127.0.0.1:49924)
0808 04:42:46.434820 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:46.434883 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.124:45039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260808 04:42:46.435672 626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:46.435486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:45039 (local address 127.0.0.1:49930)
0808 04:42:46.435571 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:46.435616 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.124:45039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260808 04:42:46.435791 621 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.148.124:45039: Network error: Client connection negotiation failed: client connection to 127.12.148.124:45039: connect: Connection refused (error 111)
I20260808 04:42:46.436683 736 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.148.124" port: 45039 } attempt: 2
I20260808 04:42:46.437314 742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:46.437054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:45039 (local address 127.0.0.1:49938)
0808 04:42:46.437175 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:46.437231 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.124:45039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260808 04:42:46.437963 742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:46.437757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:45039 (local address 127.0.0.1:49954)
0808 04:42:46.437851 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:46.437899 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.124:45039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260808 04:42:46.438071 736 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.148.124:45039: Network error: Client connection negotiation failed: client connection to 127.12.148.124:45039: connect: Connection refused (error 111)
I20260808 04:42:46.438874 746 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:41451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:45223,127.12.148.125:33579,127.12.148.124:45039
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.124.keytab
--principal=kudu/127.12.148.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.124:45039
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.148.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.746
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:42:46.439885 746 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:42:46.440898 746 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:42:46.449051 753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:46.449052 757 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:46.449052 755 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:46.449347 746 server_base.cc:1034] running on GCE node
I20260808 04:42:46.449939 746 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:42:46.451030 746 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:42:46.452195 746 hybrid_clock.cc:648] HybridClock initialized: now 1786164166452163 us; error 37 us; skew 500 ppm
Aug 08 04:42:46 dist-test-slave-t7g5 krb5kdc[506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164166, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:42:46.454931 746 init.cc:377] Logged in from keytab as kudu/127.12.148.124@KRBTEST.COM (short username kudu)
I20260808 04:42:46.455823 746 webserver.cc:460] Webserver started at http://127.12.148.124:39377/ using document root <none> and password file <none>
I20260808 04:42:46.456351 746 fs_manager.cc:359] Metadata directory not provided
I20260808 04:42:46.456420 746 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:42:46.456605 746 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:42:46.458699 746 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-2/data/instance:
uuid: "e10e8f50dc1d4add8b9789098a3e7bf6"
format_stamp: "Formatted at 2026-08-08 04:42:46 on dist-test-slave-t7g5"
server_key: "01b7bd4dfd2f0ce4db5ee1330f691c53"
server_key_iv: "269c1a952e19701ace2e5397bbd76d8c"
server_key_version: "encryptionkey@0"
I20260808 04:42:46.459250 746 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-2/wal/instance:
uuid: "e10e8f50dc1d4add8b9789098a3e7bf6"
format_stamp: "Formatted at 2026-08-08 04:42:46 on dist-test-slave-t7g5"
server_key: "01b7bd4dfd2f0ce4db5ee1330f691c53"
server_key_iv: "269c1a952e19701ace2e5397bbd76d8c"
server_key_version: "encryptionkey@0"
I20260808 04:42:46.462926 746 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 04:42:46.465325 767 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:46.466548 746 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:42:46.466656 746 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-2/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-2/wal
uuid: "e10e8f50dc1d4add8b9789098a3e7bf6"
format_stamp: "Formatted at 2026-08-08 04:42:46 on dist-test-slave-t7g5"
server_key: "01b7bd4dfd2f0ce4db5ee1330f691c53"
server_key_iv: "269c1a952e19701ace2e5397bbd76d8c"
server_key_version: "encryptionkey@0"
I20260808 04:42:46.466759 746 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:42:46.485910 746 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:42:46.488955 746 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:42:46.489138 746 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:42:46.496058 746 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.124:45039
I20260808 04:42:46.496310 870 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.124:45039 every 8 connection(s)
I20260808 04:42:46.497001 746 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-2/data/info.pb
I20260808 04:42:46.499701 871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:42:46.500854 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 746
I20260808 04:42:46.500963 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786164004017495-12881-0/minicluster-data/master-2/wal/instance
I20260808 04:42:46.501233 12881 external_mini_cluster.cc:1428] Setting key 2b9d9767d70526cef174cb1925433679
I20260808 04:42:46.503819 871 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45223 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 04:42:46 dist-test-slave-t7g5 krb5kdc[506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164165, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.148.124@KRBTEST.COM
Aug 08 04:42:46 dist-test-slave-t7g5 krb5kdc[506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164166, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.124@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:42:46.514706 627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:46.505609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45988 (local address 127.12.148.126:45223)
0808 04:42:46.505755 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:46.505759 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:46.506158 (+ 399us) server_negotiation.cc:407] Connection header received
0808 04:42:46.506274 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:46.506276 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:46.506318 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:46.506383 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:46.507164 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.507646 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.508534 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.508741 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.508834 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:46.511293 (+ 2459us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:46.511297 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:46.511300 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:46.511329 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:46.512670 (+ 1341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:46.513182 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:46.513185 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:46.513187 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:46.513280 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:46.513627 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:46.513630 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:46.513632 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:46.513887 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:46.513981 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:46.514410 (+ 429us) server_negotiation.cc:299] Negotiation successful
0808 04:42:46.514538 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 04:42:46.515595 879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:46.502567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49968 (local address 127.12.148.124:45039)
0808 04:42:46.503000 (+ 433us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:46.503016 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:46.503051 (+ 35us) server_negotiation.cc:407] Connection header received
0808 04:42:46.503706 (+ 655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:46.503730 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:46.504146 (+ 416us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:46.504516 (+ 370us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:46.505318 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.506749 (+ 1431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.507583 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.508061 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.508206 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:46.510793 (+ 2587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:46.510799 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:46.510809 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:46.510831 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:46.512670 (+ 1839us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:46.513191 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:46.513197 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:46.513199 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:46.513324 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:46.513601 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:46.513604 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:46.513606 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:46.514146 (+ 540us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:46.514310 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:46.514567 (+ 257us) server_negotiation.cc:299] Negotiation successful
0808 04:42:46.514784 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":67,"server-negotiator.queue_time_us":300,"thread_start_us":141,"threads_started":1}
I20260808 04:42:46.515594 880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:46.505509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:45223 (local address 127.0.0.1:45988)
0808 04:42:46.506017 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:46.506067 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:46.506193 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:46.506443 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:46.506449 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:46.506894 (+ 445us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:42:46.507042 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:46.507048 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.507760 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.507764 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:46.508415 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:46.508424 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.508887 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.508891 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:46.509001 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:46.509488 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:42:46.509503 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:42:46.511128 (+ 1625us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:42:46.512784 (+ 1656us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:46.512794 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:46.512805 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:46.513086 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:46.513370 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:46.513372 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:46.513374 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:46.513544 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:46.513999 (+ 455us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:42:46.514005 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:42:46.514160 (+ 155us) client_negotiation.cc:769] Sending connection context
0808 04:42:46.514349 (+ 189us) client_negotiation.cc:240] Negotiation successful
0808 04:42:46.514723 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"mutex_wait_us":1,"spinlock_wait_cycles":7040,"thread_start_us":135,"threads_started":1}
I20260808 04:42:46.516862 871 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.148.125" port: 33579 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 04:42:46 dist-test-slave-t7g5 krb5kdc[506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164166, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.124@KRBTEST.COM for kudu/127.12.148.125@KRBTEST.COM
Aug 08 04:42:46 dist-test-slave-t7g5 krb5kdc[506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164165, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:42:46.525936 880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:46.517342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.125:33579 (local address 127.0.0.1:33422)
0808 04:42:46.517506 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:46.517521 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:46.517606 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:46.517862 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:46.517865 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:46.518054 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:42:46.518176 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:46.518183 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.519246 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.519250 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:46.519982 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:46.519991 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.520572 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.520575 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:46.520661 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:46.521161 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:42:46.521176 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:42:46.522422 (+ 1246us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:42:46.524404 (+ 1982us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:46.524407 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:46.524409 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:46.524616 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:46.524912 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:46.524915 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:46.524916 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:46.525030 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:46.525414 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:42:46.525416 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:42:46.525519 (+ 103us) client_negotiation.cc:769] Sending connection context
0808 04:42:46.525633 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 04:42:46.525796 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":89}
I20260808 04:42:46.526062 744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:46.517468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33422 (local address 127.12.148.125:33579)
0808 04:42:46.517595 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:46.517599 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:46.517614 (+ 15us) server_negotiation.cc:407] Connection header received
0808 04:42:46.517710 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:46.517713 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:46.517765 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:46.517843 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:46.518292 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.519089 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.520095 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.520445 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.520548 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:46.522581 (+ 2033us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:46.522584 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:46.522586 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:46.522613 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:46.524295 (+ 1682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:46.524702 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:46.524705 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:46.524707 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:46.524798 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:46.525124 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:46.525127 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:46.525128 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:46.525312 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:46.525416 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:46.525755 (+ 339us) server_negotiation.cc:299] Negotiation successful
0808 04:42:46.525874 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 04:42:46.526729 871 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.148.124" port: 45039 } has no permanent_uuid. Determining permanent_uuid...
I20260808 04:42:46.527010 627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:46.517851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45998 (local address 127.12.148.126:45223)
0808 04:42:46.517962 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:46.517966 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:46.518057 (+ 91us) server_negotiation.cc:407] Connection header received
0808 04:42:46.518130 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:46.518132 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:46.518176 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:46.518257 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:46.518948 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.519712 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.520709 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.520996 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.521089 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:46.523475 (+ 2386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:46.523479 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:46.523482 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:46.523510 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:46.524908 (+ 1398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:46.525326 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:46.525330 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:46.525331 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:46.525416 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:46.525779 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:46.525782 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:46.525784 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:46.526012 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:46.526469 (+ 457us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:46.526759 (+ 290us) server_negotiation.cc:299] Negotiation successful
0808 04:42:46.526871 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 04:42:46.529219 736 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.148.124" port: 45039 } attempt: 3
Aug 08 04:42:46 dist-test-slave-t7g5 krb5kdc[506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164166, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.124@KRBTEST.COM for kudu/127.12.148.124@KRBTEST.COM
Aug 08 04:42:46 dist-test-slave-t7g5 krb5kdc[506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164165, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.148.125@KRBTEST.COM
Aug 08 04:42:46 dist-test-slave-t7g5 krb5kdc[506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164166, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.125@KRBTEST.COM for kudu/127.12.148.124@KRBTEST.COM
I20260808 04:42:46.535050 880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:46.527264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:45039 (local address 127.0.0.1:49978)
0808 04:42:46.527367 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:46.527380 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:46.527442 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:46.527635 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:46.527638 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:46.527798 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:42:46.527901 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:46.527907 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.528976 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.528979 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:46.529573 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:46.529582 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.530116 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.530119 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:46.530189 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:46.530610 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:42:46.530624 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:42:46.531892 (+ 1268us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:42:46.533537 (+ 1645us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:46.533540 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:46.533541 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:46.533789 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:46.534090 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:46.534093 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:46.534095 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:46.534189 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:46.534579 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:42:46.534582 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:42:46.534665 (+ 83us) client_negotiation.cc:769] Sending connection context
0808 04:42:46.534749 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 04:42:46.534883 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 04:42:46.535156 621 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.148.124" port: 45039 } attempt: 3
I20260808 04:42:46.535064 879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:46.527309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49978 (local address 127.12.148.124:45039)
0808 04:42:46.527405 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:46.527409 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:46.527424 (+ 15us) server_negotiation.cc:407] Connection header received
0808 04:42:46.527518 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:46.527520 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:46.527563 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:46.527632 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:46.527999 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.528878 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.529731 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.530020 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.530104 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:46.532005 (+ 1901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:46.532008 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:46.532011 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:46.532031 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:46.533431 (+ 1400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:46.533883 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:46.533887 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:46.533889 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:46.533985 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:46.534283 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:46.534286 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:46.534288 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:46.534496 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:46.534587 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:46.534804 (+ 217us) server_negotiation.cc:299] Negotiation successful
0808 04:42:46.534947 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":39}
I20260808 04:42:46.538513 744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:46.528306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33428 (local address 127.12.148.125:33579)
0808 04:42:46.528407 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:46.528410 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:46.528422 (+ 12us) server_negotiation.cc:407] Connection header received
0808 04:42:46.528538 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:46.528541 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:46.528581 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:46.528638 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:46.529235 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.530131 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.531166 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.531546 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.531651 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:46.534365 (+ 2714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:46.534368 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:46.534370 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:46.534390 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:46.535909 (+ 1519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:46.536778 (+ 869us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:46.536781 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:46.536783 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:46.536882 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:46.537182 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:46.537185 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:46.537187 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:46.537410 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:46.537640 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:46.538255 (+ 615us) server_negotiation.cc:299] Negotiation successful
0808 04:42:46.538360 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":26,"server-negotiator.queue_time_us":45}
I20260808 04:42:46.539202 871 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e10e8f50dc1d4add8b9789098a3e7bf6: Bootstrap starting.
I20260808 04:42:46.539440 742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:46.529582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:45039 (local address 127.0.0.1:49994)
0808 04:42:46.529722 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:46.529735 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:46.529797 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:46.530336 (+ 539us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:46.530339 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:46.530483 (+ 144us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:42:46.530576 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:46.530582 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.531429 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.531433 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:46.532142 (+ 709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:46.532153 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.533434 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.533437 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:46.533530 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:46.533982 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:42:46.533996 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:42:46.535684 (+ 1688us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:42:46.538027 (+ 2343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:46.538030 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:46.538032 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:46.538246 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:46.538558 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:46.538561 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:46.538563 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:46.538649 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:46.539031 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:42:46.539034 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:42:46.539119 (+ 85us) client_negotiation.cc:769] Sending connection context
0808 04:42:46.539180 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 04:42:46.539290 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48,"mutex_wait_us":1}
I20260808 04:42:46.539882 881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:46.529810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49994 (local address 127.12.148.124:45039)
0808 04:42:46.530124 (+ 314us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:46.530132 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:46.530145 (+ 13us) server_negotiation.cc:407] Connection header received
0808 04:42:46.530176 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:46.530178 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:46.530219 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:46.530299 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:46.530668 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.531332 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.533052 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.533318 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.533411 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:46.535833 (+ 2422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:46.535837 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:46.535840 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:46.535864 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:46.537920 (+ 2056us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:46.538376 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:46.538379 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:46.538380 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:46.538456 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:46.538746 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:46.538748 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:46.538750 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:46.538928 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:46.539584 (+ 656us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:46.539645 (+ 61us) server_negotiation.cc:299] Negotiation successful
0808 04:42:46.539729 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":94,"threads_started":1}
I20260808 04:42:46.542232 871 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e10e8f50dc1d4add8b9789098a3e7bf6: Neither blocks nor log segments found. Creating new log.
I20260808 04:42:46.542670 736 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86990f563f9c4c98b193fa5bf02fca5a: Bootstrap starting.
Aug 08 04:42:46 dist-test-slave-t7g5 krb5kdc[506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164166, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for kudu/127.12.148.124@KRBTEST.COM
I20260808 04:42:46.542985 12881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:42:46.543176 871 log.cc:824] T 00000000000000000000000000000000 P e10e8f50dc1d4add8b9789098a3e7bf6: Log is configured to *not* fsync() on all Append() calls
I20260808 04:42:46.545356 736 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 86990f563f9c4c98b193fa5bf02fca5a: Neither blocks nor log segments found. Creating new log.
I20260808 04:42:46.545487 871 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e10e8f50dc1d4add8b9789098a3e7bf6: No bootstrap required, opened a new log
I20260808 04:42:46.546180 736 log.cc:824] T 00000000000000000000000000000000 P 86990f563f9c4c98b193fa5bf02fca5a: Log is configured to *not* fsync() on all Append() calls
I20260808 04:42:46.546931 879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:46.536346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50008 (local address 127.12.148.124:45039)
0808 04:42:46.536540 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:46.536545 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:46.536556 (+ 11us) server_negotiation.cc:407] Connection header received
0808 04:42:46.536583 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:46.536586 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:46.536621 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:46.536693 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:46.537145 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.537845 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.539360 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.540733 (+ 1373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.541188 (+ 455us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:46.543492 (+ 2304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:46.543496 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:46.543499 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:46.543522 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:46.545015 (+ 1493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:46.545586 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:46.545589 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:46.545590 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:46.545722 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:46.546065 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:46.546068 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:46.546069 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:46.546267 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:46.546399 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:46.546698 (+ 299us) server_negotiation.cc:299] Negotiation successful
0808 04:42:46.546796 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135}
I20260808 04:42:46.546957 626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:46.535599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:45039 (local address 127.0.0.1:50008)
0808 04:42:46.535831 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:46.535844 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:46.535908 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:46.536741 (+ 833us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:46.536745 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:46.536923 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:42:46.537029 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:46.537037 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.537987 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.537990 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:46.538706 (+ 716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:46.538718 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.540864 (+ 2146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.540868 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:46.540977 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:46.541393 (+ 416us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:42:46.541407 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:42:46.543299 (+ 1892us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:42:46.545141 (+ 1842us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:46.545145 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:46.545147 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:46.545390 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:46.545833 (+ 443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:46.545836 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:46.545838 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:46.545938 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:46.546407 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:42:46.546411 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:42:46.546517 (+ 106us) client_negotiation.cc:769] Sending connection context
0808 04:42:46.546629 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 04:42:46.546770 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161}
I20260808 04:42:46.549772 871 raft_consensus.cc:348] T 00000000000000000000000000000000 P e10e8f50dc1d4add8b9789098a3e7bf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "347c2fa876f9410495b55cdd6d89772b" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45223 } } peers { permanent_uuid: "86990f563f9c4c98b193fa5bf02fca5a" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 33579 } } peers { permanent_uuid: "e10e8f50dc1d4add8b9789098a3e7bf6" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 45039 } }
I20260808 04:42:46.549984 621 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 347c2fa876f9410495b55cdd6d89772b: Bootstrap starting.
I20260808 04:42:46.550020 871 raft_consensus.cc:374] T 00000000000000000000000000000000 P e10e8f50dc1d4add8b9789098a3e7bf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:42:46.550066 871 raft_consensus.cc:729] T 00000000000000000000000000000000 P e10e8f50dc1d4add8b9789098a3e7bf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10e8f50dc1d4add8b9789098a3e7bf6, State: Initialized, Role: FOLLOWER
I20260808 04:42:46.550778 871 consensus_queue.cc:260] T 00000000000000000000000000000000 P e10e8f50dc1d4add8b9789098a3e7bf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "347c2fa876f9410495b55cdd6d89772b" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45223 } } peers { permanent_uuid: "86990f563f9c4c98b193fa5bf02fca5a" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 33579 } } peers { permanent_uuid: "e10e8f50dc1d4add8b9789098a3e7bf6" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 45039 } }
I20260808 04:42:46.552218 871 sys_catalog.cc:564] T 00000000000000000000000000000000 P e10e8f50dc1d4add8b9789098a3e7bf6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:42:46.553041 621 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 347c2fa876f9410495b55cdd6d89772b: Neither blocks nor log segments found. Creating new log.
I20260808 04:42:46.554914 621 log.cc:824] T 00000000000000000000000000000000 P 347c2fa876f9410495b55cdd6d89772b: Log is configured to *not* fsync() on all Append() calls
I20260808 04:42:46.557492 744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:46.546717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33436 (local address 127.12.148.125:33579)
0808 04:42:46.546815 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:46.546819 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:46.548275 (+ 1456us) server_negotiation.cc:407] Connection header received
0808 04:42:46.548312 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:46.548315 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:46.548368 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:46.548429 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:46.549315 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.550086 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.551187 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.551503 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.551596 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:46.553189 (+ 1593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:46.553192 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:46.553195 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:46.553221 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:46.554787 (+ 1566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:46.555902 (+ 1115us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:46.555906 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:46.555908 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:46.555999 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:46.556288 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:46.556291 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:46.556293 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:46.556520 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:46.556655 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:46.557188 (+ 533us) server_negotiation.cc:299] Negotiation successful
0808 04:42:46.557324 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
W20260808 04:42:46.557868 918 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e10e8f50dc1d4add8b9789098a3e7bf6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 04:42:46.557955 918 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 04:42:46.558233 896 sys_catalog.cc:455] T 00000000000000000000000000000000 P e10e8f50dc1d4add8b9789098a3e7bf6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "347c2fa876f9410495b55cdd6d89772b" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45223 } } peers { permanent_uuid: "86990f563f9c4c98b193fa5bf02fca5a" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 33579 } } peers { permanent_uuid: "e10e8f50dc1d4add8b9789098a3e7bf6" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 45039 } } }
I20260808 04:42:46.558387 896 sys_catalog.cc:458] T 00000000000000000000000000000000 P e10e8f50dc1d4add8b9789098a3e7bf6 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:42:46.559676 621 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 347c2fa876f9410495b55cdd6d89772b: No bootstrap required, opened a new log
I20260808 04:42:46.556720 746 master_runner.cc:186] Error getting master registration for 127.12.148.126:45223: OK, instance_id { permanent_uuid: "347c2fa876f9410495b55cdd6d89772b" instance_seqno: 1786164166073221 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 04:42:46.560483 746 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 04:42:46.562673 736 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86990f563f9c4c98b193fa5bf02fca5a: No bootstrap required, opened a new log
I20260808 04:42:46.563222 621 raft_consensus.cc:348] T 00000000000000000000000000000000 P 347c2fa876f9410495b55cdd6d89772b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "347c2fa876f9410495b55cdd6d89772b" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45223 } } peers { permanent_uuid: "86990f563f9c4c98b193fa5bf02fca5a" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 33579 } } peers { permanent_uuid: "e10e8f50dc1d4add8b9789098a3e7bf6" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 45039 } }
I20260808 04:42:46.563426 621 raft_consensus.cc:374] T 00000000000000000000000000000000 P 347c2fa876f9410495b55cdd6d89772b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:42:46.563473 621 raft_consensus.cc:729] T 00000000000000000000000000000000 P 347c2fa876f9410495b55cdd6d89772b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 347c2fa876f9410495b55cdd6d89772b, State: Initialized, Role: FOLLOWER
I20260808 04:42:46.565702 627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:46.547764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46008 (local address 127.12.148.126:45223)
0808 04:42:46.547870 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:46.547874 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:46.551507 (+ 3633us) server_negotiation.cc:407] Connection header received
0808 04:42:46.551666 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:46.551669 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:46.551713 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:46.551761 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:46.553527 (+ 1766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.554343 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.556021 (+ 1678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.556312 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.556388 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:46.562144 (+ 5756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:46.562148 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:46.562151 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:46.562175 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:46.563723 (+ 1548us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:46.564254 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:46.564258 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:46.564260 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:46.564350 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:46.564659 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:46.564662 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:46.564664 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:46.564872 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:46.564994 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:46.565398 (+ 404us) server_negotiation.cc:299] Negotiation successful
0808 04:42:46.565517 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 04:42:46.565712 879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:46.547107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50012 (local address 127.12.148.124:45039)
0808 04:42:46.547645 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:46.547649 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:46.548444 (+ 795us) server_negotiation.cc:407] Connection header received
0808 04:42:46.548607 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:46.548610 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:46.548650 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:46.548694 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:46.549557 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.550295 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.552648 (+ 2353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:46.552938 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:46.553022 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:46.556377 (+ 3355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:46.556381 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:46.556383 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:46.556406 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:46.558000 (+ 1594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:46.564117 (+ 6117us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:46.564121 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:46.564123 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:46.564207 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:46.564490 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:46.564493 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:46.564495 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:46.564699 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:46.564818 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:46.565433 (+ 615us) server_negotiation.cc:299] Negotiation successful
0808 04:42:46.565543 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":473}
I20260808 04:42:46.567099 621 consensus_queue.cc:260] T 00000000000000000000000000000000 P 347c2fa876f9410495b55cdd6d89772b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "347c2fa876f9410495b55cdd6d89772b" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45223 } } peers { permanent_uuid: "86990f563f9c4c98b193fa5bf02fca5a" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 33579 } } peers { permanent_uuid: "e10e8f50dc1d4add8b9789098a3e7bf6" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 45039 } }
I20260808 04:42:46.567392 736 raft_consensus.cc:348] T 00000000000000000000000000000000 P 86990f563f9c4c98b193fa5bf02fca5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "347c2fa876f9410495b55cdd6d89772b" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45223 } } peers { permanent_uuid: "86990f563f9c4c98b193fa5bf02fca5a" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 33579 } } peers { permanent_uuid: "e10e8f50dc1d4add8b9789098a3e7bf6" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 45039 } }
I20260808 04:42:46.567606 736 raft_consensus.cc:374] T 00000000000000000000000000000000 P 86990f563f9c4c98b193fa5bf02fca5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:42:46.567670 736 raft_consensus.cc:729] T 00000000000000000000000000000000 P 86990f563f9c4c98b193fa5bf02fca5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86990f563f9c4c98b193fa5bf02fca5a, State: Initialized, Role: FOLLOWER
I20260808 04:42:46.567771 922 sys_catalog.cc:455] T 00000000000000000000000000000000 P 347c2fa876f9410495b55cdd6d89772b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "347c2fa876f9410495b55cdd6d89772b" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45223 } } peers { permanent_uuid: "86990f563f9c4c98b193fa5bf02fca5a" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 33579 } } peers { permanent_uuid: "e10e8f50dc1d4add8b9789098a3e7bf6" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 45039 } } }
I20260808 04:42:46.567989 922 sys_catalog.cc:458] T 00000000000000000000000000000000 P 347c2fa876f9410495b55cdd6d89772b [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:42:46.568145 736 consensus_queue.cc:260] T 00000000000000000000000000000000 P 86990f563f9c4c98b193fa5bf02fca5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "347c2fa876f9410495b55cdd6d89772b" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45223 } } peers { permanent_uuid: "86990f563f9c4c98b193fa5bf02fca5a" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 33579 } } peers { permanent_uuid: "e10e8f50dc1d4add8b9789098a3e7bf6" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 45039 } }
I20260808 04:42:46.568460 621 sys_catalog.cc:564] T 00000000000000000000000000000000 P 347c2fa876f9410495b55cdd6d89772b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:42:46.568676 924 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86990f563f9c4c98b193fa5bf02fca5a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "347c2fa876f9410495b55cdd6d89772b" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45223 } } peers { permanent_uuid: "86990f563f9c4c98b193fa5bf02fca5a" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 33579 } } peers { permanent_uuid: "e10e8f50dc1d4add8b9789098a3e7bf6" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 45039 } } }
I20260808 04:42:46.568871 924 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86990f563f9c4c98b193fa5bf02fca5a [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:42:46.569120 924 raft_consensus.cc:482] T 00000000000000000000000000000000 P 86990f563f9c4c98b193fa5bf02fca5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:42:46.569290 924 raft_consensus.cc:504] T 00000000000000000000000000000000 P 86990f563f9c4c98b193fa5bf02fca5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "347c2fa876f9410495b55cdd6d89772b" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45223 } } peers { permanent_uuid: "86990f563f9c4c98b193fa5bf02fca5a" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 33579 } } peers { permanent_uuid: "e10e8f50dc1d4add8b9789098a3e7bf6" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 45039 } }
I20260808 04:42:46.569530 736 sys_catalog.cc:564] T 00000000000000000000000000000000 P 86990f563f9c4c98b193fa5bf02fca5a [sys.catalog]: configured and running, proceeding with master startup.
W20260808 04:42:46.569758 549 tablet.cc:2369] T 00000000000000000000000000000000 P 347c2fa876f9410495b55cdd6d89772b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:42:46.572367 582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "86990f563f9c4c98b193fa5bf02fca5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "347c2fa876f9410495b55cdd6d89772b" is_pre_election: true
I20260808 04:42:46.572489 804 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "86990f563f9c4c98b193fa5bf02fca5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10e8f50dc1d4add8b9789098a3e7bf6" is_pre_election: true
I20260808 04:42:46.572650 582 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 347c2fa876f9410495b55cdd6d89772b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86990f563f9c4c98b193fa5bf02fca5a in term 0.
I20260808 04:42:46.572772 804 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e10e8f50dc1d4add8b9789098a3e7bf6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86990f563f9c4c98b193fa5bf02fca5a in term 0.
I20260808 04:42:46.573307 660 leader_election.cc:302] T 00000000000000000000000000000000 P 86990f563f9c4c98b193fa5bf02fca5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86990f563f9c4c98b193fa5bf02fca5a, e10e8f50dc1d4add8b9789098a3e7bf6; no voters:
I20260808 04:42:46.573746 924 leader_election.cc:288] T 00000000000000000000000000000000 P 86990f563f9c4c98b193fa5bf02fca5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 347c2fa876f9410495b55cdd6d89772b (127.12.148.126:45223), e10e8f50dc1d4add8b9789098a3e7bf6 (127.12.148.124:45039)
I20260808 04:42:46.573911 924 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 86990f563f9c4c98b193fa5bf02fca5a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:42:46.574052 924 raft_consensus.cc:482] T 00000000000000000000000000000000 P 86990f563f9c4c98b193fa5bf02fca5a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:42:46.574157 924 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 86990f563f9c4c98b193fa5bf02fca5a [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:42:46.575480 924 raft_consensus.cc:504] T 00000000000000000000000000000000 P 86990f563f9c4c98b193fa5bf02fca5a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "347c2fa876f9410495b55cdd6d89772b" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45223 } } peers { permanent_uuid: "86990f563f9c4c98b193fa5bf02fca5a" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 33579 } } peers { permanent_uuid: "e10e8f50dc1d4add8b9789098a3e7bf6" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 45039 } }
I20260808 04:42:46.576279 804 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "86990f563f9c4c98b193fa5bf02fca5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10e8f50dc1d4add8b9789098a3e7bf6"
I20260808 04:42:46.576406 804 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e10e8f50dc1d4add8b9789098a3e7bf6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:42:46.577596 804 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e10e8f50dc1d4add8b9789098a3e7bf6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86990f563f9c4c98b193fa5bf02fca5a in term 1.
I20260808 04:42:46.578598 660 leader_election.cc:302] T 00000000000000000000000000000000 P 86990f563f9c4c98b193fa5bf02fca5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86990f563f9c4c98b193fa5bf02fca5a, e10e8f50dc1d4add8b9789098a3e7bf6; no voters:
I20260808 04:42:46.578913 582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "86990f563f9c4c98b193fa5bf02fca5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "347c2fa876f9410495b55cdd6d89772b"
I20260808 04:42:46.579025 582 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 347c2fa876f9410495b55cdd6d89772b [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:42:46.580231 582 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 347c2fa876f9410495b55cdd6d89772b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86990f563f9c4c98b193fa5bf02fca5a in term 1.
I20260808 04:42:46.580401 524 master_runner.cc:263] No leader master found from master 347c2fa876f9410495b55cdd6d89772b
I20260808 04:42:46.580461 524 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 04:42:46.580566 924 leader_election.cc:288] T 00000000000000000000000000000000 P 86990f563f9c4c98b193fa5bf02fca5a [CANDIDATE]: Term 1 election: Requested vote from peers 347c2fa876f9410495b55cdd6d89772b (127.12.148.126:45223), e10e8f50dc1d4add8b9789098a3e7bf6 (127.12.148.124:45039)
W20260808 04:42:46.580674 955 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 86990f563f9c4c98b193fa5bf02fca5a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 04:42:46.580770 955 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 04:42:46.580706 924 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 86990f563f9c4c98b193fa5bf02fca5a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:42:46.580897 924 raft_consensus.cc:686] T 00000000000000000000000000000000 P 86990f563f9c4c98b193fa5bf02fca5a [term 1 LEADER]: Becoming Leader. State: Replica: 86990f563f9c4c98b193fa5bf02fca5a, State: Running, Role: LEADER
I20260808 04:42:46.581208 924 consensus_queue.cc:237] T 00000000000000000000000000000000 P 86990f563f9c4c98b193fa5bf02fca5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "347c2fa876f9410495b55cdd6d89772b" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45223 } } peers { permanent_uuid: "86990f563f9c4c98b193fa5bf02fca5a" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 33579 } } peers { permanent_uuid: "e10e8f50dc1d4add8b9789098a3e7bf6" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 45039 } }
I20260808 04:42:46.582003 633 master_runner.cc:232] Existing masters have differing terms: 0 vs 1
I20260808 04:42:46.582103 633 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 04:42:46.582994 924 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86990f563f9c4c98b193fa5bf02fca5a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 86990f563f9c4c98b193fa5bf02fca5a. Latest consensus state: current_term: 1 leader_uuid: "86990f563f9c4c98b193fa5bf02fca5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "347c2fa876f9410495b55cdd6d89772b" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45223 } } peers { permanent_uuid: "86990f563f9c4c98b193fa5bf02fca5a" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 33579 } } peers { permanent_uuid: "e10e8f50dc1d4add8b9789098a3e7bf6" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 45039 } } }
I20260808 04:42:46.583103 924 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86990f563f9c4c98b193fa5bf02fca5a [sys.catalog]: This master's current role is: LEADER
W20260808 04:42:46.583377 939 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 347c2fa876f9410495b55cdd6d89772b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260808 04:42:46.583446 963 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
W20260808 04:42:46.583456 939 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 04:42:46.584113 963 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:42:46.588762 804 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e10e8f50dc1d4add8b9789098a3e7bf6 [term 1 FOLLOWER]: Refusing update from remote peer 86990f563f9c4c98b193fa5bf02fca5a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:42:46.588857 582 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 347c2fa876f9410495b55cdd6d89772b [term 1 FOLLOWER]: Refusing update from remote peer 86990f563f9c4c98b193fa5bf02fca5a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:42:46.589568 924 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 86990f563f9c4c98b193fa5bf02fca5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "347c2fa876f9410495b55cdd6d89772b" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:42:46.590409 924 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 86990f563f9c4c98b193fa5bf02fca5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10e8f50dc1d4add8b9789098a3e7bf6" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 45039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:42:46.594228 922 sys_catalog.cc:455] T 00000000000000000000000000000000 P 347c2fa876f9410495b55cdd6d89772b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 86990f563f9c4c98b193fa5bf02fca5a. Latest consensus state: current_term: 1 leader_uuid: "86990f563f9c4c98b193fa5bf02fca5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "347c2fa876f9410495b55cdd6d89772b" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45223 } } peers { permanent_uuid: "86990f563f9c4c98b193fa5bf02fca5a" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 33579 } } peers { permanent_uuid: "e10e8f50dc1d4add8b9789098a3e7bf6" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 45039 } } }
I20260808 04:42:46.594340 922 sys_catalog.cc:458] T 00000000000000000000000000000000 P 347c2fa876f9410495b55cdd6d89772b [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:42:46.597805 896 sys_catalog.cc:455] T 00000000000000000000000000000000 P e10e8f50dc1d4add8b9789098a3e7bf6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 86990f563f9c4c98b193fa5bf02fca5a. Latest consensus state: current_term: 1 leader_uuid: "86990f563f9c4c98b193fa5bf02fca5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "347c2fa876f9410495b55cdd6d89772b" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45223 } } peers { permanent_uuid: "86990f563f9c4c98b193fa5bf02fca5a" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 33579 } } peers { permanent_uuid: "e10e8f50dc1d4add8b9789098a3e7bf6" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 45039 } } }
I20260808 04:42:46.597937 896 sys_catalog.cc:458] T 00000000000000000000000000000000 P e10e8f50dc1d4add8b9789098a3e7bf6 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:42:46.599961 956 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86990f563f9c4c98b193fa5bf02fca5a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "86990f563f9c4c98b193fa5bf02fca5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "347c2fa876f9410495b55cdd6d89772b" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45223 } } peers { permanent_uuid: "86990f563f9c4c98b193fa5bf02fca5a" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 33579 } } peers { permanent_uuid: "e10e8f50dc1d4add8b9789098a3e7bf6" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 45039 } } }
I20260808 04:42:46.600077 956 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86990f563f9c4c98b193fa5bf02fca5a [sys.catalog]: This master's current role is: LEADER
I20260808 04:42:46.600427 922 sys_catalog.cc:455] T 00000000000000000000000000000000 P 347c2fa876f9410495b55cdd6d89772b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "86990f563f9c4c98b193fa5bf02fca5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "347c2fa876f9410495b55cdd6d89772b" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45223 } } peers { permanent_uuid: "86990f563f9c4c98b193fa5bf02fca5a" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 33579 } } peers { permanent_uuid: "e10e8f50dc1d4add8b9789098a3e7bf6" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 45039 } } }
I20260808 04:42:46.600530 922 sys_catalog.cc:458] T 00000000000000000000000000000000 P 347c2fa876f9410495b55cdd6d89772b [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:42:46.601001 964 mvcc.cc:205] Tried to move back new op lower bound from 7316128426341150720 to 7316128426319740928. Current Snapshot: MvccSnapshot[applied={T|T < 7316128426341150720}]
I20260808 04:42:46.608971 963 catalog_manager.cc:1347] Generated new cluster ID: b06436dabfaa4e81a40c2aba118af3a6
I20260808 04:42:46.609047 963 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:42:46.609412 956 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86990f563f9c4c98b193fa5bf02fca5a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "86990f563f9c4c98b193fa5bf02fca5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "347c2fa876f9410495b55cdd6d89772b" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45223 } } peers { permanent_uuid: "86990f563f9c4c98b193fa5bf02fca5a" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 33579 } } peers { permanent_uuid: "e10e8f50dc1d4add8b9789098a3e7bf6" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 45039 } } }
I20260808 04:42:46.609529 956 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86990f563f9c4c98b193fa5bf02fca5a [sys.catalog]: This master's current role is: LEADER
I20260808 04:42:46.610801 896 sys_catalog.cc:455] T 00000000000000000000000000000000 P e10e8f50dc1d4add8b9789098a3e7bf6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "86990f563f9c4c98b193fa5bf02fca5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "347c2fa876f9410495b55cdd6d89772b" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45223 } } peers { permanent_uuid: "86990f563f9c4c98b193fa5bf02fca5a" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 33579 } } peers { permanent_uuid: "e10e8f50dc1d4add8b9789098a3e7bf6" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 45039 } } }
I20260808 04:42:46.610914 896 sys_catalog.cc:458] T 00000000000000000000000000000000 P e10e8f50dc1d4add8b9789098a3e7bf6 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:42:46.611474 970 mvcc.cc:205] Tried to move back new op lower bound from 7316128426341150720 to 7316128426319740928. Current Snapshot: MvccSnapshot[applied={T|T < 7316128426341150720}]
I20260808 04:42:46.659919 963 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:42:46.661288 963 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:42:46.675269 963 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 86990f563f9c4c98b193fa5bf02fca5a: Generated new TSK 0
I20260808 04:42:46.676188 963 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:42:47.559369 918 catalog_manager.cc:1259] Loaded cluster ID: b06436dabfaa4e81a40c2aba118af3a6
I20260808 04:42:47.559470 918 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e10e8f50dc1d4add8b9789098a3e7bf6: loading cluster ID for follower catalog manager: success
I20260808 04:42:47.561131 918 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e10e8f50dc1d4add8b9789098a3e7bf6: acquiring CA information for follower catalog manager: success
I20260808 04:42:47.562376 918 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e10e8f50dc1d4add8b9789098a3e7bf6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 04:42:47.584748 939 catalog_manager.cc:1259] Loaded cluster ID: b06436dabfaa4e81a40c2aba118af3a6
I20260808 04:42:47.584851 939 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 347c2fa876f9410495b55cdd6d89772b: loading cluster ID for follower catalog manager: success
I20260808 04:42:47.586580 939 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 347c2fa876f9410495b55cdd6d89772b: acquiring CA information for follower catalog manager: success
I20260808 04:42:47.587793 939 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 347c2fa876f9410495b55cdd6d89772b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 04:42:47.746146 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 524
I20260808 04:42:47.760152 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 633
I20260808 04:42:47.772123 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 746
2026-08-08T04:42:47Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3157 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164004017495-12881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:42:47 dist-test-slave-t7g5 krb5kdc[984](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:42:47 dist-test-slave-t7g5 krb5kdc[984](info): set up 2 sockets
Aug 08 04:42:47 dist-test-slave-t7g5 krb5kdc[984](info): commencing operation
krb5kdc: starting...
W20260808 04:42:48.925457 12881 mini_kdc.cc:121] Time spent starting KDC: real 1.126s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Aug 08 04:42:49 dist-test-slave-t7g5 krb5kdc[984](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164169, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:42:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:42:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.148.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
I20260808 04:42:49.049311 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:40019
--webserver_interface=127.12.148.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:33567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:40019
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:42:49.163708 1008 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:42:49.163996 1008 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:42:49.164038 1008 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:42:49.168309 1008 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:42:49.168452 1008 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:42:49.168509 1008 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:42:49.168553 1008 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:42:49.168586 1008 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:42:49.176587 1008 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:33567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:40019
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:40019
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1008
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:42:49.177896 1008 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:42:49.179116 1008 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:42:49.188243 1014 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:49.188315 1015 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:49.188328 1019 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:49.188414 1008 server_base.cc:1034] running on GCE node
I20260808 04:42:49.189145 1008 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:42:49.190333 1008 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:42:49.191537 1008 hybrid_clock.cc:648] HybridClock initialized: now 1786164169191512 us; error 35 us; skew 500 ppm
Aug 08 04:42:49 dist-test-slave-t7g5 krb5kdc[984](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164169, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:42:49.198863 1008 init.cc:377] Logged in from keytab as kudu/127.12.148.126@KRBTEST.COM (short username kudu)
I20260808 04:42:49.199877 1008 webserver.cc:460] Webserver started at http://127.12.148.126:46173/ using document root <none> and password file <none>
I20260808 04:42:49.200436 1008 fs_manager.cc:359] Metadata directory not provided
I20260808 04:42:49.200498 1008 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:42:49.200681 1008 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:42:49.202858 1008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "2fc97c84581143bb9283451621f5105a"
format_stamp: "Formatted at 2026-08-08 04:42:49 on dist-test-slave-t7g5"
server_key: "5ec4f571aed36db6df28bfb505240b1b"
server_key_iv: "2f768c0b10d273cd52271c648addaae0"
server_key_version: "encryptionkey@0"
I20260808 04:42:49.203393 1008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "2fc97c84581143bb9283451621f5105a"
format_stamp: "Formatted at 2026-08-08 04:42:49 on dist-test-slave-t7g5"
server_key: "5ec4f571aed36db6df28bfb505240b1b"
server_key_iv: "2f768c0b10d273cd52271c648addaae0"
server_key_version: "encryptionkey@0"
I20260808 04:42:49.207221 1008 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 04:42:49.209760 1027 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:49.211040 1008 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 04:42:49.211153 1008 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "2fc97c84581143bb9283451621f5105a"
format_stamp: "Formatted at 2026-08-08 04:42:49 on dist-test-slave-t7g5"
server_key: "5ec4f571aed36db6df28bfb505240b1b"
server_key_iv: "2f768c0b10d273cd52271c648addaae0"
server_key_version: "encryptionkey@0"
I20260808 04:42:49.211272 1008 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:42:49.222630 1008 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:42:49.225415 1008 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:42:49.225598 1008 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:42:49.232602 1008 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:40019
I20260808 04:42:49.232616 1109 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:40019 every 8 connection(s)
I20260808 04:42:49.233556 1008 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:42:49.236409 1110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:42:49.238965 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 1008
I20260808 04:42:49.239063 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:42:49.239331 12881 external_mini_cluster.cc:1428] Setting key 74eedf5b84f9479cf502959f2f0e2131
I20260808 04:42:49.242698 1110 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fc97c84581143bb9283451621f5105a: Bootstrap starting.
I20260808 04:42:49.245319 1110 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2fc97c84581143bb9283451621f5105a: Neither blocks nor log segments found. Creating new log.
I20260808 04:42:49.246179 1110 log.cc:824] T 00000000000000000000000000000000 P 2fc97c84581143bb9283451621f5105a: Log is configured to *not* fsync() on all Append() calls
I20260808 04:42:49.248049 1110 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fc97c84581143bb9283451621f5105a: No bootstrap required, opened a new log
Aug 08 04:42:49 dist-test-slave-t7g5 krb5kdc[984](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164169, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:42:49.251924 1110 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2fc97c84581143bb9283451621f5105a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fc97c84581143bb9283451621f5105a" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40019 } }
I20260808 04:42:49.252156 1110 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2fc97c84581143bb9283451621f5105a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:42:49.252229 1110 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2fc97c84581143bb9283451621f5105a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc97c84581143bb9283451621f5105a, State: Initialized, Role: FOLLOWER
I20260808 04:42:49.252673 1110 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2fc97c84581143bb9283451621f5105a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fc97c84581143bb9283451621f5105a" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40019 } }
I20260808 04:42:49.252826 1110 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2fc97c84581143bb9283451621f5105a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:42:49.252902 1110 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2fc97c84581143bb9283451621f5105a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:42:49.253002 1110 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2fc97c84581143bb9283451621f5105a [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:42:49.253914 1110 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2fc97c84581143bb9283451621f5105a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fc97c84581143bb9283451621f5105a" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40019 } }
I20260808 04:42:49.254245 1110 leader_election.cc:302] T 00000000000000000000000000000000 P 2fc97c84581143bb9283451621f5105a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2fc97c84581143bb9283451621f5105a; no voters:
I20260808 04:42:49.254580 1110 leader_election.cc:288] T 00000000000000000000000000000000 P 2fc97c84581143bb9283451621f5105a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:42:49.254673 1119 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2fc97c84581143bb9283451621f5105a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:42:49.254844 1119 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2fc97c84581143bb9283451621f5105a [term 1 LEADER]: Becoming Leader. State: Replica: 2fc97c84581143bb9283451621f5105a, State: Running, Role: LEADER
I20260808 04:42:49.254858 1117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:49.240659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52068 (local address 127.12.148.126:40019)
0808 04:42:49.241093 (+ 434us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:49.241112 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:49.241155 (+ 43us) server_negotiation.cc:407] Connection header received
0808 04:42:49.241988 (+ 833us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:49.242011 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:49.242423 (+ 412us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:49.242803 (+ 380us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:49.243479 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:49.244968 (+ 1489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:49.245862 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:49.246576 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:49.246745 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:49.249300 (+ 2555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:49.249306 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:49.249323 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:49.249363 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:49.251814 (+ 2451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:49.252228 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:49.252233 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:49.252238 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:49.252384 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:49.252677 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:49.252681 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:49.252682 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:49.253160 (+ 478us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:49.253364 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:49.253690 (+ 326us) server_negotiation.cc:299] Negotiation successful
0808 04:42:49.253987 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":122,"threads_started":1}
I20260808 04:42:49.255223 1119 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2fc97c84581143bb9283451621f5105a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fc97c84581143bb9283451621f5105a" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40019 } }
I20260808 04:42:49.255867 1110 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2fc97c84581143bb9283451621f5105a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:42:49.256930 1120 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fc97c84581143bb9283451621f5105a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2fc97c84581143bb9283451621f5105a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fc97c84581143bb9283451621f5105a" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40019 } } }
I20260808 04:42:49.257054 1120 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fc97c84581143bb9283451621f5105a [sys.catalog]: This master's current role is: LEADER
I20260808 04:42:49.257375 1121 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fc97c84581143bb9283451621f5105a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2fc97c84581143bb9283451621f5105a. Latest consensus state: current_term: 1 leader_uuid: "2fc97c84581143bb9283451621f5105a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fc97c84581143bb9283451621f5105a" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40019 } } }
I20260808 04:42:49.257459 1121 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fc97c84581143bb9283451621f5105a [sys.catalog]: This master's current role is: LEADER
I20260808 04:42:49.258152 12881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:42:49.258188 1128 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:42:49.261261 1128 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:42:49.266458 1128 catalog_manager.cc:1347] Generated new cluster ID: e7c5a4d7ad8c411c836511e76673ab6a
I20260808 04:42:49.266525 1128 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:42:49.289871 1128 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:42:49.290910 1128 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:42:49.296272 1128 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2fc97c84581143bb9283451621f5105a: Generated new TSK 0
I20260808 04:42:49.297015 1128 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:42:49.314150 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 1008
2026-08-08T04:42:49Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1544 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:42:49 dist-test-slave-t7g5 krb5kdc[1146](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:42:49 dist-test-slave-t7g5 krb5kdc[1146](info): set up 2 sockets
Aug 08 04:42:49 dist-test-slave-t7g5 krb5kdc[1146](info): commencing operation
krb5kdc: starting...
W20260808 04:42:50.461948 12881 mini_kdc.cc:121] Time spent starting KDC: real 1.118s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Aug 08 04:42:50 dist-test-slave-t7g5 krb5kdc[1146](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164170, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:42:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:42:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.148.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
I20260808 04:42:50.585316 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:40051
--webserver_interface=127.12.148.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:42437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:40051
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:42:50.696877 1163 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:42:50.697163 1163 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:42:50.697206 1163 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:42:50.701180 1163 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:42:50.701238 1163 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:42:50.701256 1163 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:42:50.701272 1163 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:42:50.701285 1163 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:42:50.706902 1163 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:42437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:40051
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:40051
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1163
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:42:50.707906 1163 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:42:50.708946 1163 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:42:50.717175 1176 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:50.717231 1173 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:50.717198 1174 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:50.717375 1163 server_base.cc:1034] running on GCE node
I20260808 04:42:50.718132 1163 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:42:50.719220 1163 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:42:50.720369 1163 hybrid_clock.cc:648] HybridClock initialized: now 1786164170720346 us; error 37 us; skew 500 ppm
Aug 08 04:42:50 dist-test-slave-t7g5 krb5kdc[1146](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164170, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:42:50.723174 1163 init.cc:377] Logged in from keytab as kudu/127.12.148.126@KRBTEST.COM (short username kudu)
I20260808 04:42:50.724115 1163 webserver.cc:460] Webserver started at http://127.12.148.126:46283/ using document root <none> and password file <none>
I20260808 04:42:50.724668 1163 fs_manager.cc:359] Metadata directory not provided
I20260808 04:42:50.724741 1163 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:42:50.724962 1163 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:42:50.727130 1163 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "386964c13efd470cac8229df4cbf2149"
format_stamp: "Formatted at 2026-08-08 04:42:50 on dist-test-slave-t7g5"
server_key: "0198b62d4b3f216fc49557a330c455bd"
server_key_iv: "03512e1257eeaf1b40d10696619531f2"
server_key_version: "encryptionkey@0"
I20260808 04:42:50.727703 1163 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "386964c13efd470cac8229df4cbf2149"
format_stamp: "Formatted at 2026-08-08 04:42:50 on dist-test-slave-t7g5"
server_key: "0198b62d4b3f216fc49557a330c455bd"
server_key_iv: "03512e1257eeaf1b40d10696619531f2"
server_key_version: "encryptionkey@0"
I20260808 04:42:50.731593 1163 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 04:42:50.734076 1184 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:50.735292 1163 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:42:50.735414 1163 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "386964c13efd470cac8229df4cbf2149"
format_stamp: "Formatted at 2026-08-08 04:42:50 on dist-test-slave-t7g5"
server_key: "0198b62d4b3f216fc49557a330c455bd"
server_key_iv: "03512e1257eeaf1b40d10696619531f2"
server_key_version: "encryptionkey@0"
I20260808 04:42:50.735528 1163 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:42:50.756734 1163 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:42:50.759796 1163 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:42:50.759990 1163 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:42:50.767380 1163 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:40051
I20260808 04:42:50.767652 1269 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:40051 every 8 connection(s)
I20260808 04:42:50.768374 1163 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:42:50.771175 1272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:42:50.772337 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 1163
I20260808 04:42:50.772454 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:42:50.772730 12881 external_mini_cluster.cc:1428] Setting key 2bb29c0761150b45eebf7d891aee7f97
I20260808 04:42:50.777840 1272 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149: Bootstrap starting.
I20260808 04:42:50.780447 1272 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149: Neither blocks nor log segments found. Creating new log.
I20260808 04:42:50.781198 1272 log.cc:824] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149: Log is configured to *not* fsync() on all Append() calls
Aug 08 04:42:50 dist-test-slave-t7g5 krb5kdc[1146](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164170, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:42:50.783401 1272 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149: No bootstrap required, opened a new log
I20260808 04:42:50.787042 1277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:50.774185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46108 (local address 127.12.148.126:40051)
0808 04:42:50.774622 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:50.774646 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:50.774690 (+ 44us) server_negotiation.cc:407] Connection header received
0808 04:42:50.775518 (+ 828us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:50.775543 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:50.775977 (+ 434us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:50.776354 (+ 377us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:50.776984 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:50.778428 (+ 1444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:50.779264 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:50.779933 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:50.780095 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:50.782701 (+ 2606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:50.782706 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:50.782719 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:50.782746 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:50.784297 (+ 1551us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:50.784773 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:50.784777 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:50.784781 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:50.784890 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:50.785157 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:50.785159 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:50.785160 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:50.785556 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:50.785740 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:50.786008 (+ 268us) server_negotiation.cc:299] Negotiation successful
0808 04:42:50.786290 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":287,"thread_start_us":116,"threads_started":1}
I20260808 04:42:50.787379 1272 raft_consensus.cc:348] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "386964c13efd470cac8229df4cbf2149" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40051 } }
I20260808 04:42:50.787609 1272 raft_consensus.cc:374] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:42:50.787678 1272 raft_consensus.cc:729] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386964c13efd470cac8229df4cbf2149, State: Initialized, Role: FOLLOWER
I20260808 04:42:50.788153 1272 consensus_queue.cc:260] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "386964c13efd470cac8229df4cbf2149" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40051 } }
I20260808 04:42:50.788321 1272 raft_consensus.cc:388] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:42:50.788385 1272 raft_consensus.cc:482] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:42:50.788481 1272 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:42:50.789600 1272 raft_consensus.cc:504] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "386964c13efd470cac8229df4cbf2149" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40051 } }
I20260808 04:42:50.789948 1272 leader_election.cc:302] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 386964c13efd470cac8229df4cbf2149; no voters:
I20260808 04:42:50.790230 1272 leader_election.cc:288] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:42:50.790343 1279 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:42:50.790552 1279 raft_consensus.cc:686] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [term 1 LEADER]: Becoming Leader. State: Replica: 386964c13efd470cac8229df4cbf2149, State: Running, Role: LEADER
I20260808 04:42:50.790890 1279 consensus_queue.cc:237] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "386964c13efd470cac8229df4cbf2149" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40051 } }
I20260808 04:42:50.791373 1272 sys_catalog.cc:564] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:42:50.792589 1281 sys_catalog.cc:455] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 386964c13efd470cac8229df4cbf2149. Latest consensus state: current_term: 1 leader_uuid: "386964c13efd470cac8229df4cbf2149" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "386964c13efd470cac8229df4cbf2149" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40051 } } }
I20260808 04:42:50.792600 1280 sys_catalog.cc:455] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "386964c13efd470cac8229df4cbf2149" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "386964c13efd470cac8229df4cbf2149" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40051 } } }
I20260808 04:42:50.792737 1281 sys_catalog.cc:458] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [sys.catalog]: This master's current role is: LEADER
I20260808 04:42:50.792745 1280 sys_catalog.cc:458] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [sys.catalog]: This master's current role is: LEADER
I20260808 04:42:50.793087 1291 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:42:50.796381 1291 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:42:50.802142 1291 catalog_manager.cc:1347] Generated new cluster ID: 53c249f496d74f6cba523ca82a4299c3
I20260808 04:42:50.802223 1291 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:42:50.846832 1291 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:42:50.848165 1291 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:42:50.854370 1291 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149: Generated new TSK 0
I20260808 04:42:50.855214 1291 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.148.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab.
Entry for principal kudu/127.12.148.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab.
I20260808 04:42:50.882913 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.65:0
--local_ip_for_outbound_sockets=127.12.148.65
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:40051
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:42437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:42:50.996760 1312 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:42:50.997045 1312 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:42:50.997088 1312 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:42:51.001120 1312 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:42:51.001188 1312 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:42:51.001247 1312 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.65
I20260808 04:42:51.006496 1312 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:42437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:40051
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1312
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.65
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:42:51.007524 1312 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:42:51.008531 1312 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:42:51.017976 1320 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:51.017985 1323 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:51.017985 1319 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:51.018249 1312 server_base.cc:1034] running on GCE node
I20260808 04:42:51.018646 1312 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:42:51.019295 1312 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:42:51.020455 1312 hybrid_clock.cc:648] HybridClock initialized: now 1786164171020428 us; error 37 us; skew 500 ppm
Aug 08 04:42:51 dist-test-slave-t7g5 krb5kdc[1146](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164171, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:42:51.023257 1312 init.cc:377] Logged in from keytab as kudu/127.12.148.65@KRBTEST.COM (short username kudu)
I20260808 04:42:51.024147 1312 webserver.cc:460] Webserver started at http://127.12.148.65:35901/ using document root <none> and password file <none>
I20260808 04:42:51.024699 1312 fs_manager.cc:359] Metadata directory not provided
I20260808 04:42:51.024768 1312 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:42:51.024959 1312 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:42:51.027001 1312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/data/instance:
uuid: "8272dbbed81f4156be5d5b45f2f7176c"
format_stamp: "Formatted at 2026-08-08 04:42:51 on dist-test-slave-t7g5"
server_key: "d13a69fd7480094b897be347d0b8b5fb"
server_key_iv: "6272215fbcaaf6197db421046bed3d84"
server_key_version: "encryptionkey@0"
I20260808 04:42:51.027549 1312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance:
uuid: "8272dbbed81f4156be5d5b45f2f7176c"
format_stamp: "Formatted at 2026-08-08 04:42:51 on dist-test-slave-t7g5"
server_key: "d13a69fd7480094b897be347d0b8b5fb"
server_key_iv: "6272215fbcaaf6197db421046bed3d84"
server_key_version: "encryptionkey@0"
I20260808 04:42:51.031199 1312 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260808 04:42:51.033630 1337 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:51.034934 1312 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 04:42:51.035034 1312 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/wal
uuid: "8272dbbed81f4156be5d5b45f2f7176c"
format_stamp: "Formatted at 2026-08-08 04:42:51 on dist-test-slave-t7g5"
server_key: "d13a69fd7480094b897be347d0b8b5fb"
server_key_iv: "6272215fbcaaf6197db421046bed3d84"
server_key_version: "encryptionkey@0"
I20260808 04:42:51.035138 1312 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:42:51.046518 1312 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:42:51.049423 1312 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:42:51.049597 1312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:42:51.050182 1312 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:42:51.050961 1312 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:42:51.051009 1312 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:51.051048 1312 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:42:51.051074 1312 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:51.059284 1312 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.65:40099
I20260808 04:42:51.059314 1510 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.65:40099 every 8 connection(s)
I20260808 04:42:51.060140 1312 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
Aug 08 04:42:51 dist-test-slave-t7g5 krb5kdc[1146](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164171, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:42:51.070061 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 1312
I20260808 04:42:51.070195 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance
I20260808 04:42:51.070540 12881 external_mini_cluster.cc:1428] Setting key fb1043d75eaa2361a351c96dfa929fd1
I20260808 04:42:51.073210 1277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:51.061850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:41833 (local address 127.12.148.126:40051)
0808 04:42:51.061994 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:51.061999 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:51.062833 (+ 834us) server_negotiation.cc:407] Connection header received
0808 04:42:51.064174 (+ 1341us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:51.064176 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:51.064222 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:51.064293 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:51.065426 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.066007 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.067046 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.067257 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.067319 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:51.069500 (+ 2181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:51.069503 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:51.069505 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:51.069529 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:51.071112 (+ 1583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:51.071662 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:51.071665 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:51.071668 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:51.071769 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:51.072134 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:51.072137 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:51.072139 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:51.072365 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:51.072465 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:51.072939 (+ 474us) server_negotiation.cc:299] Negotiation successful
0808 04:42:51.073063 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 04:42:51.073930 1515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:51.062243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.65:41833)
0808 04:42:51.062683 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:51.062725 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:51.063992 (+ 1267us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:51.064451 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:51.064457 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:51.064808 (+ 351us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:42:51.065304 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:51.065318 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.066100 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.066102 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:51.066954 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:51.066963 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.067355 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.067358 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:51.067487 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:51.067974 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:42:51.067990 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:42:51.069353 (+ 1363us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:42:51.071224 (+ 1871us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:51.071244 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:51.071256 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:51.071578 (+ 322us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:51.071863 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:51.071866 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:51.071868 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:51.072031 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:51.072475 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:42:51.072480 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:42:51.072690 (+ 210us) client_negotiation.cc:769] Sending connection context
0808 04:42:51.072872 (+ 182us) client_negotiation.cc:240] Negotiation successful
0808 04:42:51.073099 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":110,"threads_started":1}
I20260808 04:42:51.075081 1512 heartbeater.cc:347] Connected to a master server at 127.12.148.126:40051
I20260808 04:42:51.075290 1512 heartbeater.cc:464] Registering TS with master...
I20260808 04:42:51.075852 1512 heartbeater.cc:511] Master 127.12.148.126:40051 requested a full tablet report, sending...
I20260808 04:42:51.077370 1216 ts_manager.cc:194] Registered new tserver with Master: 8272dbbed81f4156be5d5b45f2f7176c (127.12.148.65:40099)
I20260808 04:42:51.078660 1216 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.65@KRBTEST.COM'} at 127.12.148.65:41833
WARNING: no policy specified for kudu/127.12.148.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab.
Entry for principal kudu/127.12.148.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab.
I20260808 04:42:51.100262 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.66:0
--local_ip_for_outbound_sockets=127.12.148.66
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:40051
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:42437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:42:51.212524 1525 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:42:51.212780 1525 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:42:51.212821 1525 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:42:51.216715 1525 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:42:51.216773 1525 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:42:51.216828 1525 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.66
I20260808 04:42:51.221925 1525 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:42437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:40051
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1525
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.66
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:42:51.222923 1525 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:42:51.223874 1525 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:42:51.233420 1532 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:51.233503 1525 server_base.cc:1034] running on GCE node
W20260808 04:42:51.233433 1531 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:51.233430 1534 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:51.234153 1525 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:42:51.234812 1525 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:42:51.235980 1525 hybrid_clock.cc:648] HybridClock initialized: now 1786164171235961 us; error 32 us; skew 500 ppm
Aug 08 04:42:51 dist-test-slave-t7g5 krb5kdc[1146](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164171, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:42:51.238806 1525 init.cc:377] Logged in from keytab as kudu/127.12.148.66@KRBTEST.COM (short username kudu)
I20260808 04:42:51.239813 1525 webserver.cc:460] Webserver started at http://127.12.148.66:42563/ using document root <none> and password file <none>
I20260808 04:42:51.240410 1525 fs_manager.cc:359] Metadata directory not provided
I20260808 04:42:51.240484 1525 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:42:51.240702 1525 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:42:51.242807 1525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/data/instance:
uuid: "af3c61c3d0ee4a548b5f6191b48631fa"
format_stamp: "Formatted at 2026-08-08 04:42:51 on dist-test-slave-t7g5"
server_key: "ff769f2d0ef675a41f1a97cfce403fe9"
server_key_iv: "5935cfe6d5c0b134420fb31f356075d9"
server_key_version: "encryptionkey@0"
I20260808 04:42:51.243387 1525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance:
uuid: "af3c61c3d0ee4a548b5f6191b48631fa"
format_stamp: "Formatted at 2026-08-08 04:42:51 on dist-test-slave-t7g5"
server_key: "ff769f2d0ef675a41f1a97cfce403fe9"
server_key_iv: "5935cfe6d5c0b134420fb31f356075d9"
server_key_version: "encryptionkey@0"
I20260808 04:42:51.247161 1525 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 04:42:51.249573 1542 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:51.250799 1525 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:42:51.250939 1525 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/wal
uuid: "af3c61c3d0ee4a548b5f6191b48631fa"
format_stamp: "Formatted at 2026-08-08 04:42:51 on dist-test-slave-t7g5"
server_key: "ff769f2d0ef675a41f1a97cfce403fe9"
server_key_iv: "5935cfe6d5c0b134420fb31f356075d9"
server_key_version: "encryptionkey@0"
I20260808 04:42:51.251045 1525 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:42:51.294490 1525 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:42:51.297866 1525 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:42:51.298055 1525 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:42:51.298650 1525 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:42:51.299487 1525 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:42:51.299536 1525 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:51.299582 1525 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:42:51.299610 1525 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:51.308179 1525 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.66:41967
I20260808 04:42:51.308208 1708 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.66:41967 every 8 connection(s)
I20260808 04:42:51.309113 1525 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
I20260808 04:42:51.317118 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 1525
I20260808 04:42:51.317233 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance
I20260808 04:42:51.317484 12881 external_mini_cluster.cc:1428] Setting key d55cb50724dc5f8e3530bde5e46a15c3
Aug 08 04:42:51 dist-test-slave-t7g5 krb5kdc[1146](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164171, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:42:51.322726 1277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:51.310927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:54523 (local address 127.12.148.126:40051)
0808 04:42:51.311064 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:51.311067 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:51.311948 (+ 881us) server_negotiation.cc:407] Connection header received
0808 04:42:51.313302 (+ 1354us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:51.313305 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:51.313364 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:51.313438 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:51.314696 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.315225 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.316360 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.316580 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.316669 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:51.319156 (+ 2487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:51.319160 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:51.319163 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:51.319194 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:51.320601 (+ 1407us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:51.321132 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:51.321135 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:51.321137 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:51.321221 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:51.321570 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:51.321572 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:51.321573 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:51.321802 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:51.321881 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:51.322486 (+ 605us) server_negotiation.cc:299] Negotiation successful
0808 04:42:51.322600 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 04:42:51.323849 1712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:51.311345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.66:54523)
0808 04:42:51.311799 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:51.311843 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:51.313095 (+ 1252us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:51.313613 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:51.313620 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:51.314023 (+ 403us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:42:51.314545 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:51.314560 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.315357 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.315359 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:51.316235 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:51.316245 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.316717 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.316722 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:51.316894 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:51.317455 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:42:51.317471 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:42:51.318988 (+ 1517us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:42:51.320710 (+ 1722us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:51.320715 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:51.320728 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:51.321029 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:51.321299 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:51.321302 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:51.321304 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:51.321490 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:51.321899 (+ 409us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:42:51.321906 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:42:51.322241 (+ 335us) client_negotiation.cc:769] Sending connection context
0808 04:42:51.322463 (+ 222us) client_negotiation.cc:240] Negotiation successful
0808 04:42:51.322808 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":120,"threads_started":1}
I20260808 04:42:51.325052 1710 heartbeater.cc:347] Connected to a master server at 127.12.148.126:40051
I20260808 04:42:51.325320 1710 heartbeater.cc:464] Registering TS with master...
I20260808 04:42:51.325968 1710 heartbeater.cc:511] Master 127.12.148.126:40051 requested a full tablet report, sending...
I20260808 04:42:51.327148 1216 ts_manager.cc:194] Registered new tserver with Master: af3c61c3d0ee4a548b5f6191b48631fa (127.12.148.66:41967)
I20260808 04:42:51.327920 1216 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.66@KRBTEST.COM'} at 127.12.148.66:54523
WARNING: no policy specified for kudu/127.12.148.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab.
Entry for principal kudu/127.12.148.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab.
I20260808 04:42:51.346621 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.67:0
--local_ip_for_outbound_sockets=127.12.148.67
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:40051
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:42437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:42:51.458081 1716 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:42:51.458346 1716 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:42:51.458406 1716 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:42:51.462347 1716 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:42:51.462405 1716 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:42:51.462486 1716 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.67
I20260808 04:42:51.467628 1716 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:42437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:40051
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1716
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.67
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:42:51.468639 1716 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:42:51.469626 1716 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:42:51.478845 1725 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:51.478852 1729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:51.479022 1726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:51.479115 1716 server_base.cc:1034] running on GCE node
I20260808 04:42:51.479581 1716 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:42:51.480227 1716 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:42:51.481405 1716 hybrid_clock.cc:648] HybridClock initialized: now 1786164171481372 us; error 48 us; skew 500 ppm
Aug 08 04:42:51 dist-test-slave-t7g5 krb5kdc[1146](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164171, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:42:51.484201 1716 init.cc:377] Logged in from keytab as kudu/127.12.148.67@KRBTEST.COM (short username kudu)
I20260808 04:42:51.485091 1716 webserver.cc:460] Webserver started at http://127.12.148.67:37183/ using document root <none> and password file <none>
I20260808 04:42:51.485646 1716 fs_manager.cc:359] Metadata directory not provided
I20260808 04:42:51.485793 1716 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:42:51.486016 1716 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:42:51.488042 1716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/data/instance:
uuid: "09cf4fd35d284cf5b343ebbaff9e835d"
format_stamp: "Formatted at 2026-08-08 04:42:51 on dist-test-slave-t7g5"
server_key: "c02661ca0f2e509b4d28c3e4660edbd6"
server_key_iv: "6eebedbe29c5452471e52e555483ac78"
server_key_version: "encryptionkey@0"
I20260808 04:42:51.488580 1716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance:
uuid: "09cf4fd35d284cf5b343ebbaff9e835d"
format_stamp: "Formatted at 2026-08-08 04:42:51 on dist-test-slave-t7g5"
server_key: "c02661ca0f2e509b4d28c3e4660edbd6"
server_key_iv: "6eebedbe29c5452471e52e555483ac78"
server_key_version: "encryptionkey@0"
I20260808 04:42:51.492336 1716 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260808 04:42:51.494783 1736 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:51.495986 1716 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 04:42:51.496105 1716 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/wal
uuid: "09cf4fd35d284cf5b343ebbaff9e835d"
format_stamp: "Formatted at 2026-08-08 04:42:51 on dist-test-slave-t7g5"
server_key: "c02661ca0f2e509b4d28c3e4660edbd6"
server_key_iv: "6eebedbe29c5452471e52e555483ac78"
server_key_version: "encryptionkey@0"
I20260808 04:42:51.496199 1716 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:42:51.512377 1716 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:42:51.515645 1716 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:42:51.515838 1716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:42:51.516438 1716 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:42:51.517275 1716 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:42:51.517328 1716 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:51.517379 1716 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:42:51.517408 1716 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:51.526315 1716 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.67:37909
I20260808 04:42:51.526486 1928 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.67:37909 every 8 connection(s)
I20260808 04:42:51.527426 1716 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
I20260808 04:42:51.533191 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 1716
I20260808 04:42:51.533318 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance
I20260808 04:42:51.533630 12881 external_mini_cluster.cc:1428] Setting key ea0c4be025047ab16702e9ce4c24f1fc
Aug 08 04:42:51 dist-test-slave-t7g5 krb5kdc[1146](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164171, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:42:51.542524 1277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:51.529520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:56095 (local address 127.12.148.126:40051)
0808 04:42:51.529726 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:51.529731 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:51.530645 (+ 914us) server_negotiation.cc:407] Connection header received
0808 04:42:51.532149 (+ 1504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:51.532152 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:51.532210 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:51.532284 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:51.533993 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.534719 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.536351 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.536673 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.536741 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:51.539444 (+ 2703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:51.539448 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:51.539450 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:51.539475 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:51.540746 (+ 1271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:51.541216 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:51.541218 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:51.541219 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:51.541308 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:51.541568 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:51.541569 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:51.541570 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:51.541762 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:51.541845 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:51.542303 (+ 458us) server_negotiation.cc:299] Negotiation successful
0808 04:42:51.542405 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 04:42:51.543352 1936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:51.529984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.67:56095)
0808 04:42:51.530493 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:51.530548 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:51.531937 (+ 1389us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:51.532470 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:51.532477 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:51.532846 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:42:51.533815 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:51.533838 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.534895 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.534898 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:51.536208 (+ 1310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:51.536219 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.536935 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.536939 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:51.537126 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:51.537730 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:42:51.537748 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:42:51.539296 (+ 1548us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:42:51.540858 (+ 1562us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:51.540863 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:51.540875 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:51.541139 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:51.541369 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:51.541371 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:51.541372 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:51.541499 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:51.541847 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:42:51.541852 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:42:51.542093 (+ 241us) client_negotiation.cc:769] Sending connection context
0808 04:42:51.542244 (+ 151us) client_negotiation.cc:240] Negotiation successful
0808 04:42:51.542498 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":110,"threads_started":1}
I20260808 04:42:51.544435 1930 heartbeater.cc:347] Connected to a master server at 127.12.148.126:40051
I20260808 04:42:51.544656 1930 heartbeater.cc:464] Registering TS with master...
I20260808 04:42:51.545120 1930 heartbeater.cc:511] Master 127.12.148.126:40051 requested a full tablet report, sending...
I20260808 04:42:51.546105 1216 ts_manager.cc:194] Registered new tserver with Master: 09cf4fd35d284cf5b343ebbaff9e835d (127.12.148.67:37909)
I20260808 04:42:51.546645 1216 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.67@KRBTEST.COM'} at 127.12.148.67:56095
I20260808 04:42:51.548380 12881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 04:42:51.556644 1277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:51.550379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46120 (local address 127.12.148.126:40051)
0808 04:42:51.550504 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:51.550508 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:51.550652 (+ 144us) server_negotiation.cc:407] Connection header received
0808 04:42:51.550740 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:51.550742 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:51.550779 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:51.550850 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:51.551447 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.551928 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.552658 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.552855 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.552925 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:51.554154 (+ 1229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:51.554157 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:51.554159 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:51.554180 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:51.555324 (+ 1144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:51.555715 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:51.555717 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:51.555718 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:51.555783 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:51.555966 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:51.555968 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:51.555969 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:51.556158 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:51.556252 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:51.556417 (+ 165us) server_negotiation.cc:299] Negotiation successful
0808 04:42:51.556505 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 04:42:51.559310 1216 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46120:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:42:51.562263 1216 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:42:51.576323 1954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:51.570216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:41967 (local address 127.0.0.1:38458)
0808 04:42:51.571069 (+ 853us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:51.571130 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:51.571256 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:51.572277 (+ 1021us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:51.572280 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:51.572299 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:42:51.572422 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:51.572430 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.573375 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.573378 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:51.574766 (+ 1388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:51.574777 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.575877 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.575881 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:51.576008 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:51.576032 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 04:42:51.576080 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 04:42:51.576168 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":792,"mutex_wait_us":45,"thread_start_us":100,"threads_started":1}
I20260808 04:42:51.576321 1950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:51.570848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:40099 (local address 127.0.0.1:42276)
0808 04:42:51.571544 (+ 696us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:51.571556 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:51.571633 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:51.572188 (+ 555us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:51.572190 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:51.572209 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:42:51.572293 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:51.572298 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.573680 (+ 1382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.573683 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:51.574955 (+ 1272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:51.574966 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.575964 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.575968 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:51.576075 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:51.576095 (+ 20us) client_negotiation.cc:769] Sending connection context
0808 04:42:51.576160 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 04:42:51.576210 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":643,"mutex_wait_us":288,"thread_start_us":93,"threads_started":1}
I20260808 04:42:51.576680 1957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:51.571144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42276 (local address 127.12.148.65:40099)
0808 04:42:51.571533 (+ 389us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:51.571548 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:51.571610 (+ 62us) server_negotiation.cc:407] Connection header received
0808 04:42:51.571735 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:51.571740 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:51.571942 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:51.572080 (+ 138us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:42:51.572421 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.573501 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.575093 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.575870 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.575966 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:51.576108 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:51.576189 (+ 81us) server_negotiation.cc:299] Negotiation successful
0808 04:42:51.576286 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":120,"threads_started":1}
I20260808 04:42:51.576714 1956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:51.570931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38458 (local address 127.12.148.66:41967)
0808 04:42:51.571864 (+ 933us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:51.571874 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:51.571896 (+ 22us) server_negotiation.cc:407] Connection header received
0808 04:42:51.571964 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:51.571969 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:51.572129 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:51.572291 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:42:51.572530 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.573251 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.574898 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.575732 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.576164 (+ 432us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:51.576296 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:51.576341 (+ 45us) server_negotiation.cc:299] Negotiation successful
0808 04:42:51.576568 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":832,"thread_start_us":143,"threads_started":1}
I20260808 04:42:51.577248 1951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:51.570111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.67:37909 (local address 127.0.0.1:42864)
0808 04:42:51.571217 (+ 1106us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:51.571233 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:51.571383 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:51.571884 (+ 501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:51.571890 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:51.571912 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:42:51.572063 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:51.572070 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.573517 (+ 1447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.573521 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:51.574941 (+ 1420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:51.574950 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.575724 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.575727 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:51.575851 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:51.575893 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 04:42:51.575997 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 04:42:51.577121 (+ 1124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"mutex_wait_us":65,"thread_start_us":66,"threads_started":1}
I20260808 04:42:51.576890 1952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:51.570264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42864 (local address 127.12.148.67:37909)
0808 04:42:51.570634 (+ 370us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:51.570647 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:51.571315 (+ 668us) server_negotiation.cc:407] Connection header received
0808 04:42:51.571532 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:51.571539 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:51.571731 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:51.571877 (+ 146us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:42:51.572173 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.573381 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.575051 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.575613 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.575710 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:51.575857 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:51.576670 (+ 813us) server_negotiation.cc:299] Negotiation successful
0808 04:42:51.576749 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":175,"threads_started":1}
I20260808 04:42:51.579696 1407 tablet_service.cc:1467] Processing CreateTablet for tablet 79486a5e7c2d41948f57c4f75194e927 (DEFAULT_TABLE table=test-table [id=be482dc5760f48d591caee365235d2b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:42:51.579697 1621 tablet_service.cc:1467] Processing CreateTablet for tablet 79486a5e7c2d41948f57c4f75194e927 (DEFAULT_TABLE table=test-table [id=be482dc5760f48d591caee365235d2b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:42:51.579991 1823 tablet_service.cc:1467] Processing CreateTablet for tablet 79486a5e7c2d41948f57c4f75194e927 (DEFAULT_TABLE table=test-table [id=be482dc5760f48d591caee365235d2b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:42:51.580821 1407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79486a5e7c2d41948f57c4f75194e927. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:42:51.580821 1621 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79486a5e7c2d41948f57c4f75194e927. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:42:51.580844 1823 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79486a5e7c2d41948f57c4f75194e927. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:42:51.587020 1958 tablet_bootstrap.cc:492] T 79486a5e7c2d41948f57c4f75194e927 P 09cf4fd35d284cf5b343ebbaff9e835d: Bootstrap starting.
I20260808 04:42:51.588261 1960 tablet_bootstrap.cc:492] T 79486a5e7c2d41948f57c4f75194e927 P 8272dbbed81f4156be5d5b45f2f7176c: Bootstrap starting.
I20260808 04:42:51.589969 1958 tablet_bootstrap.cc:654] T 79486a5e7c2d41948f57c4f75194e927 P 09cf4fd35d284cf5b343ebbaff9e835d: Neither blocks nor log segments found. Creating new log.
I20260808 04:42:51.589973 1961 tablet_bootstrap.cc:492] T 79486a5e7c2d41948f57c4f75194e927 P af3c61c3d0ee4a548b5f6191b48631fa: Bootstrap starting.
I20260808 04:42:51.590485 1960 tablet_bootstrap.cc:654] T 79486a5e7c2d41948f57c4f75194e927 P 8272dbbed81f4156be5d5b45f2f7176c: Neither blocks nor log segments found. Creating new log.
I20260808 04:42:51.591367 1960 log.cc:824] T 79486a5e7c2d41948f57c4f75194e927 P 8272dbbed81f4156be5d5b45f2f7176c: Log is configured to *not* fsync() on all Append() calls
I20260808 04:42:51.591367 1958 log.cc:824] T 79486a5e7c2d41948f57c4f75194e927 P 09cf4fd35d284cf5b343ebbaff9e835d: Log is configured to *not* fsync() on all Append() calls
I20260808 04:42:51.592293 1961 tablet_bootstrap.cc:654] T 79486a5e7c2d41948f57c4f75194e927 P af3c61c3d0ee4a548b5f6191b48631fa: Neither blocks nor log segments found. Creating new log.
I20260808 04:42:51.593173 1961 log.cc:824] T 79486a5e7c2d41948f57c4f75194e927 P af3c61c3d0ee4a548b5f6191b48631fa: Log is configured to *not* fsync() on all Append() calls
I20260808 04:42:51.593585 1958 tablet_bootstrap.cc:492] T 79486a5e7c2d41948f57c4f75194e927 P 09cf4fd35d284cf5b343ebbaff9e835d: No bootstrap required, opened a new log
I20260808 04:42:51.593644 1960 tablet_bootstrap.cc:492] T 79486a5e7c2d41948f57c4f75194e927 P 8272dbbed81f4156be5d5b45f2f7176c: No bootstrap required, opened a new log
I20260808 04:42:51.593824 1958 ts_tablet_manager.cc:1397] T 79486a5e7c2d41948f57c4f75194e927 P 09cf4fd35d284cf5b343ebbaff9e835d: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260808 04:42:51.593863 1960 ts_tablet_manager.cc:1397] T 79486a5e7c2d41948f57c4f75194e927 P 8272dbbed81f4156be5d5b45f2f7176c: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 04:42:51.595171 1961 tablet_bootstrap.cc:492] T 79486a5e7c2d41948f57c4f75194e927 P af3c61c3d0ee4a548b5f6191b48631fa: No bootstrap required, opened a new log
I20260808 04:42:51.595378 1961 ts_tablet_manager.cc:1397] T 79486a5e7c2d41948f57c4f75194e927 P af3c61c3d0ee4a548b5f6191b48631fa: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 04:42:51.596825 1958 raft_consensus.cc:348] T 79486a5e7c2d41948f57c4f75194e927 P 09cf4fd35d284cf5b343ebbaff9e835d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09cf4fd35d284cf5b343ebbaff9e835d" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37909 } } peers { permanent_uuid: "af3c61c3d0ee4a548b5f6191b48631fa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41967 } } peers { permanent_uuid: "8272dbbed81f4156be5d5b45f2f7176c" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40099 } }
I20260808 04:42:51.597055 1958 raft_consensus.cc:374] T 79486a5e7c2d41948f57c4f75194e927 P 09cf4fd35d284cf5b343ebbaff9e835d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:42:51.597110 1958 raft_consensus.cc:729] T 79486a5e7c2d41948f57c4f75194e927 P 09cf4fd35d284cf5b343ebbaff9e835d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09cf4fd35d284cf5b343ebbaff9e835d, State: Initialized, Role: FOLLOWER
I20260808 04:42:51.597541 1958 consensus_queue.cc:260] T 79486a5e7c2d41948f57c4f75194e927 P 09cf4fd35d284cf5b343ebbaff9e835d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09cf4fd35d284cf5b343ebbaff9e835d" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37909 } } peers { permanent_uuid: "af3c61c3d0ee4a548b5f6191b48631fa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41967 } } peers { permanent_uuid: "8272dbbed81f4156be5d5b45f2f7176c" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40099 } }
I20260808 04:42:51.598249 1930 heartbeater.cc:503] Master 127.12.148.126:40051 was elected leader, sending a full tablet report...
I20260808 04:42:51.598608 1958 ts_tablet_manager.cc:1428] T 79486a5e7c2d41948f57c4f75194e927 P 09cf4fd35d284cf5b343ebbaff9e835d: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260808 04:42:51.598129 1960 raft_consensus.cc:348] T 79486a5e7c2d41948f57c4f75194e927 P 8272dbbed81f4156be5d5b45f2f7176c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09cf4fd35d284cf5b343ebbaff9e835d" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37909 } } peers { permanent_uuid: "af3c61c3d0ee4a548b5f6191b48631fa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41967 } } peers { permanent_uuid: "8272dbbed81f4156be5d5b45f2f7176c" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40099 } }
I20260808 04:42:51.599046 1960 raft_consensus.cc:374] T 79486a5e7c2d41948f57c4f75194e927 P 8272dbbed81f4156be5d5b45f2f7176c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:42:51.599102 1960 raft_consensus.cc:729] T 79486a5e7c2d41948f57c4f75194e927 P 8272dbbed81f4156be5d5b45f2f7176c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8272dbbed81f4156be5d5b45f2f7176c, State: Initialized, Role: FOLLOWER
I20260808 04:42:51.599597 1960 consensus_queue.cc:260] T 79486a5e7c2d41948f57c4f75194e927 P 8272dbbed81f4156be5d5b45f2f7176c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09cf4fd35d284cf5b343ebbaff9e835d" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37909 } } peers { permanent_uuid: "af3c61c3d0ee4a548b5f6191b48631fa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41967 } } peers { permanent_uuid: "8272dbbed81f4156be5d5b45f2f7176c" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40099 } }
I20260808 04:42:51.599612 1961 raft_consensus.cc:348] T 79486a5e7c2d41948f57c4f75194e927 P af3c61c3d0ee4a548b5f6191b48631fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09cf4fd35d284cf5b343ebbaff9e835d" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37909 } } peers { permanent_uuid: "af3c61c3d0ee4a548b5f6191b48631fa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41967 } } peers { permanent_uuid: "8272dbbed81f4156be5d5b45f2f7176c" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40099 } }
I20260808 04:42:51.599852 1961 raft_consensus.cc:374] T 79486a5e7c2d41948f57c4f75194e927 P af3c61c3d0ee4a548b5f6191b48631fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:42:51.599921 1961 raft_consensus.cc:729] T 79486a5e7c2d41948f57c4f75194e927 P af3c61c3d0ee4a548b5f6191b48631fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3c61c3d0ee4a548b5f6191b48631fa, State: Initialized, Role: FOLLOWER
I20260808 04:42:51.600353 1961 consensus_queue.cc:260] T 79486a5e7c2d41948f57c4f75194e927 P af3c61c3d0ee4a548b5f6191b48631fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09cf4fd35d284cf5b343ebbaff9e835d" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37909 } } peers { permanent_uuid: "af3c61c3d0ee4a548b5f6191b48631fa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41967 } } peers { permanent_uuid: "8272dbbed81f4156be5d5b45f2f7176c" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40099 } }
I20260808 04:42:51.600618 1960 ts_tablet_manager.cc:1428] T 79486a5e7c2d41948f57c4f75194e927 P 8272dbbed81f4156be5d5b45f2f7176c: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260808 04:42:51.600965 1512 heartbeater.cc:503] Master 127.12.148.126:40051 was elected leader, sending a full tablet report...
I20260808 04:42:51.601095 1710 heartbeater.cc:503] Master 127.12.148.126:40051 was elected leader, sending a full tablet report...
I20260808 04:42:51.602047 1961 ts_tablet_manager.cc:1428] T 79486a5e7c2d41948f57c4f75194e927 P af3c61c3d0ee4a548b5f6191b48631fa: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260808 04:42:51.692785 1972 raft_consensus.cc:482] T 79486a5e7c2d41948f57c4f75194e927 P af3c61c3d0ee4a548b5f6191b48631fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:42:51.693010 1972 raft_consensus.cc:504] T 79486a5e7c2d41948f57c4f75194e927 P af3c61c3d0ee4a548b5f6191b48631fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09cf4fd35d284cf5b343ebbaff9e835d" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37909 } } peers { permanent_uuid: "af3c61c3d0ee4a548b5f6191b48631fa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41967 } } peers { permanent_uuid: "8272dbbed81f4156be5d5b45f2f7176c" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40099 } }
I20260808 04:42:51.694216 1972 leader_election.cc:288] T 79486a5e7c2d41948f57c4f75194e927 P af3c61c3d0ee4a548b5f6191b48631fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09cf4fd35d284cf5b343ebbaff9e835d (127.12.148.67:37909), 8272dbbed81f4156be5d5b45f2f7176c (127.12.148.65:40099)
I20260808 04:42:51.698694 1952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:51.694586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:33321 (local address 127.12.148.67:37909)
0808 04:42:51.694732 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:51.694736 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:51.695128 (+ 392us) server_negotiation.cc:407] Connection header received
0808 04:42:51.695211 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:51.695214 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:51.695264 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:51.695340 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:42:51.695575 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.696247 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.697553 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.698169 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.698268 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:51.698310 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:51.698491 (+ 181us) server_negotiation.cc:299] Negotiation successful
0808 04:42:51.698558 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 04:42:51.698694 1957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:51.694584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:48847 (local address 127.12.148.65:40099)
0808 04:42:51.694723 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:51.694727 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:51.694744 (+ 17us) server_negotiation.cc:407] Connection header received
0808 04:42:51.694836 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:51.694839 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:51.694890 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:51.694972 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:42:51.695248 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.696019 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.697452 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.698100 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.698224 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:51.698278 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:51.698499 (+ 221us) server_negotiation.cc:299] Negotiation successful
0808 04:42:51.698566 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 04:42:51.698740 1712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:51.694455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:40099 (local address 127.12.148.66:48847)
0808 04:42:51.694617 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:51.694633 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:51.694734 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:51.695000 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:51.695003 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:51.695023 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:42:51.695148 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:51.695155 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.696132 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.696135 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:51.697322 (+ 1187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:51.697340 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.698214 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.698218 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:51.698346 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:51.698421 (+ 75us) client_negotiation.cc:769] Sending connection context
0808 04:42:51.698485 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 04:42:51.698570 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":70,"mutex_wait_us":53}
I20260808 04:42:51.698747 1973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:51.694455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.67:37909 (local address 127.12.148.66:33321)
0808 04:42:51.695024 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:51.695037 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:51.695132 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:51.695356 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:51.695358 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:51.695373 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:42:51.695474 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:51.695479 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.696341 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.696344 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:51.697453 (+ 1109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:51.697462 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.698260 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.698264 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:51.698353 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:51.698396 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 04:42:51.698475 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 04:42:51.698570 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":504,"mutex_wait_us":192,"thread_start_us":149,"threads_started":1}
I20260808 04:42:51.699435 1853 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79486a5e7c2d41948f57c4f75194e927" candidate_uuid: "af3c61c3d0ee4a548b5f6191b48631fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09cf4fd35d284cf5b343ebbaff9e835d" is_pre_election: true
I20260808 04:42:51.699481 1443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79486a5e7c2d41948f57c4f75194e927" candidate_uuid: "af3c61c3d0ee4a548b5f6191b48631fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8272dbbed81f4156be5d5b45f2f7176c" is_pre_election: true
I20260808 04:42:51.699777 1443 raft_consensus.cc:2454] T 79486a5e7c2d41948f57c4f75194e927 P 8272dbbed81f4156be5d5b45f2f7176c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3c61c3d0ee4a548b5f6191b48631fa in term 0.
I20260808 04:42:51.699779 1853 raft_consensus.cc:2454] T 79486a5e7c2d41948f57c4f75194e927 P 09cf4fd35d284cf5b343ebbaff9e835d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af3c61c3d0ee4a548b5f6191b48631fa in term 0.
I20260808 04:42:51.700249 1543 leader_election.cc:302] T 79486a5e7c2d41948f57c4f75194e927 P af3c61c3d0ee4a548b5f6191b48631fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8272dbbed81f4156be5d5b45f2f7176c, af3c61c3d0ee4a548b5f6191b48631fa; no voters:
I20260808 04:42:51.700528 1972 raft_consensus.cc:2781] T 79486a5e7c2d41948f57c4f75194e927 P af3c61c3d0ee4a548b5f6191b48631fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:42:51.700609 1972 raft_consensus.cc:482] T 79486a5e7c2d41948f57c4f75194e927 P af3c61c3d0ee4a548b5f6191b48631fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:42:51.700640 1972 raft_consensus.cc:3037] T 79486a5e7c2d41948f57c4f75194e927 P af3c61c3d0ee4a548b5f6191b48631fa [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:42:51.701756 1972 raft_consensus.cc:504] T 79486a5e7c2d41948f57c4f75194e927 P af3c61c3d0ee4a548b5f6191b48631fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09cf4fd35d284cf5b343ebbaff9e835d" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37909 } } peers { permanent_uuid: "af3c61c3d0ee4a548b5f6191b48631fa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41967 } } peers { permanent_uuid: "8272dbbed81f4156be5d5b45f2f7176c" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40099 } }
I20260808 04:42:51.702114 1972 leader_election.cc:288] T 79486a5e7c2d41948f57c4f75194e927 P af3c61c3d0ee4a548b5f6191b48631fa [CANDIDATE]: Term 1 election: Requested vote from peers 09cf4fd35d284cf5b343ebbaff9e835d (127.12.148.67:37909), 8272dbbed81f4156be5d5b45f2f7176c (127.12.148.65:40099)
I20260808 04:42:51.702468 1853 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79486a5e7c2d41948f57c4f75194e927" candidate_uuid: "af3c61c3d0ee4a548b5f6191b48631fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09cf4fd35d284cf5b343ebbaff9e835d"
I20260808 04:42:51.702471 1443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79486a5e7c2d41948f57c4f75194e927" candidate_uuid: "af3c61c3d0ee4a548b5f6191b48631fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8272dbbed81f4156be5d5b45f2f7176c"
I20260808 04:42:51.702579 1443 raft_consensus.cc:3037] T 79486a5e7c2d41948f57c4f75194e927 P 8272dbbed81f4156be5d5b45f2f7176c [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:42:51.702586 1853 raft_consensus.cc:3037] T 79486a5e7c2d41948f57c4f75194e927 P 09cf4fd35d284cf5b343ebbaff9e835d [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:42:51.703578 1443 raft_consensus.cc:2454] T 79486a5e7c2d41948f57c4f75194e927 P 8272dbbed81f4156be5d5b45f2f7176c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3c61c3d0ee4a548b5f6191b48631fa in term 1.
I20260808 04:42:51.703603 1853 raft_consensus.cc:2454] T 79486a5e7c2d41948f57c4f75194e927 P 09cf4fd35d284cf5b343ebbaff9e835d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af3c61c3d0ee4a548b5f6191b48631fa in term 1.
I20260808 04:42:51.703871 1546 leader_election.cc:302] T 79486a5e7c2d41948f57c4f75194e927 P af3c61c3d0ee4a548b5f6191b48631fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 09cf4fd35d284cf5b343ebbaff9e835d, 8272dbbed81f4156be5d5b45f2f7176c, af3c61c3d0ee4a548b5f6191b48631fa; no voters:
I20260808 04:42:51.704063 1972 raft_consensus.cc:2781] T 79486a5e7c2d41948f57c4f75194e927 P af3c61c3d0ee4a548b5f6191b48631fa [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:42:51.704282 1972 raft_consensus.cc:686] T 79486a5e7c2d41948f57c4f75194e927 P af3c61c3d0ee4a548b5f6191b48631fa [term 1 LEADER]: Becoming Leader. State: Replica: af3c61c3d0ee4a548b5f6191b48631fa, State: Running, Role: LEADER
I20260808 04:42:51.704628 1972 consensus_queue.cc:237] T 79486a5e7c2d41948f57c4f75194e927 P af3c61c3d0ee4a548b5f6191b48631fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09cf4fd35d284cf5b343ebbaff9e835d" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37909 } } peers { permanent_uuid: "af3c61c3d0ee4a548b5f6191b48631fa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41967 } } peers { permanent_uuid: "8272dbbed81f4156be5d5b45f2f7176c" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40099 } }
I20260808 04:42:51.707810 1215 catalog_manager.cc:5495] T 79486a5e7c2d41948f57c4f75194e927 P af3c61c3d0ee4a548b5f6191b48631fa reported cstate change: term changed from 0 to 1, leader changed from <none> to af3c61c3d0ee4a548b5f6191b48631fa (127.12.148.66). New cstate: current_term: 1 leader_uuid: "af3c61c3d0ee4a548b5f6191b48631fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09cf4fd35d284cf5b343ebbaff9e835d" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af3c61c3d0ee4a548b5f6191b48631fa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8272dbbed81f4156be5d5b45f2f7176c" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40099 } health_report { overall_health: UNKNOWN } } }
I20260808 04:42:51.726503 1956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:51.723060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38460 (local address 127.12.148.66:41967)
0808 04:42:51.723183 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:51.723187 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:51.723200 (+ 13us) server_negotiation.cc:407] Connection header received
0808 04:42:51.723312 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:51.723315 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:51.723369 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:51.723467 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:42:51.723700 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.724189 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.724997 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:51.725211 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:51.725300 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:51.725585 (+ 285us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:42:51.726068 (+ 483us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:42:51.726180 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:51.726239 (+ 59us) server_negotiation.cc:299] Negotiation successful
0808 04:42:51.726299 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 04:42:51.732057 1853 raft_consensus.cc:1261] T 79486a5e7c2d41948f57c4f75194e927 P 09cf4fd35d284cf5b343ebbaff9e835d [term 1 FOLLOWER]: Refusing update from remote peer af3c61c3d0ee4a548b5f6191b48631fa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:42:51.732056 1443 raft_consensus.cc:1261] T 79486a5e7c2d41948f57c4f75194e927 P 8272dbbed81f4156be5d5b45f2f7176c [term 1 FOLLOWER]: Refusing update from remote peer af3c61c3d0ee4a548b5f6191b48631fa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:42:51.732782 1975 consensus_queue.cc:1035] T 79486a5e7c2d41948f57c4f75194e927 P af3c61c3d0ee4a548b5f6191b48631fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "09cf4fd35d284cf5b343ebbaff9e835d" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:42:51.732959 1972 consensus_queue.cc:1035] T 79486a5e7c2d41948f57c4f75194e927 P af3c61c3d0ee4a548b5f6191b48631fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "8272dbbed81f4156be5d5b45f2f7176c" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:42:51.748240 1215 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46120:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:42:51.748449 1215 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46120:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:42:51.750968 1215 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149: Sending DeleteTablet for 3 replicas of tablet 79486a5e7c2d41948f57c4f75194e927
I20260808 04:42:51.751731 1823 tablet_service.cc:1514] Processing DeleteTablet for tablet 79486a5e7c2d41948f57c4f75194e927 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:42:51 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:42864
I20260808 04:42:51.751789 1621 tablet_service.cc:1514] Processing DeleteTablet for tablet 79486a5e7c2d41948f57c4f75194e927 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:42:51 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:38458
I20260808 04:42:51.751935 1407 tablet_service.cc:1514] Processing DeleteTablet for tablet 79486a5e7c2d41948f57c4f75194e927 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:42:51 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:42276
I20260808 04:42:51.752245 1994 tablet_replica.cc:330] T 79486a5e7c2d41948f57c4f75194e927 P af3c61c3d0ee4a548b5f6191b48631fa: stopping tablet replica
I20260808 04:42:51.752339 1995 tablet_replica.cc:330] T 79486a5e7c2d41948f57c4f75194e927 P 8272dbbed81f4156be5d5b45f2f7176c: stopping tablet replica
I20260808 04:42:51.752548 1994 raft_consensus.cc:2229] T 79486a5e7c2d41948f57c4f75194e927 P af3c61c3d0ee4a548b5f6191b48631fa [term 1 LEADER]: Raft consensus shutting down.
I20260808 04:42:51.752650 1995 raft_consensus.cc:2229] T 79486a5e7c2d41948f57c4f75194e927 P 8272dbbed81f4156be5d5b45f2f7176c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:42:51.752713 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 1312
I20260808 04:42:51.766708 1993 tablet_replica.cc:330] T 79486a5e7c2d41948f57c4f75194e927 P 09cf4fd35d284cf5b343ebbaff9e835d: stopping tablet replica
I20260808 04:42:51.767092 1993 raft_consensus.cc:2229] T 79486a5e7c2d41948f57c4f75194e927 P 09cf4fd35d284cf5b343ebbaff9e835d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:42:51.767581 1993 raft_consensus.cc:2258] T 79486a5e7c2d41948f57c4f75194e927 P 09cf4fd35d284cf5b343ebbaff9e835d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:42:51.769300 1993 ts_tablet_manager.cc:1905] T 79486a5e7c2d41948f57c4f75194e927 P 09cf4fd35d284cf5b343ebbaff9e835d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:42:51.772085 1993 ts_tablet_manager.cc:1918] T 79486a5e7c2d41948f57c4f75194e927 P 09cf4fd35d284cf5b343ebbaff9e835d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:42:51.772192 1993 log.cc:1196] T 79486a5e7c2d41948f57c4f75194e927 P 09cf4fd35d284cf5b343ebbaff9e835d: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/wal/wals/79486a5e7c2d41948f57c4f75194e927
I20260808 04:42:51.772526 1993 ts_tablet_manager.cc:1939] T 79486a5e7c2d41948f57c4f75194e927 P 09cf4fd35d284cf5b343ebbaff9e835d: Deleting consensus metadata
I20260808 04:42:51.773892 1994 raft_consensus.cc:2258] T 79486a5e7c2d41948f57c4f75194e927 P af3c61c3d0ee4a548b5f6191b48631fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:42:51.773902 1189 catalog_manager.cc:4841] TS 09cf4fd35d284cf5b343ebbaff9e835d (127.12.148.67:37909): tablet 79486a5e7c2d41948f57c4f75194e927 (table test-table [id=be482dc5760f48d591caee365235d2b5]) successfully deleted
W20260808 04:42:51.774919 1185 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.148.65:40099 (error 108)
I20260808 04:42:51.775470 1994 ts_tablet_manager.cc:1905] T 79486a5e7c2d41948f57c4f75194e927 P af3c61c3d0ee4a548b5f6191b48631fa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:42:51.775535 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 1525
I20260808 04:42:51.782533 1951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:51.782225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:40099 (local address 127.0.0.1:42282)
0808 04:42:51.782373 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:51.782451 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.65:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260808 04:42:51.782785 1185 catalog_manager.cc:4584] TS 8272dbbed81f4156be5d5b45f2f7176c (127.12.148.65:40099): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 79486a5e7c2d41948f57c4f75194e927: Network error: Client connection negotiation failed: client connection to 127.12.148.65:40099: connect: Connection refused (error 111)
I20260808 04:42:51.793529 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 1716
I20260808 04:42:51.793744 1951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:51.793445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:41967 (local address 127.0.0.1:38476)
0808 04:42:51.793563 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:51.793617 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.66:41967: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 04:42:51.806269 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 1163
I20260808 04:42:51.817126 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:40051
--webserver_interface=127.12.148.126
--webserver_port=46283
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:42437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:40051
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:42:51.928758 1997 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:42:51.929021 1997 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:42:51.929059 1997 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:42:51.933015 1997 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:42:51.933076 1997 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:42:51.933094 1997 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:42:51.933113 1997 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:42:51.933140 1997 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:42:51.938333 1997 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:42437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:40051
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:40051
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=46283
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1997
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:42:51.939340 1997 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:42:51.940342 1997 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:42:51.954038 2008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:51.954058 2007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:51.954052 2011 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:51.954460 1997 server_base.cc:1034] running on GCE node
I20260808 04:42:51.955063 1997 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:42:51.956230 1997 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:42:51.957391 1997 hybrid_clock.cc:648] HybridClock initialized: now 1786164171957373 us; error 30 us; skew 500 ppm
Aug 08 04:42:51 dist-test-slave-t7g5 krb5kdc[1146](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164171, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:42:51.960274 1997 init.cc:377] Logged in from keytab as kudu/127.12.148.126@KRBTEST.COM (short username kudu)
I20260808 04:42:51.961189 1997 webserver.cc:460] Webserver started at http://127.12.148.126:46283/ using document root <none> and password file <none>
I20260808 04:42:51.961812 1997 fs_manager.cc:359] Metadata directory not provided
I20260808 04:42:51.961898 1997 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:42:51.965857 1997 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260808 04:42:51.968016 2019 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:51.969214 1997 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:42:51.969324 1997 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "386964c13efd470cac8229df4cbf2149"
format_stamp: "Formatted at 2026-08-08 04:42:50 on dist-test-slave-t7g5"
server_key: "0198b62d4b3f216fc49557a330c455bd"
server_key_iv: "03512e1257eeaf1b40d10696619531f2"
server_key_version: "encryptionkey@0"
I20260808 04:42:51.969973 1997 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:42:51.986771 1997 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:42:51.989974 1997 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:42:51.990159 1997 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:42:51.997108 1997 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:40051
I20260808 04:42:51.997363 2106 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:40051 every 8 connection(s)
I20260808 04:42:51.998239 1997 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:42:52.002568 2107 sys_catalog.cc:263] Verifying existing consensus state
I20260808 04:42:52.003420 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 1997
I20260808 04:42:52.003822 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.65:40099
--local_ip_for_outbound_sockets=127.12.148.65
--tserver_master_addrs=127.12.148.126:40051
--webserver_port=35901
--webserver_interface=127.12.148.65
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:42437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 04:42:52.004317 2107 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149: Bootstrap starting.
I20260808 04:42:52.026424 2107 log.cc:824] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149: Log is configured to *not* fsync() on all Append() calls
I20260808 04:42:52.037724 2107 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 04:42:52.038156 2107 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149: Bootstrap complete.
I20260808 04:42:52.043557 2107 raft_consensus.cc:348] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "386964c13efd470cac8229df4cbf2149" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40051 } }
I20260808 04:42:52.044076 2107 raft_consensus.cc:729] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386964c13efd470cac8229df4cbf2149, State: Initialized, Role: FOLLOWER
I20260808 04:42:52.044631 2107 consensus_queue.cc:260] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "386964c13efd470cac8229df4cbf2149" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40051 } }
I20260808 04:42:52.044778 2107 raft_consensus.cc:388] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:42:52.044862 2107 raft_consensus.cc:482] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:42:52.044958 2107 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [term 1 FOLLOWER]: Advancing to term 2
I20260808 04:42:52.047453 2107 raft_consensus.cc:504] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "386964c13efd470cac8229df4cbf2149" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40051 } }
I20260808 04:42:52.047866 2107 leader_election.cc:302] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 386964c13efd470cac8229df4cbf2149; no voters:
I20260808 04:42:52.048243 2107 leader_election.cc:288] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 04:42:52.048357 2116 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 04:42:52.048700 2116 raft_consensus.cc:686] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [term 2 LEADER]: Becoming Leader. State: Replica: 386964c13efd470cac8229df4cbf2149, State: Running, Role: LEADER
I20260808 04:42:52.049042 2116 consensus_queue.cc:237] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "386964c13efd470cac8229df4cbf2149" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40051 } }
I20260808 04:42:52.049611 2107 sys_catalog.cc:564] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:42:52.050503 2118 sys_catalog.cc:455] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "386964c13efd470cac8229df4cbf2149" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "386964c13efd470cac8229df4cbf2149" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40051 } } }
I20260808 04:42:52.050635 2118 sys_catalog.cc:458] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [sys.catalog]: This master's current role is: LEADER
I20260808 04:42:52.050913 2119 sys_catalog.cc:455] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 386964c13efd470cac8229df4cbf2149. Latest consensus state: current_term: 2 leader_uuid: "386964c13efd470cac8229df4cbf2149" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "386964c13efd470cac8229df4cbf2149" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40051 } } }
I20260808 04:42:52.051003 2119 sys_catalog.cc:458] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [sys.catalog]: This master's current role is: LEADER
I20260808 04:42:52.051666 2127 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:42:52.056735 2127 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:42:52.057356 2127 catalog_manager.cc:1259] Loaded cluster ID: 53c249f496d74f6cba523ca82a4299c3
I20260808 04:42:52.057418 2127 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:42:52.058773 2127 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260808 04:42:52.063180 2127 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260808 04:42:52.068590 2127 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:42:52.069304 2127 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149: Loaded TSK: 0
I20260808 04:42:52.070546 2127 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 04:42:52.135356 2109 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:42:52.135630 2109 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:42:52.135699 2109 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:42:52.139659 2109 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:42:52.139721 2109 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:42:52.139796 2109 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.65
I20260808 04:42:52.144884 2109 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:42437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.65:40099
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.148.65
--webserver_port=35901
--tserver_master_addrs=127.12.148.126:40051
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2109
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.65
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:42:52.145879 2109 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:42:52.146874 2109 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:42:52.156417 2146 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:52.156603 2109 server_base.cc:1034] running on GCE node
W20260808 04:42:52.156438 2149 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:52.156454 2152 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:52.157251 2109 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:42:52.157894 2109 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:42:52.159057 2109 hybrid_clock.cc:648] HybridClock initialized: now 1786164172159025 us; error 53 us; skew 500 ppm
Aug 08 04:42:52 dist-test-slave-t7g5 krb5kdc[1146](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164172, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:42:52.161967 2109 init.cc:377] Logged in from keytab as kudu/127.12.148.65@KRBTEST.COM (short username kudu)
I20260808 04:42:52.162791 2109 webserver.cc:460] Webserver started at http://127.12.148.65:35901/ using document root <none> and password file <none>
I20260808 04:42:52.163316 2109 fs_manager.cc:359] Metadata directory not provided
I20260808 04:42:52.163400 2109 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:42:52.167552 2109 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 04:42:52.169687 2159 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:52.170940 2109 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 04:42:52.171047 2109 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/wal
uuid: "8272dbbed81f4156be5d5b45f2f7176c"
format_stamp: "Formatted at 2026-08-08 04:42:51 on dist-test-slave-t7g5"
server_key: "d13a69fd7480094b897be347d0b8b5fb"
server_key_iv: "6272215fbcaaf6197db421046bed3d84"
server_key_version: "encryptionkey@0"
I20260808 04:42:52.171617 2109 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:42:52.185766 2109 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:42:52.188925 2109 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:42:52.189132 2109 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:42:52.189888 2109 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:42:52.191262 2169 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 04:42:52.196703 2109 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 04:42:52.196775 2109 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.001s sys 0.000s
I20260808 04:42:52.196847 2109 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 04:42:52.198769 2109 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 04:42:52.198832 2109 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.001s
I20260808 04:42:52.199116 2169 tablet_bootstrap.cc:492] T 79486a5e7c2d41948f57c4f75194e927 P 8272dbbed81f4156be5d5b45f2f7176c: Bootstrap starting.
I20260808 04:42:52.209337 2109 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.65:40099
I20260808 04:42:52.209344 2329 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.65:40099 every 8 connection(s)
I20260808 04:42:52.210570 2109 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
I20260808 04:42:52.212126 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 2109
I20260808 04:42:52.212637 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.66:41967
--local_ip_for_outbound_sockets=127.12.148.66
--tserver_master_addrs=127.12.148.126:40051
--webserver_port=42563
--webserver_interface=127.12.148.66
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:42437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 04:42:52.219640 2169 log.cc:824] T 79486a5e7c2d41948f57c4f75194e927 P 8272dbbed81f4156be5d5b45f2f7176c: Log is configured to *not* fsync() on all Append() calls
Aug 08 04:42:52 dist-test-slave-t7g5 krb5kdc[1146](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164172, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:42:52.228116 2169 tablet_bootstrap.cc:492] T 79486a5e7c2d41948f57c4f75194e927 P 8272dbbed81f4156be5d5b45f2f7176c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 04:42:52.228291 2335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:52.212685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.65:44431)
0808 04:42:52.213244 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:52.213296 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:52.214273 (+ 977us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:52.215372 (+ 1099us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:52.215380 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:52.215868 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:42:52.216487 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:52.216505 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:52.218528 (+ 2023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:52.218532 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:52.219897 (+ 1365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:52.219909 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:52.220831 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:52.220835 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:52.221040 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:52.221604 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:42:52.221620 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:42:52.223197 (+ 1577us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:42:52.225178 (+ 1981us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:52.225183 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:52.225197 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:52.225467 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:52.225841 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:52.225844 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:52.225846 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:52.225993 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:52.226637 (+ 644us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:42:52.226643 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:42:52.226906 (+ 263us) client_negotiation.cc:769] Sending connection context
0808 04:42:52.227067 (+ 161us) client_negotiation.cc:240] Negotiation successful
0808 04:42:52.227384 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":178,"threads_started":1}
I20260808 04:42:52.228507 2169 tablet_bootstrap.cc:492] T 79486a5e7c2d41948f57c4f75194e927 P 8272dbbed81f4156be5d5b45f2f7176c: Bootstrap complete.
I20260808 04:42:52.228323 2340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:52.213769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:44431 (local address 127.12.148.126:40051)
0808 04:42:52.214237 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:52.214255 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:52.214301 (+ 46us) server_negotiation.cc:407] Connection header received
0808 04:42:52.214687 (+ 386us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:52.214697 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:52.214994 (+ 297us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:52.215289 (+ 295us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:52.216694 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:52.218344 (+ 1650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:52.220065 (+ 1721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:52.220689 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:52.220857 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:52.223378 (+ 2521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:52.223383 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:52.223395 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:52.223424 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:52.225062 (+ 1638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:52.225577 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:52.225582 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:52.225586 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:52.225751 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:52.226082 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:52.226086 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:52.226088 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:52.226418 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:52.226576 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:52.227203 (+ 627us) server_negotiation.cc:299] Negotiation successful
0808 04:42:52.227455 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":130,"threads_started":1}
I20260808 04:42:52.229840 2169 ts_tablet_manager.cc:1397] T 79486a5e7c2d41948f57c4f75194e927 P 8272dbbed81f4156be5d5b45f2f7176c: Time spent bootstrapping tablet: real 0.031s user 0.022s sys 0.008s
I20260808 04:42:52.230813 2331 heartbeater.cc:347] Connected to a master server at 127.12.148.126:40051
I20260808 04:42:52.231031 2331 heartbeater.cc:464] Registering TS with master...
I20260808 04:42:52.231472 2331 heartbeater.cc:511] Master 127.12.148.126:40051 requested a full tablet report, sending...
I20260808 04:42:52.232584 2169 raft_consensus.cc:348] T 79486a5e7c2d41948f57c4f75194e927 P 8272dbbed81f4156be5d5b45f2f7176c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09cf4fd35d284cf5b343ebbaff9e835d" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37909 } } peers { permanent_uuid: "af3c61c3d0ee4a548b5f6191b48631fa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41967 } } peers { permanent_uuid: "8272dbbed81f4156be5d5b45f2f7176c" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40099 } }
I20260808 04:42:52.233088 2169 raft_consensus.cc:729] T 79486a5e7c2d41948f57c4f75194e927 P 8272dbbed81f4156be5d5b45f2f7176c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8272dbbed81f4156be5d5b45f2f7176c, State: Initialized, Role: FOLLOWER
I20260808 04:42:52.233556 2169 consensus_queue.cc:260] T 79486a5e7c2d41948f57c4f75194e927 P 8272dbbed81f4156be5d5b45f2f7176c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09cf4fd35d284cf5b343ebbaff9e835d" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37909 } } peers { permanent_uuid: "af3c61c3d0ee4a548b5f6191b48631fa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41967 } } peers { permanent_uuid: "8272dbbed81f4156be5d5b45f2f7176c" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40099 } }
I20260808 04:42:52.233747 2045 ts_manager.cc:194] Registered new tserver with Master: 8272dbbed81f4156be5d5b45f2f7176c (127.12.148.65:40099)
I20260808 04:42:52.234563 2169 ts_tablet_manager.cc:1428] T 79486a5e7c2d41948f57c4f75194e927 P 8272dbbed81f4156be5d5b45f2f7176c: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260808 04:42:52.237011 2045 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.65@KRBTEST.COM'} at 127.12.148.65:44431
I20260808 04:42:52.239336 2331 heartbeater.cc:503] Master 127.12.148.126:40051 was elected leader, sending a full tablet report...
Aug 08 04:42:52 dist-test-slave-t7g5 krb5kdc[1146](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164171, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for kudu/127.12.148.65@KRBTEST.COM
I20260808 04:42:52.246686 2348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:52.236512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42292 (local address 127.12.148.65:40099)
0808 04:42:52.236879 (+ 367us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:52.236890 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:52.237290 (+ 400us) server_negotiation.cc:407] Connection header received
0808 04:42:52.237463 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:52.237468 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:52.237684 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:52.237808 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:52.238518 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:52.239517 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:52.240712 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:52.241107 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:52.241191 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:52.243546 (+ 2355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:52.243554 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:52.243564 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:52.243584 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:52.244959 (+ 1375us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:52.245443 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:52.245448 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:52.245450 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:52.245522 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:52.245798 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:52.245801 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:52.245802 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:52.246024 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:52.246120 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:52.246447 (+ 327us) server_negotiation.cc:299] Negotiation successful
0808 04:42:52.246570 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":256,"thread_start_us":94,"threads_started":1}
I20260808 04:42:52.246732 2345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:52.236417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:40099 (local address 127.0.0.1:42292)
0808 04:42:52.237145 (+ 728us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:52.237193 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:52.237326 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:52.237869 (+ 543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:52.237874 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:52.238266 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:42:52.238388 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:52.238396 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:52.239638 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:52.239641 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:52.240568 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:52.240579 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:52.241214 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:52.241218 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:52.241325 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:52.241900 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:42:52.241915 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:42:52.243418 (+ 1503us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:42:52.245062 (+ 1644us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:52.245072 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:52.245077 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:52.245353 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:52.245597 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:52.245601 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:52.245602 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:52.245722 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:52.246126 (+ 404us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:42:52.246132 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:42:52.246248 (+ 116us) client_negotiation.cc:769] Sending connection context
0808 04:42:52.246396 (+ 148us) client_negotiation.cc:240] Negotiation successful
0808 04:42:52.246571 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":561,"thread_start_us":92,"threads_started":1}
I20260808 04:42:52.247870 2229 tablet_service.cc:1514] Processing DeleteTablet for tablet 79486a5e7c2d41948f57c4f75194e927 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:42:51 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:42292
I20260808 04:42:52.248745 2350 tablet_replica.cc:330] stopping tablet replica
I20260808 04:42:52.249006 2350 raft_consensus.cc:2229] T 79486a5e7c2d41948f57c4f75194e927 P 8272dbbed81f4156be5d5b45f2f7176c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:42:52.249291 2350 raft_consensus.cc:2258] T 79486a5e7c2d41948f57c4f75194e927 P 8272dbbed81f4156be5d5b45f2f7176c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:42:52.250458 2350 ts_tablet_manager.cc:1905] T 79486a5e7c2d41948f57c4f75194e927 P 8272dbbed81f4156be5d5b45f2f7176c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:42:52.253973 2350 ts_tablet_manager.cc:1918] T 79486a5e7c2d41948f57c4f75194e927 P 8272dbbed81f4156be5d5b45f2f7176c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:42:52.254062 2350 log.cc:1196] T 79486a5e7c2d41948f57c4f75194e927 P 8272dbbed81f4156be5d5b45f2f7176c: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/wal/wals/79486a5e7c2d41948f57c4f75194e927
I20260808 04:42:52.254292 2350 ts_tablet_manager.cc:1939] T 79486a5e7c2d41948f57c4f75194e927 P 8272dbbed81f4156be5d5b45f2f7176c: Deleting consensus metadata
I20260808 04:42:52.255822 2020 catalog_manager.cc:4841] TS 8272dbbed81f4156be5d5b45f2f7176c (127.12.148.65:40099): tablet 79486a5e7c2d41948f57c4f75194e927 (table test-table [id=be482dc5760f48d591caee365235d2b5]) successfully deleted
W20260808 04:42:52.332423 2342 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:42:52.332705 2342 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:42:52.332747 2342 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:42:52.336783 2342 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:42:52.336848 2342 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:42:52.336918 2342 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.66
I20260808 04:42:52.342163 2342 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:42437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.66:41967
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.148.66
--webserver_port=42563
--tserver_master_addrs=127.12.148.126:40051
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2342
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.66
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:42:52.343195 2342 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:42:52.344199 2342 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:42:52.353667 2365 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:52.353673 2357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:52.353667 2355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:52.354292 2342 server_base.cc:1034] running on GCE node
I20260808 04:42:52.354660 2342 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:42:52.355240 2342 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:42:52.356393 2342 hybrid_clock.cc:648] HybridClock initialized: now 1786164172356372 us; error 32 us; skew 500 ppm
Aug 08 04:42:52 dist-test-slave-t7g5 krb5kdc[1146](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164172, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:42:52.359064 2342 init.cc:377] Logged in from keytab as kudu/127.12.148.66@KRBTEST.COM (short username kudu)
I20260808 04:42:52.359939 2342 webserver.cc:460] Webserver started at http://127.12.148.66:42563/ using document root <none> and password file <none>
I20260808 04:42:52.360473 2342 fs_manager.cc:359] Metadata directory not provided
I20260808 04:42:52.360569 2342 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:42:52.364399 2342 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.001s
I20260808 04:42:52.366508 2375 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:52.367678 2342 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 04:42:52.367774 2342 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/wal
uuid: "af3c61c3d0ee4a548b5f6191b48631fa"
format_stamp: "Formatted at 2026-08-08 04:42:51 on dist-test-slave-t7g5"
server_key: "ff769f2d0ef675a41f1a97cfce403fe9"
server_key_iv: "5935cfe6d5c0b134420fb31f356075d9"
server_key_version: "encryptionkey@0"
I20260808 04:42:52.368284 2342 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:42:52.389956 2342 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:42:52.392819 2342 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:42:52.392994 2342 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:42:52.393548 2342 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:42:52.394680 2391 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 04:42:52.398793 2342 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 04:42:52.398860 2342 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.000s
I20260808 04:42:52.398926 2342 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 04:42:52.400540 2342 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 04:42:52.400588 2342 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260808 04:42:52.400838 2391 tablet_bootstrap.cc:492] T 79486a5e7c2d41948f57c4f75194e927 P af3c61c3d0ee4a548b5f6191b48631fa: Bootstrap starting.
I20260808 04:42:52.406493 2391 log.cc:824] T 79486a5e7c2d41948f57c4f75194e927 P af3c61c3d0ee4a548b5f6191b48631fa: Log is configured to *not* fsync() on all Append() calls
I20260808 04:42:52.410183 2342 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.66:41967
I20260808 04:42:52.410252 2561 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.66:41967 every 8 connection(s)
I20260808 04:42:52.411011 2342 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
I20260808 04:42:52.412349 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 2342
I20260808 04:42:52.412788 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.67:37909
--local_ip_for_outbound_sockets=127.12.148.67
--tserver_master_addrs=127.12.148.126:40051
--webserver_port=37183
--webserver_interface=127.12.148.67
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:42437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 04:42:52.415045 2391 tablet_bootstrap.cc:492] T 79486a5e7c2d41948f57c4f75194e927 P af3c61c3d0ee4a548b5f6191b48631fa: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 04:42:52.415477 2391 tablet_bootstrap.cc:492] T 79486a5e7c2d41948f57c4f75194e927 P af3c61c3d0ee4a548b5f6191b48631fa: Bootstrap complete.
I20260808 04:42:52.415841 2391 ts_tablet_manager.cc:1397] T 79486a5e7c2d41948f57c4f75194e927 P af3c61c3d0ee4a548b5f6191b48631fa: Time spent bootstrapping tablet: real 0.015s user 0.013s sys 0.000s
I20260808 04:42:52.418646 2391 raft_consensus.cc:348] T 79486a5e7c2d41948f57c4f75194e927 P af3c61c3d0ee4a548b5f6191b48631fa [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09cf4fd35d284cf5b343ebbaff9e835d" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37909 } } peers { permanent_uuid: "af3c61c3d0ee4a548b5f6191b48631fa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41967 } } peers { permanent_uuid: "8272dbbed81f4156be5d5b45f2f7176c" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40099 } }
I20260808 04:42:52.419104 2391 raft_consensus.cc:729] T 79486a5e7c2d41948f57c4f75194e927 P af3c61c3d0ee4a548b5f6191b48631fa [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3c61c3d0ee4a548b5f6191b48631fa, State: Initialized, Role: FOLLOWER
I20260808 04:42:52.419658 2391 consensus_queue.cc:260] T 79486a5e7c2d41948f57c4f75194e927 P af3c61c3d0ee4a548b5f6191b48631fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09cf4fd35d284cf5b343ebbaff9e835d" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37909 } } peers { permanent_uuid: "af3c61c3d0ee4a548b5f6191b48631fa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41967 } } peers { permanent_uuid: "8272dbbed81f4156be5d5b45f2f7176c" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40099 } }
I20260808 04:42:52.420627 2391 ts_tablet_manager.cc:1428] T 79486a5e7c2d41948f57c4f75194e927 P af3c61c3d0ee4a548b5f6191b48631fa: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
Aug 08 04:42:52 dist-test-slave-t7g5 krb5kdc[1146](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164172, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:42:52.425987 2340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:52.412905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:52249 (local address 127.12.148.126:40051)
0808 04:42:52.413055 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:52.413059 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:52.413728 (+ 669us) server_negotiation.cc:407] Connection header received
0808 04:42:52.414927 (+ 1199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:52.414931 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:52.414991 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:52.415083 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:52.416612 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:52.417151 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:52.418748 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:52.419102 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:52.419203 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:52.422456 (+ 3253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:52.422460 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:52.422463 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:52.422495 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:52.423977 (+ 1482us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:52.424455 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:52.424459 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:52.424461 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:52.424558 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:52.424863 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:52.424866 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:52.424868 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:52.425094 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:52.425194 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:52.425647 (+ 453us) server_negotiation.cc:299] Negotiation successful
0808 04:42:52.425822 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 04:42:52.426669 2566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:52.413071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.66:52249)
0808 04:42:52.413543 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:52.413600 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:52.414680 (+ 1080us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:52.415321 (+ 641us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:52.415331 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:52.415798 (+ 467us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:42:52.416440 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:52.416459 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:52.417292 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:52.417296 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:52.418609 (+ 1313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:52.418620 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:52.419358 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:52.419362 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:52.419623 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:52.420631 (+ 1008us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:42:52.420652 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:42:52.422285 (+ 1633us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:42:52.424086 (+ 1801us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:52.424091 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:52.424102 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:52.424346 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:52.424641 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:52.424642 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:52.424644 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:52.424768 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:52.425189 (+ 421us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:42:52.425193 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:42:52.425405 (+ 212us) client_negotiation.cc:769] Sending connection context
0808 04:42:52.425552 (+ 147us) client_negotiation.cc:240] Negotiation successful
0808 04:42:52.425828 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":117,"threads_started":1}
I20260808 04:42:52.427759 2562 heartbeater.cc:347] Connected to a master server at 127.12.148.126:40051
I20260808 04:42:52.427980 2562 heartbeater.cc:464] Registering TS with master...
I20260808 04:42:52.428421 2562 heartbeater.cc:511] Master 127.12.148.126:40051 requested a full tablet report, sending...
I20260808 04:42:52.430018 2045 ts_manager.cc:194] Registered new tserver with Master: af3c61c3d0ee4a548b5f6191b48631fa (127.12.148.66:41967)
I20260808 04:42:52.431191 2045 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.66@KRBTEST.COM'} at 127.12.148.66:52249
I20260808 04:42:52.433295 2562 heartbeater.cc:503] Master 127.12.148.126:40051 was elected leader, sending a full tablet report...
Aug 08 04:42:52 dist-test-slave-t7g5 krb5kdc[1146](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164171, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for kudu/127.12.148.66@KRBTEST.COM
I20260808 04:42:52.439797 2345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:52.430910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:41967 (local address 127.0.0.1:38478)
0808 04:42:52.431019 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:52.431033 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:52.431107 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:52.431694 (+ 587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:52.431697 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:52.431873 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:42:52.431978 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:52.431984 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:52.433271 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:52.433275 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:52.434164 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:52.434176 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:52.434724 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:52.434728 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:52.434820 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:52.435283 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:42:52.435295 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:42:52.436526 (+ 1231us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:42:52.438256 (+ 1730us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:52.438259 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:52.438261 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:52.438449 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:52.438719 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:52.438722 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:52.438724 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:52.438804 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:52.439228 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:42:52.439231 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:42:52.439325 (+ 94us) client_negotiation.cc:769] Sending connection context
0808 04:42:52.439413 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 04:42:52.439633 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260808 04:42:52.439817 2569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:52.431018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38478 (local address 127.12.148.66:41967)
0808 04:42:52.431274 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:52.431285 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:52.431307 (+ 22us) server_negotiation.cc:407] Connection header received
0808 04:42:52.431366 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:52.431370 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:52.431568 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:52.431699 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:52.432099 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:52.433148 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:52.434271 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:52.434613 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:52.434708 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:52.436655 (+ 1947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:52.436666 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:52.436678 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:52.436698 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:52.438150 (+ 1452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:52.438550 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:52.438555 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:52.438556 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:52.438633 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:52.438883 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:52.438887 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:52.438888 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:52.439124 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:52.439248 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:52.439514 (+ 266us) server_negotiation.cc:299] Negotiation successful
0808 04:42:52.439667 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":84,"threads_started":1}
I20260808 04:42:52.440809 2453 tablet_service.cc:1514] Processing DeleteTablet for tablet 79486a5e7c2d41948f57c4f75194e927 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:42:51 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:38478
I20260808 04:42:52.441843 2570 tablet_replica.cc:330] stopping tablet replica
I20260808 04:42:52.442129 2570 raft_consensus.cc:2229] T 79486a5e7c2d41948f57c4f75194e927 P af3c61c3d0ee4a548b5f6191b48631fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:42:52.442361 2570 raft_consensus.cc:2258] T 79486a5e7c2d41948f57c4f75194e927 P af3c61c3d0ee4a548b5f6191b48631fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:42:52.443271 2570 ts_tablet_manager.cc:1905] T 79486a5e7c2d41948f57c4f75194e927 P af3c61c3d0ee4a548b5f6191b48631fa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:42:52.446741 2570 ts_tablet_manager.cc:1918] T 79486a5e7c2d41948f57c4f75194e927 P af3c61c3d0ee4a548b5f6191b48631fa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:42:52.446831 2570 log.cc:1196] T 79486a5e7c2d41948f57c4f75194e927 P af3c61c3d0ee4a548b5f6191b48631fa: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/wal/wals/79486a5e7c2d41948f57c4f75194e927
I20260808 04:42:52.447069 2570 ts_tablet_manager.cc:1939] T 79486a5e7c2d41948f57c4f75194e927 P af3c61c3d0ee4a548b5f6191b48631fa: Deleting consensus metadata
I20260808 04:42:52.448449 2020 catalog_manager.cc:4841] TS af3c61c3d0ee4a548b5f6191b48631fa (127.12.148.66:41967): tablet 79486a5e7c2d41948f57c4f75194e927 (table test-table [id=be482dc5760f48d591caee365235d2b5]) successfully deleted
W20260808 04:42:52.528916 2567 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:42:52.529178 2567 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:42:52.529229 2567 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:42:52.533226 2567 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:42:52.533289 2567 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:42:52.533356 2567 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.67
I20260808 04:42:52.538601 2567 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:42437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.67:37909
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.148.67
--webserver_port=37183
--tserver_master_addrs=127.12.148.126:40051
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2567
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.67
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:42:52.539620 2567 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:42:52.540607 2567 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:42:52.549889 2578 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:52.549882 2579 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:52.549882 2583 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:52.550426 2567 server_base.cc:1034] running on GCE node
I20260808 04:42:52.550803 2567 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:42:52.551537 2567 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:42:52.552695 2567 hybrid_clock.cc:648] HybridClock initialized: now 1786164172552666 us; error 37 us; skew 500 ppm
Aug 08 04:42:52 dist-test-slave-t7g5 krb5kdc[1146](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164172, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:42:52.555281 2567 init.cc:377] Logged in from keytab as kudu/127.12.148.67@KRBTEST.COM (short username kudu)
I20260808 04:42:52.556113 2567 webserver.cc:460] Webserver started at http://127.12.148.67:37183/ using document root <none> and password file <none>
I20260808 04:42:52.556649 2567 fs_manager.cc:359] Metadata directory not provided
I20260808 04:42:52.556733 2567 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:42:52.560556 2567 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:42:52.562595 2596 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:52.563787 2567 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:42:52.563897 2567 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/wal
uuid: "09cf4fd35d284cf5b343ebbaff9e835d"
format_stamp: "Formatted at 2026-08-08 04:42:51 on dist-test-slave-t7g5"
server_key: "c02661ca0f2e509b4d28c3e4660edbd6"
server_key_iv: "6eebedbe29c5452471e52e555483ac78"
server_key_version: "encryptionkey@0"
I20260808 04:42:52.564426 2567 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:42:52.584164 2567 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:42:52.587435 2567 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:42:52.587632 2567 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:42:52.588231 2567 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:42:52.589071 2567 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:42:52.589121 2567 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:52.589174 2567 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:42:52.589200 2567 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:52.597525 2567 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.67:37909
I20260808 04:42:52.597554 2778 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.67:37909 every 8 connection(s)
I20260808 04:42:52.598510 2567 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
I20260808 04:42:52.601886 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 2567
Aug 08 04:42:52 dist-test-slave-t7g5 krb5kdc[1146](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164172, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:42:52.610324 2787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:52.602552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46136 (local address 127.12.148.126:40051)
0808 04:42:52.603085 (+ 533us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:52.603089 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:52.603098 (+ 9us) server_negotiation.cc:407] Connection header received
0808 04:42:52.603132 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:52.603134 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:52.603167 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:52.603241 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:52.603992 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:52.604573 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:52.605402 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:52.605625 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:52.605740 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:52.607124 (+ 1384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:52.607127 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:52.607129 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:52.607153 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:52.608488 (+ 1335us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:52.608928 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:52.608932 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:52.608934 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:52.609036 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:52.609353 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:52.609356 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:52.609357 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:52.609592 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:52.609768 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:52.610016 (+ 248us) server_negotiation.cc:299] Negotiation successful
0808 04:42:52.610144 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":32,"server-negotiator.queue_time_us":473,"thread_start_us":90,"threads_started":1}
I20260808 04:42:52.611996 2340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:52.600208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:32963 (local address 127.12.148.126:40051)
0808 04:42:52.600348 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:52.600352 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:52.601153 (+ 801us) server_negotiation.cc:407] Connection header received
0808 04:42:52.602732 (+ 1579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:52.602735 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:52.602780 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:52.602821 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:52.604112 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:52.604641 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:52.605754 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:52.605962 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:52.606047 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:52.608414 (+ 2367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:52.608417 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:52.608419 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:52.608452 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:52.609895 (+ 1443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:52.610470 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:52.610474 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:52.610476 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:52.610561 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:52.610934 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:52.610937 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:52.610938 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:52.611143 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:52.611242 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:52.611711 (+ 469us) server_negotiation.cc:299] Negotiation successful
0808 04:42:52.611821 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":47}
I20260808 04:42:52.612748 2782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:52.600571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.67:32963)
0808 04:42:52.601016 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:52.601057 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:52.602489 (+ 1432us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:52.603160 (+ 671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:52.603167 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:52.603505 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:42:52.603973 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:52.603987 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:52.604756 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:52.604759 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:52.605623 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:52.605634 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:52.606096 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:52.606100 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:52.606254 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:52.606727 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:42:52.606742 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:42:52.608259 (+ 1517us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:42:52.610010 (+ 1751us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:52.610016 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:52.610032 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:52.610350 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:52.610663 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:52.610666 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:52.610667 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:52.610829 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:52.611249 (+ 420us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:42:52.611254 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:42:52.611484 (+ 230us) client_negotiation.cc:769] Sending connection context
0808 04:42:52.611649 (+ 165us) client_negotiation.cc:240] Negotiation successful
0808 04:42:52.611984 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":117,"threads_started":1}
I20260808 04:42:52.613736 2780 heartbeater.cc:347] Connected to a master server at 127.12.148.126:40051
I20260808 04:42:52.613950 2780 heartbeater.cc:464] Registering TS with master...
I20260808 04:42:52.614367 2780 heartbeater.cc:511] Master 127.12.148.126:40051 requested a full tablet report, sending...
I20260808 04:42:52.615265 2045 ts_manager.cc:194] Registered new tserver with Master: 09cf4fd35d284cf5b343ebbaff9e835d (127.12.148.67:37909)
I20260808 04:42:52.615798 2045 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.67@KRBTEST.COM'} at 127.12.148.67:32963
I20260808 04:42:52.623505 12881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 04:42:52.627672 2340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:52.624058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46140 (local address 127.12.148.126:40051)
0808 04:42:52.624187 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:52.624191 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:52.624364 (+ 173us) server_negotiation.cc:407] Connection header received
0808 04:42:52.624517 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:52.624520 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:52.624616 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:52.624704 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:42:52.624938 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:52.625428 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:52.626310 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:52.626538 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:52.626622 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:52.626936 (+ 314us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:42:52.627322 (+ 386us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:42:52.627438 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:52.627489 (+ 51us) server_negotiation.cc:299] Negotiation successful
0808 04:42:52.627539 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 04:42:52.628358 2045 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:46140:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:42:52.631678 2045 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:42:52.639258 2229 tablet_service.cc:1467] Processing CreateTablet for tablet 8002a577b3344a2c9742b819fa4e27a6 (DEFAULT_TABLE table=test-table [id=be02f5534f0c4cdfbd6c496450c3acc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:42:52.639279 2453 tablet_service.cc:1467] Processing CreateTablet for tablet 8002a577b3344a2c9742b819fa4e27a6 (DEFAULT_TABLE table=test-table [id=be02f5534f0c4cdfbd6c496450c3acc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:42:52.639895 2453 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8002a577b3344a2c9742b819fa4e27a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:42:52.639897 2229 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8002a577b3344a2c9742b819fa4e27a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:42:52.642571 2391 tablet_bootstrap.cc:492] T 8002a577b3344a2c9742b819fa4e27a6 P af3c61c3d0ee4a548b5f6191b48631fa: Bootstrap starting.
I20260808 04:42:52.642571 2169 tablet_bootstrap.cc:492] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c: Bootstrap starting.
I20260808 04:42:52.643411 2169 tablet_bootstrap.cc:654] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c: Neither blocks nor log segments found. Creating new log.
I20260808 04:42:52.643450 2391 tablet_bootstrap.cc:654] T 8002a577b3344a2c9742b819fa4e27a6 P af3c61c3d0ee4a548b5f6191b48631fa: Neither blocks nor log segments found. Creating new log.
I20260808 04:42:52.644615 2345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:52.638470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.67:37909 (local address 127.0.0.1:42870)
0808 04:42:52.638643 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:52.638658 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:52.638746 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:52.639657 (+ 911us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:52.639661 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:52.639688 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:42:52.639794 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:52.639801 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:52.641724 (+ 1923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:52.641728 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:52.642853 (+ 1125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:52.642865 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:52.644203 (+ 1338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:52.644207 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:52.644291 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:52.644347 (+ 56us) client_negotiation.cc:769] Sending connection context
0808 04:42:52.644403 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 04:42:52.644485 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101}
I20260808 04:42:52.644932 2169 tablet_bootstrap.cc:492] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c: No bootstrap required, opened a new log
I20260808 04:42:52.644932 2391 tablet_bootstrap.cc:492] T 8002a577b3344a2c9742b819fa4e27a6 P af3c61c3d0ee4a548b5f6191b48631fa: No bootstrap required, opened a new log
I20260808 04:42:52.645022 2169 ts_tablet_manager.cc:1397] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 04:42:52.645021 2391 ts_tablet_manager.cc:1397] T 8002a577b3344a2c9742b819fa4e27a6 P af3c61c3d0ee4a548b5f6191b48631fa: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 04:42:52.645236 2796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:52.638667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42870 (local address 127.12.148.67:37909)
0808 04:42:52.639073 (+ 406us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:52.639086 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:52.639110 (+ 24us) server_negotiation.cc:407] Connection header received
0808 04:42:52.639186 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:52.639191 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:52.639429 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:52.639666 (+ 237us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:42:52.639918 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:52.641569 (+ 1651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:52.642993 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:52.644078 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:52.644808 (+ 730us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:52.644968 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:52.645024 (+ 56us) server_negotiation.cc:299] Negotiation successful
0808 04:42:52.645119 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":201,"threads_started":1}
I20260808 04:42:52.645452 2169 raft_consensus.cc:348] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09cf4fd35d284cf5b343ebbaff9e835d" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37909 } } peers { permanent_uuid: "8272dbbed81f4156be5d5b45f2f7176c" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40099 } } peers { permanent_uuid: "af3c61c3d0ee4a548b5f6191b48631fa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41967 } }
I20260808 04:42:52.645442 2391 raft_consensus.cc:348] T 8002a577b3344a2c9742b819fa4e27a6 P af3c61c3d0ee4a548b5f6191b48631fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09cf4fd35d284cf5b343ebbaff9e835d" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37909 } } peers { permanent_uuid: "8272dbbed81f4156be5d5b45f2f7176c" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40099 } } peers { permanent_uuid: "af3c61c3d0ee4a548b5f6191b48631fa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41967 } }
I20260808 04:42:52.645560 2169 raft_consensus.cc:374] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:42:52.645560 2391 raft_consensus.cc:374] T 8002a577b3344a2c9742b819fa4e27a6 P af3c61c3d0ee4a548b5f6191b48631fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:42:52.645606 2391 raft_consensus.cc:729] T 8002a577b3344a2c9742b819fa4e27a6 P af3c61c3d0ee4a548b5f6191b48631fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3c61c3d0ee4a548b5f6191b48631fa, State: Initialized, Role: FOLLOWER
I20260808 04:42:52.645606 2169 raft_consensus.cc:729] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8272dbbed81f4156be5d5b45f2f7176c, State: Initialized, Role: FOLLOWER
I20260808 04:42:52.645754 2391 consensus_queue.cc:260] T 8002a577b3344a2c9742b819fa4e27a6 P af3c61c3d0ee4a548b5f6191b48631fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09cf4fd35d284cf5b343ebbaff9e835d" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37909 } } peers { permanent_uuid: "8272dbbed81f4156be5d5b45f2f7176c" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40099 } } peers { permanent_uuid: "af3c61c3d0ee4a548b5f6191b48631fa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41967 } }
I20260808 04:42:52.645774 2169 consensus_queue.cc:260] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09cf4fd35d284cf5b343ebbaff9e835d" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37909 } } peers { permanent_uuid: "8272dbbed81f4156be5d5b45f2f7176c" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40099 } } peers { permanent_uuid: "af3c61c3d0ee4a548b5f6191b48631fa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41967 } }
I20260808 04:42:52.646039 2391 ts_tablet_manager.cc:1428] T 8002a577b3344a2c9742b819fa4e27a6 P af3c61c3d0ee4a548b5f6191b48631fa: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 04:42:52.646090 2169 ts_tablet_manager.cc:1428] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 04:42:52.648310 2670 tablet_service.cc:1467] Processing CreateTablet for tablet 8002a577b3344a2c9742b819fa4e27a6 (DEFAULT_TABLE table=test-table [id=be02f5534f0c4cdfbd6c496450c3acc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:42:52.649492 2670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8002a577b3344a2c9742b819fa4e27a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:42:52.656180 2799 tablet_bootstrap.cc:492] T 8002a577b3344a2c9742b819fa4e27a6 P 09cf4fd35d284cf5b343ebbaff9e835d: Bootstrap starting.
I20260808 04:42:52.658165 2799 tablet_bootstrap.cc:654] T 8002a577b3344a2c9742b819fa4e27a6 P 09cf4fd35d284cf5b343ebbaff9e835d: Neither blocks nor log segments found. Creating new log.
I20260808 04:42:52.659246 2799 log.cc:824] T 8002a577b3344a2c9742b819fa4e27a6 P 09cf4fd35d284cf5b343ebbaff9e835d: Log is configured to *not* fsync() on all Append() calls
I20260808 04:42:52.661214 2799 tablet_bootstrap.cc:492] T 8002a577b3344a2c9742b819fa4e27a6 P 09cf4fd35d284cf5b343ebbaff9e835d: No bootstrap required, opened a new log
I20260808 04:42:52.661408 2799 ts_tablet_manager.cc:1397] T 8002a577b3344a2c9742b819fa4e27a6 P 09cf4fd35d284cf5b343ebbaff9e835d: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
W20260808 04:42:52.661828 2563 tablet.cc:2369] T 8002a577b3344a2c9742b819fa4e27a6 P af3c61c3d0ee4a548b5f6191b48631fa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:42:52.664278 2799 raft_consensus.cc:348] T 8002a577b3344a2c9742b819fa4e27a6 P 09cf4fd35d284cf5b343ebbaff9e835d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09cf4fd35d284cf5b343ebbaff9e835d" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37909 } } peers { permanent_uuid: "8272dbbed81f4156be5d5b45f2f7176c" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40099 } } peers { permanent_uuid: "af3c61c3d0ee4a548b5f6191b48631fa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41967 } }
I20260808 04:42:52.664507 2799 raft_consensus.cc:374] T 8002a577b3344a2c9742b819fa4e27a6 P 09cf4fd35d284cf5b343ebbaff9e835d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:42:52.664563 2799 raft_consensus.cc:729] T 8002a577b3344a2c9742b819fa4e27a6 P 09cf4fd35d284cf5b343ebbaff9e835d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09cf4fd35d284cf5b343ebbaff9e835d, State: Initialized, Role: FOLLOWER
I20260808 04:42:52.664956 2799 consensus_queue.cc:260] T 8002a577b3344a2c9742b819fa4e27a6 P 09cf4fd35d284cf5b343ebbaff9e835d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09cf4fd35d284cf5b343ebbaff9e835d" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37909 } } peers { permanent_uuid: "8272dbbed81f4156be5d5b45f2f7176c" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40099 } } peers { permanent_uuid: "af3c61c3d0ee4a548b5f6191b48631fa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41967 } }
I20260808 04:42:52.665558 2780 heartbeater.cc:503] Master 127.12.148.126:40051 was elected leader, sending a full tablet report...
I20260808 04:42:52.665915 2799 ts_tablet_manager.cc:1428] T 8002a577b3344a2c9742b819fa4e27a6 P 09cf4fd35d284cf5b343ebbaff9e835d: Time spent starting tablet: real 0.004s user 0.006s sys 0.000s
I20260808 04:42:52.684266 2344 raft_consensus.cc:482] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:42:52.684461 2344 raft_consensus.cc:504] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09cf4fd35d284cf5b343ebbaff9e835d" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37909 } } peers { permanent_uuid: "8272dbbed81f4156be5d5b45f2f7176c" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40099 } } peers { permanent_uuid: "af3c61c3d0ee4a548b5f6191b48631fa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41967 } }
I20260808 04:42:52.685472 2344 leader_election.cc:288] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09cf4fd35d284cf5b343ebbaff9e835d (127.12.148.67:37909), af3c61c3d0ee4a548b5f6191b48631fa (127.12.148.66:41967)
I20260808 04:42:52.690289 2796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:52.686191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:39769 (local address 127.12.148.67:37909)
0808 04:42:52.686293 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:52.686297 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:52.686311 (+ 14us) server_negotiation.cc:407] Connection header received
0808 04:42:52.686367 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:52.686369 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:52.686412 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:52.686482 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:42:52.686794 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:52.687516 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:52.689057 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:52.689643 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:52.689784 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:52.689842 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:52.690092 (+ 250us) server_negotiation.cc:299] Negotiation successful
0808 04:42:52.690162 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 04:42:52.690308 2569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:52.685818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:56299 (local address 127.12.148.66:41967)
0808 04:42:52.685952 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:52.685957 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:52.686180 (+ 223us) server_negotiation.cc:407] Connection header received
0808 04:42:52.686391 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:52.686394 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:52.686454 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:52.686545 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:42:52.686995 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:52.687735 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:52.689087 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:52.689757 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:52.689856 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:52.689974 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:52.690091 (+ 117us) server_negotiation.cc:299] Negotiation successful
0808 04:42:52.690163 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 04:42:52.690305 2335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:52.685690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.67:37909 (local address 127.12.148.65:39769)
0808 04:42:52.685833 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:52.685848 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:52.685959 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:52.686520 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:52.686524 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:52.686543 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:42:52.686665 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:52.686671 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:52.687636 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:52.687639 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:52.688929 (+ 1290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:52.688940 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:52.689782 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:52.689785 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:52.689914 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:52.689989 (+ 75us) client_negotiation.cc:769] Sending connection context
0808 04:42:52.690067 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 04:42:52.690150 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67,"mutex_wait_us":37}
I20260808 04:42:52.690315 2804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:52.685741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:41967 (local address 127.12.148.65:56299)
0808 04:42:52.686100 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:52.686113 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:52.686249 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:52.686735 (+ 486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:52.686738 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:52.686757 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:42:52.686878 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:52.686883 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:52.687832 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:52.687835 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:52.688989 (+ 1154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:52.688997 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:52.689867 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:52.689871 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:52.689955 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:52.690005 (+ 50us) client_negotiation.cc:769] Sending connection context
0808 04:42:52.690067 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 04:42:52.690150 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"mutex_wait_us":51,"thread_start_us":96,"threads_started":1}
I20260808 04:42:52.690901 2703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8002a577b3344a2c9742b819fa4e27a6" candidate_uuid: "8272dbbed81f4156be5d5b45f2f7176c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09cf4fd35d284cf5b343ebbaff9e835d" is_pre_election: true
I20260808 04:42:52.691092 2485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8002a577b3344a2c9742b819fa4e27a6" candidate_uuid: "8272dbbed81f4156be5d5b45f2f7176c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3c61c3d0ee4a548b5f6191b48631fa" is_pre_election: true
I20260808 04:42:52.691190 2703 raft_consensus.cc:2454] T 8002a577b3344a2c9742b819fa4e27a6 P 09cf4fd35d284cf5b343ebbaff9e835d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8272dbbed81f4156be5d5b45f2f7176c in term 0.
I20260808 04:42:52.691363 2485 raft_consensus.cc:2454] T 8002a577b3344a2c9742b819fa4e27a6 P af3c61c3d0ee4a548b5f6191b48631fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8272dbbed81f4156be5d5b45f2f7176c in term 0.
I20260808 04:42:52.691619 2165 leader_election.cc:302] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09cf4fd35d284cf5b343ebbaff9e835d, 8272dbbed81f4156be5d5b45f2f7176c; no voters:
I20260808 04:42:52.691874 2344 raft_consensus.cc:2781] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:42:52.691975 2344 raft_consensus.cc:482] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:42:52.692031 2344 raft_consensus.cc:3037] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:42:52.693060 2344 raft_consensus.cc:504] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09cf4fd35d284cf5b343ebbaff9e835d" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37909 } } peers { permanent_uuid: "8272dbbed81f4156be5d5b45f2f7176c" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40099 } } peers { permanent_uuid: "af3c61c3d0ee4a548b5f6191b48631fa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41967 } }
I20260808 04:42:52.693401 2344 leader_election.cc:288] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [CANDIDATE]: Term 1 election: Requested vote from peers 09cf4fd35d284cf5b343ebbaff9e835d (127.12.148.67:37909), af3c61c3d0ee4a548b5f6191b48631fa (127.12.148.66:41967)
I20260808 04:42:52.693764 2485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8002a577b3344a2c9742b819fa4e27a6" candidate_uuid: "8272dbbed81f4156be5d5b45f2f7176c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af3c61c3d0ee4a548b5f6191b48631fa"
I20260808 04:42:52.693791 2703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8002a577b3344a2c9742b819fa4e27a6" candidate_uuid: "8272dbbed81f4156be5d5b45f2f7176c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09cf4fd35d284cf5b343ebbaff9e835d"
I20260808 04:42:52.693892 2485 raft_consensus.cc:3037] T 8002a577b3344a2c9742b819fa4e27a6 P af3c61c3d0ee4a548b5f6191b48631fa [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:42:52.693895 2703 raft_consensus.cc:3037] T 8002a577b3344a2c9742b819fa4e27a6 P 09cf4fd35d284cf5b343ebbaff9e835d [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:42:52.694885 2703 raft_consensus.cc:2454] T 8002a577b3344a2c9742b819fa4e27a6 P 09cf4fd35d284cf5b343ebbaff9e835d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8272dbbed81f4156be5d5b45f2f7176c in term 1.
I20260808 04:42:52.694909 2485 raft_consensus.cc:2454] T 8002a577b3344a2c9742b819fa4e27a6 P af3c61c3d0ee4a548b5f6191b48631fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8272dbbed81f4156be5d5b45f2f7176c in term 1.
I20260808 04:42:52.695151 2165 leader_election.cc:302] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09cf4fd35d284cf5b343ebbaff9e835d, 8272dbbed81f4156be5d5b45f2f7176c; no voters:
I20260808 04:42:52.695326 2344 raft_consensus.cc:2781] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:42:52.695581 2344 raft_consensus.cc:686] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [term 1 LEADER]: Becoming Leader. State: Replica: 8272dbbed81f4156be5d5b45f2f7176c, State: Running, Role: LEADER
I20260808 04:42:52.695829 2344 consensus_queue.cc:237] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09cf4fd35d284cf5b343ebbaff9e835d" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37909 } } peers { permanent_uuid: "8272dbbed81f4156be5d5b45f2f7176c" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40099 } } peers { permanent_uuid: "af3c61c3d0ee4a548b5f6191b48631fa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41967 } }
I20260808 04:42:52.698963 2045 catalog_manager.cc:5495] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c reported cstate change: term changed from 0 to 1, leader changed from <none> to 8272dbbed81f4156be5d5b45f2f7176c (127.12.148.65). New cstate: current_term: 1 leader_uuid: "8272dbbed81f4156be5d5b45f2f7176c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09cf4fd35d284cf5b343ebbaff9e835d" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8272dbbed81f4156be5d5b45f2f7176c" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af3c61c3d0ee4a548b5f6191b48631fa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41967 } health_report { overall_health: UNKNOWN } } }
W20260808 04:42:52.711772 2334 tablet.cc:2369] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:42:52.722507 2348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:52.719538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42304 (local address 127.12.148.65:40099)
0808 04:42:52.719655 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:52.719659 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:52.719671 (+ 12us) server_negotiation.cc:407] Connection header received
0808 04:42:52.719739 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:52.719741 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:52.719791 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:52.719884 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:42:52.720064 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:52.720571 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:52.721300 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:52.721517 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:52.721584 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:52.721798 (+ 214us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:42:52.722222 (+ 424us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:42:52.722304 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:52.722347 (+ 43us) server_negotiation.cc:299] Negotiation successful
0808 04:42:52.722397 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 04:42:52.726306 2485 raft_consensus.cc:1261] T 8002a577b3344a2c9742b819fa4e27a6 P af3c61c3d0ee4a548b5f6191b48631fa [term 1 FOLLOWER]: Refusing update from remote peer 8272dbbed81f4156be5d5b45f2f7176c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:42:52.726312 2703 raft_consensus.cc:1261] T 8002a577b3344a2c9742b819fa4e27a6 P 09cf4fd35d284cf5b343ebbaff9e835d [term 1 FOLLOWER]: Refusing update from remote peer 8272dbbed81f4156be5d5b45f2f7176c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:42:52.726979 2344 consensus_queue.cc:1035] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [LEADER]: Connected to new peer: Peer: permanent_uuid: "af3c61c3d0ee4a548b5f6191b48631fa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:42:52.727174 2805 consensus_queue.cc:1035] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [LEADER]: Connected to new peer: Peer: permanent_uuid: "09cf4fd35d284cf5b343ebbaff9e835d" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:42:52.741070 2045 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:46140:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:42:52.741226 2045 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:46140:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:42:52.743498 2045 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149: Sending DeleteTablet for 3 replicas of tablet 8002a577b3344a2c9742b819fa4e27a6
I20260808 04:42:52.744120 2670 tablet_service.cc:1514] Processing DeleteTablet for tablet 8002a577b3344a2c9742b819fa4e27a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:42:52 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:42870
I20260808 04:42:52.744206 2453 tablet_service.cc:1514] Processing DeleteTablet for tablet 8002a577b3344a2c9742b819fa4e27a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:42:52 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:38478
I20260808 04:42:52.744248 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 2109
I20260808 04:42:52.744385 2570 tablet_replica.cc:330] T 8002a577b3344a2c9742b819fa4e27a6 P af3c61c3d0ee4a548b5f6191b48631fa: stopping tablet replica
I20260808 04:42:52.744481 2570 raft_consensus.cc:2229] T 8002a577b3344a2c9742b819fa4e27a6 P af3c61c3d0ee4a548b5f6191b48631fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:42:52.744594 2570 raft_consensus.cc:2258] T 8002a577b3344a2c9742b819fa4e27a6 P af3c61c3d0ee4a548b5f6191b48631fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:42:52.752202 2824 tablet_replica.cc:330] T 8002a577b3344a2c9742b819fa4e27a6 P 09cf4fd35d284cf5b343ebbaff9e835d: stopping tablet replica
I20260808 04:42:52.752516 2824 raft_consensus.cc:2229] T 8002a577b3344a2c9742b819fa4e27a6 P 09cf4fd35d284cf5b343ebbaff9e835d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:42:52.752839 2824 raft_consensus.cc:2258] T 8002a577b3344a2c9742b819fa4e27a6 P 09cf4fd35d284cf5b343ebbaff9e835d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:42:52.755221 2824 ts_tablet_manager.cc:1905] T 8002a577b3344a2c9742b819fa4e27a6 P 09cf4fd35d284cf5b343ebbaff9e835d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:42:52.755940 2570 ts_tablet_manager.cc:1905] T 8002a577b3344a2c9742b819fa4e27a6 P af3c61c3d0ee4a548b5f6191b48631fa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:42:52.757865 2824 ts_tablet_manager.cc:1918] T 8002a577b3344a2c9742b819fa4e27a6 P 09cf4fd35d284cf5b343ebbaff9e835d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:42:52.757977 2824 log.cc:1196] T 8002a577b3344a2c9742b819fa4e27a6 P 09cf4fd35d284cf5b343ebbaff9e835d: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/wal/wals/8002a577b3344a2c9742b819fa4e27a6
I20260808 04:42:52.758265 2824 ts_tablet_manager.cc:1939] T 8002a577b3344a2c9742b819fa4e27a6 P 09cf4fd35d284cf5b343ebbaff9e835d: Deleting consensus metadata
I20260808 04:42:52.758273 2570 ts_tablet_manager.cc:1918] T 8002a577b3344a2c9742b819fa4e27a6 P af3c61c3d0ee4a548b5f6191b48631fa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:42:52.758345 2570 log.cc:1196] T 8002a577b3344a2c9742b819fa4e27a6 P af3c61c3d0ee4a548b5f6191b48631fa: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/wal/wals/8002a577b3344a2c9742b819fa4e27a6
I20260808 04:42:52.758595 2570 ts_tablet_manager.cc:1939] T 8002a577b3344a2c9742b819fa4e27a6 P af3c61c3d0ee4a548b5f6191b48631fa: Deleting consensus metadata
I20260808 04:42:52.759362 2020 catalog_manager.cc:4841] TS af3c61c3d0ee4a548b5f6191b48631fa (127.12.148.66:41967): tablet 8002a577b3344a2c9742b819fa4e27a6 (table test-table [id=be02f5534f0c4cdfbd6c496450c3acc3]) successfully deleted
I20260808 04:42:52.759397 2023 catalog_manager.cc:4841] TS 09cf4fd35d284cf5b343ebbaff9e835d (127.12.148.67:37909): tablet 8002a577b3344a2c9742b819fa4e27a6 (table test-table [id=be02f5534f0c4cdfbd6c496450c3acc3]) successfully deleted
W20260808 04:42:52.762625 2020 connection.cc:535] client connection to 127.12.148.65:40099 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 04:42:52.762768 2020 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 04:42:52.763048 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 2342
I20260808 04:42:52.768455 2345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:52.768128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:40099 (local address 127.0.0.1:42310)
0808 04:42:52.768298 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:52.768369 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.65:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
W20260808 04:42:52.768610 2020 catalog_manager.cc:4584] TS 8272dbbed81f4156be5d5b45f2f7176c (127.12.148.65:40099): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8002a577b3344a2c9742b819fa4e27a6: Network error: Client connection negotiation failed: client connection to 127.12.148.65:40099: connect: Connection refused (error 111)
I20260808 04:42:52.776374 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 2567
I20260808 04:42:52.788168 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 1997
I20260808 04:42:52.799467 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:40051
--webserver_interface=127.12.148.126
--webserver_port=46283
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:42437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:40051
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:42:52.910511 2826 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:42:52.910784 2826 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:42:52.910825 2826 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:42:52.914765 2826 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:42:52.914825 2826 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:42:52.914842 2826 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:42:52.914858 2826 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:42:52.914872 2826 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:42:52.920145 2826 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:42437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:40051
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:40051
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=46283
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2826
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:42:52.921245 2826 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:42:52.922345 2826 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:42:52.930714 2836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:52.930707 2838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:52.930881 2826 server_base.cc:1034] running on GCE node
W20260808 04:42:52.930707 2834 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:52.931685 2826 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:42:52.932770 2826 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:42:52.933923 2826 hybrid_clock.cc:648] HybridClock initialized: now 1786164172933905 us; error 34 us; skew 500 ppm
Aug 08 04:42:52 dist-test-slave-t7g5 krb5kdc[1146](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164172, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:42:52.936759 2826 init.cc:377] Logged in from keytab as kudu/127.12.148.126@KRBTEST.COM (short username kudu)
I20260808 04:42:52.937719 2826 webserver.cc:460] Webserver started at http://127.12.148.126:46283/ using document root <none> and password file <none>
I20260808 04:42:52.938263 2826 fs_manager.cc:359] Metadata directory not provided
I20260808 04:42:52.938330 2826 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:42:52.942188 2826 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 04:42:52.944348 2848 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:52.945545 2826 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:42:52.945686 2826 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "386964c13efd470cac8229df4cbf2149"
format_stamp: "Formatted at 2026-08-08 04:42:50 on dist-test-slave-t7g5"
server_key: "0198b62d4b3f216fc49557a330c455bd"
server_key_iv: "03512e1257eeaf1b40d10696619531f2"
server_key_version: "encryptionkey@0"
I20260808 04:42:52.946228 2826 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:42:52.972061 2826 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:42:52.975340 2826 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:42:52.975551 2826 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:42:52.982617 2826 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:40051
I20260808 04:42:52.982893 2936 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:40051 every 8 connection(s)
I20260808 04:42:52.983716 2826 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:42:52.986217 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 2826
I20260808 04:42:52.986619 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.65:40099
--local_ip_for_outbound_sockets=127.12.148.65
--tserver_master_addrs=127.12.148.126:40051
--webserver_port=35901
--webserver_interface=127.12.148.65
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:42437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 04:42:52.988106 2937 sys_catalog.cc:263] Verifying existing consensus state
I20260808 04:42:52.990231 2937 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149: Bootstrap starting.
I20260808 04:42:53.013489 2937 log.cc:824] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149: Log is configured to *not* fsync() on all Append() calls
I20260808 04:42:53.027938 2937 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 04:42:53.028399 2937 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149: Bootstrap complete.
I20260808 04:42:53.033897 2937 raft_consensus.cc:348] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "386964c13efd470cac8229df4cbf2149" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40051 } }
I20260808 04:42:53.034418 2937 raft_consensus.cc:729] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386964c13efd470cac8229df4cbf2149, State: Initialized, Role: FOLLOWER
I20260808 04:42:53.034981 2937 consensus_queue.cc:260] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "386964c13efd470cac8229df4cbf2149" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40051 } }
I20260808 04:42:53.035133 2937 raft_consensus.cc:388] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:42:53.035202 2937 raft_consensus.cc:482] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:42:53.035308 2937 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [term 2 FOLLOWER]: Advancing to term 3
I20260808 04:42:53.037856 2937 raft_consensus.cc:504] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "386964c13efd470cac8229df4cbf2149" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40051 } }
I20260808 04:42:53.038224 2937 leader_election.cc:302] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 386964c13efd470cac8229df4cbf2149; no voters:
I20260808 04:42:53.038614 2937 leader_election.cc:288] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 04:42:53.038724 2943 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 04:42:53.039017 2943 raft_consensus.cc:686] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [term 3 LEADER]: Becoming Leader. State: Replica: 386964c13efd470cac8229df4cbf2149, State: Running, Role: LEADER
I20260808 04:42:53.039340 2943 consensus_queue.cc:237] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "386964c13efd470cac8229df4cbf2149" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40051 } }
I20260808 04:42:53.039887 2937 sys_catalog.cc:564] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:42:53.040768 2944 sys_catalog.cc:455] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "386964c13efd470cac8229df4cbf2149" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "386964c13efd470cac8229df4cbf2149" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40051 } } }
I20260808 04:42:53.040905 2944 sys_catalog.cc:458] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [sys.catalog]: This master's current role is: LEADER
I20260808 04:42:53.040758 2945 sys_catalog.cc:455] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 386964c13efd470cac8229df4cbf2149. Latest consensus state: current_term: 3 leader_uuid: "386964c13efd470cac8229df4cbf2149" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "386964c13efd470cac8229df4cbf2149" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40051 } } }
I20260808 04:42:53.041028 2945 sys_catalog.cc:458] T 00000000000000000000000000000000 P 386964c13efd470cac8229df4cbf2149 [sys.catalog]: This master's current role is: LEADER
I20260808 04:42:53.041303 2954 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:42:53.046983 2954 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:42:53.047693 2954 catalog_manager.cc:1259] Loaded cluster ID: 53c249f496d74f6cba523ca82a4299c3
I20260808 04:42:53.047761 2954 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260808 04:42:53.048799 2954 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f78d6e6a9ad google::LogMessage::Fail() at ??:0
@ 0x7f78d6e6d88a google::LogMessage::SendToLog() at ??:0
@ 0x7f78d6e6a4de google::LogMessage::Flush() at ??:0
@ 0x7f78d6e6ba19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f78e17a9fdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f78e17aad2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f78e17a7579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f78e17eb640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f78d90bc3d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f78d90bcc83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f78d90be3f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f78d90ad512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f78da6f16db start_thread at ??:0
@ 0x7f78d596861f clone at ??:0
W20260808 04:42:53.140995 2940 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:42:53.141268 2940 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:42:53.141317 2940 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:42:53.145422 2940 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:42:53.145496 2940 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:42:53.145556 2940 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.65
I20260808 04:42:53.151065 2940 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:42437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.65:40099
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.148.65
--webserver_port=35901
--tserver_master_addrs=127.12.148.126:40051
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2940
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.65
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:42:53.152163 2940 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:42:53.153184 2940 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:42:53.162837 3006 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:53.163060 3010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:53.162837 3008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:53.163976 2940 server_base.cc:1034] running on GCE node
I20260808 04:42:53.164361 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:42:53.164989 2940 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:42:53.166157 2940 hybrid_clock.cc:648] HybridClock initialized: now 1786164173166131 us; error 45 us; skew 500 ppm
Aug 08 04:42:53 dist-test-slave-t7g5 krb5kdc[1146](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164173, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:42:53.169080 2940 init.cc:377] Logged in from keytab as kudu/127.12.148.65@KRBTEST.COM (short username kudu)
I20260808 04:42:53.170042 2940 webserver.cc:460] Webserver started at http://127.12.148.65:35901/ using document root <none> and password file <none>
I20260808 04:42:53.170593 2940 fs_manager.cc:359] Metadata directory not provided
I20260808 04:42:53.170662 2940 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:42:53.174763 2940 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 04:42:53.177120 3022 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:53.178580 2940 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 04:42:53.178707 2940 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/wal
uuid: "8272dbbed81f4156be5d5b45f2f7176c"
format_stamp: "Formatted at 2026-08-08 04:42:51 on dist-test-slave-t7g5"
server_key: "d13a69fd7480094b897be347d0b8b5fb"
server_key_iv: "6272215fbcaaf6197db421046bed3d84"
server_key_version: "encryptionkey@0"
I20260808 04:42:53.179293 2940 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:42:53.191532 2940 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:42:53.194751 2940 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:42:53.194937 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:42:53.195545 2940 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:42:53.196683 3032 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 04:42:53.202399 2940 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 04:42:53.202472 2940 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.000s
I20260808 04:42:53.202540 2940 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 04:42:53.204200 2940 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 04:42:53.204249 2940 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260808 04:42:53.204603 3032 tablet_bootstrap.cc:492] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c: Bootstrap starting.
I20260808 04:42:53.214201 2940 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.65:40099
I20260808 04:42:53.214443 3212 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.65:40099 every 8 connection(s)
I20260808 04:42:53.215205 2940 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
I20260808 04:42:53.216315 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 2940
I20260808 04:42:53.216832 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.66:41967
--local_ip_for_outbound_sockets=127.12.148.66
--tserver_master_addrs=127.12.148.126:40051
--webserver_port=42563
--webserver_interface=127.12.148.66
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:42437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 04:42:53.225586 3032 log.cc:824] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c: Log is configured to *not* fsync() on all Append() calls
I20260808 04:42:53.232506 3032 tablet_bootstrap.cc:492] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 04:42:53.232844 3032 tablet_bootstrap.cc:492] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c: Bootstrap complete.
I20260808 04:42:53.233865 3032 ts_tablet_manager.cc:1397] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c: Time spent bootstrapping tablet: real 0.030s user 0.025s sys 0.003s
I20260808 04:42:53.236253 3032 raft_consensus.cc:348] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09cf4fd35d284cf5b343ebbaff9e835d" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37909 } } peers { permanent_uuid: "8272dbbed81f4156be5d5b45f2f7176c" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40099 } } peers { permanent_uuid: "af3c61c3d0ee4a548b5f6191b48631fa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41967 } }
I20260808 04:42:53.236676 3032 raft_consensus.cc:729] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8272dbbed81f4156be5d5b45f2f7176c, State: Initialized, Role: FOLLOWER
I20260808 04:42:53.237149 3032 consensus_queue.cc:260] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09cf4fd35d284cf5b343ebbaff9e835d" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37909 } } peers { permanent_uuid: "8272dbbed81f4156be5d5b45f2f7176c" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40099 } } peers { permanent_uuid: "af3c61c3d0ee4a548b5f6191b48631fa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41967 } }
I20260808 04:42:53.238065 3032 ts_tablet_manager.cc:1428] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
W20260808 04:42:53.261371 3216 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:42:53.217301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.65:46223)
0808 04:42:53.218835 (+ 1534us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:53.218895 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:53.219963 (+ 1068us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:53.260425 (+ 40462us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":1270,"thread_start_us":153,"threads_started":1}
W20260808 04:42:53.261927 3214 heartbeater.cc:644] Failed to heartbeat to 127.12.148.126:40051 (0 consecutive failures): Network error: Failed to ping master at 127.12.148.126:40051: Client connection negotiation failed: client connection to 127.12.148.126:40051: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 04:42:53.262722 3216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:53.262397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.65:47555)
0808 04:42:53.262547 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:53.262632 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260808 04:42:53.263417 3216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:53.263181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.65:45259)
0808 04:42:53.263294 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:53.263352 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260808 04:42:53.263593 3214 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 04:42:53.345752 3217 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:42:53.346028 3217 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:42:53.346073 3217 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:42:53.350047 3217 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:42:53.350116 3217 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:42:53.350196 3217 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.66
I20260808 04:42:53.355525 3217 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:42437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.66:41967
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.148.66
--webserver_port=42563
--tserver_master_addrs=127.12.148.126:40051
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3217
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.66
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:42:53.356571 3217 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:42:53.357553 3217 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:42:53.367093 3229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:53.367091 3231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:53.367111 3228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:53.367422 3217 server_base.cc:1034] running on GCE node
I20260808 04:42:53.367786 3217 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:42:53.368413 3217 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:42:53.369585 3217 hybrid_clock.cc:648] HybridClock initialized: now 1786164173369556 us; error 41 us; skew 500 ppm
Aug 08 04:42:53 dist-test-slave-t7g5 krb5kdc[1146](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164173, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:42:53.372380 3217 init.cc:377] Logged in from keytab as kudu/127.12.148.66@KRBTEST.COM (short username kudu)
I20260808 04:42:53.373224 3217 webserver.cc:460] Webserver started at http://127.12.148.66:42563/ using document root <none> and password file <none>
I20260808 04:42:53.373788 3217 fs_manager.cc:359] Metadata directory not provided
I20260808 04:42:53.373860 3217 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:42:53.377696 3217 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 04:42:53.379773 3239 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:53.381059 3217 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:42:53.381181 3217 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/wal
uuid: "af3c61c3d0ee4a548b5f6191b48631fa"
format_stamp: "Formatted at 2026-08-08 04:42:51 on dist-test-slave-t7g5"
server_key: "ff769f2d0ef675a41f1a97cfce403fe9"
server_key_iv: "5935cfe6d5c0b134420fb31f356075d9"
server_key_version: "encryptionkey@0"
I20260808 04:42:53.381734 3217 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:42:53.407814 3217 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:42:53.410813 3217 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:42:53.411010 3217 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:42:53.411612 3217 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:42:53.412462 3217 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:42:53.412513 3217 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:53.412568 3217 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:42:53.412598 3217 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:53.421257 3217 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.66:41967
I20260808 04:42:53.421293 3428 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.66:41967 every 8 connection(s)
I20260808 04:42:53.422304 3217 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
I20260808 04:42:53.426401 3436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:53.424487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.66:58215)
0808 04:42:53.424979 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:53.425098 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":124,"threads_started":1}
W20260808 04:42:53.426913 3429 heartbeater.cc:644] Failed to heartbeat to 127.12.148.126:40051 (0 consecutive failures): Network error: Failed to ping master at 127.12.148.126:40051: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
I20260808 04:42:53.427466 3436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:53.427262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.66:52059)
0808 04:42:53.427363 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:53.427410 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260808 04:42:53.427613 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 3217
I20260808 04:42:53.428100 3436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:53.427921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.66:38481)
0808 04:42:53.428010 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:53.428051 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260808 04:42:53.428082 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.67:37909
--local_ip_for_outbound_sockets=127.12.148.67
--tserver_master_addrs=127.12.148.126:40051
--webserver_port=37183
--webserver_interface=127.12.148.67
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:42437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:42:53.428278 3429 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 04:42:53.540177 3438 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:42:53.540445 3438 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:42:53.540504 3438 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:42:53.544567 3438 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:42:53.544632 3438 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:42:53.544715 3438 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.67
I20260808 04:42:53.549961 3438 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:42437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.67:37909
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.148.67
--webserver_port=37183
--tserver_master_addrs=127.12.148.126:40051
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3438
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.67
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:42:53.551061 3438 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:42:53.552102 3438 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:42:53.561692 3446 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:42:53.561713 3447 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:53.561748 3438 server_base.cc:1034] running on GCE node
W20260808 04:42:53.561692 3450 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:42:53.562381 3438 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:42:53.563045 3438 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:42:53.564216 3438 hybrid_clock.cc:648] HybridClock initialized: now 1786164173564186 us; error 40 us; skew 500 ppm
Aug 08 04:42:53 dist-test-slave-t7g5 krb5kdc[1146](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164173, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:42:53.566885 3438 init.cc:377] Logged in from keytab as kudu/127.12.148.67@KRBTEST.COM (short username kudu)
I20260808 04:42:53.567701 3438 webserver.cc:460] Webserver started at http://127.12.148.67:37183/ using document root <none> and password file <none>
I20260808 04:42:53.568224 3438 fs_manager.cc:359] Metadata directory not provided
I20260808 04:42:53.568284 3438 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:42:53.572124 3438 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260808 04:42:53.574090 3458 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:53.575268 3438 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:42:53.575374 3438 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/wal
uuid: "09cf4fd35d284cf5b343ebbaff9e835d"
format_stamp: "Formatted at 2026-08-08 04:42:51 on dist-test-slave-t7g5"
server_key: "c02661ca0f2e509b4d28c3e4660edbd6"
server_key_iv: "6eebedbe29c5452471e52e555483ac78"
server_key_version: "encryptionkey@0"
I20260808 04:42:53.575868 3438 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:42:53.587313 3438 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:42:53.590423 3438 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:42:53.590584 3438 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:42:53.591122 3438 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:42:53.591907 3438 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:42:53.591962 3438 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:53.592005 3438 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:42:53.592024 3438 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:42:53.600261 3438 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.67:37909
I20260808 04:42:53.600287 3639 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.67:37909 every 8 connection(s)
I20260808 04:42:53.601265 3438 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
I20260808 04:42:53.604645 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 3438
I20260808 04:42:53.605131 3643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:53.603352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.67:54621)
0808 04:42:53.603800 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:53.603918 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":118,"threads_started":1}
W20260808 04:42:53.605687 3640 heartbeater.cc:644] Failed to heartbeat to 127.12.148.126:40051 (0 consecutive failures): Network error: Failed to ping master at 127.12.148.126:40051: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
I20260808 04:42:53.606249 3643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:53.606044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.67:37475)
0808 04:42:53.606145 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:53.606195 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 04:42:53.606804 3643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:53.606638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.67:59171)
0808 04:42:53.606717 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:53.606756 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260808 04:42:53.606958 3640 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 04:42:54.264640 3647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.264183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.65:41915)
0808 04:42:54.264458 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:54.264517 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":78,"threads_started":1}
I20260808 04:42:54.429311 3650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.428862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.66:41639)
0808 04:42:54.429151 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:54.429206 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":101,"threads_started":1}
I20260808 04:42:54.607815 3652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.607417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.67:46989)
0808 04:42:54.607660 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:54.607713 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":82,"threads_started":1}
I20260808 04:42:54.635012 3656 raft_consensus.cc:482] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:42:54.635273 3656 raft_consensus.cc:504] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09cf4fd35d284cf5b343ebbaff9e835d" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37909 } } peers { permanent_uuid: "8272dbbed81f4156be5d5b45f2f7176c" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40099 } } peers { permanent_uuid: "af3c61c3d0ee4a548b5f6191b48631fa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41967 } }
I20260808 04:42:54.636379 3656 leader_election.cc:288] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09cf4fd35d284cf5b343ebbaff9e835d (127.12.148.67:37909), af3c61c3d0ee4a548b5f6191b48631fa (127.12.148.66:41967)
Aug 08 04:42:54 dist-test-slave-t7g5 krb5kdc[1146](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164173, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for kudu/127.12.148.67@KRBTEST.COM
Aug 08 04:42:54 dist-test-slave-t7g5 krb5kdc[1146](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164173, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for kudu/127.12.148.66@KRBTEST.COM
I20260808 04:42:54.657542 3647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.636555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.67:37909 (local address 127.12.148.65:50859)
0808 04:42:54.636736 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:54.636750 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:54.636854 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:54.638569 (+ 1715us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:54.638574 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:54.639118 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:42:54.639608 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:54.639623 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.640871 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.640873 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:54.641857 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:54.641867 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.642538 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.642541 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:54.642750 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:54.651368 (+ 8618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:42:54.651384 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:42:54.653128 (+ 1744us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:42:54.655137 (+ 2009us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:54.655143 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:54.655157 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:54.655405 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:54.655745 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:54.655749 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:54.655751 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:54.655888 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:54.656544 (+ 656us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:42:54.656551 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:42:54.656769 (+ 218us) client_negotiation.cc:769] Sending connection context
0808 04:42:54.656979 (+ 210us) client_negotiation.cc:240] Negotiation successful
0808 04:42:54.657331 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"mutex_wait_us":198,"spinlock_wait_cycles":64384}
I20260808 04:42:54.657545 3660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.636763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:50859 (local address 127.12.148.67:37909)
0808 04:42:54.637104 (+ 341us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:54.637128 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:54.637165 (+ 37us) server_negotiation.cc:407] Connection header received
0808 04:42:54.637875 (+ 710us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:54.637882 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:54.638219 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:54.638503 (+ 284us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:54.639766 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.640724 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.641967 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.642415 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.642574 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:54.653349 (+ 10775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:54.653355 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:54.653369 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:54.653400 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:54.655021 (+ 1621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:54.655529 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:54.655534 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:54.655538 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:54.655655 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:54.655976 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:54.655979 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:54.655980 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:54.656434 (+ 454us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:54.656554 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:54.657107 (+ 553us) server_negotiation.cc:299] Negotiation successful
0808 04:42:54.657362 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":221,"thread_start_us":54,"threads_started":1}
I20260808 04:42:54.657567 3661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.636790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:53677 (local address 127.12.148.66:41967)
0808 04:42:54.637174 (+ 384us) server_negotiation.cc:206] Beginning negotiation
0808 04:42:54.637198 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0808 04:42:54.637230 (+ 32us) server_negotiation.cc:407] Connection header received
0808 04:42:54.637912 (+ 682us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:42:54.637918 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:42:54.638219 (+ 301us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:42:54.638503 (+ 284us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:42:54.639766 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.640729 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.641975 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.642440 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.642577 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:54.653567 (+ 10990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:42:54.653572 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:42:54.653584 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:42:54.653614 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:42:54.655193 (+ 1579us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:54.655620 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:54.655625 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:54.655629 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:54.655740 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:42:54.655997 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:42:54.656000 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:42:54.656002 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:42:54.656446 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:42:54.656566 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 04:42:54.657108 (+ 542us) server_negotiation.cc:299] Negotiation successful
0808 04:42:54.657369 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267,"thread_start_us":91,"threads_started":1}
I20260808 04:42:54.657580 3657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:54.636616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:41967 (local address 127.12.148.65:53677)
0808 04:42:54.636980 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:54.636993 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:42:54.637094 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:42:54.638568 (+ 1474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:42:54.638574 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:42:54.639118 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:42:54.639607 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:54.639623 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.640863 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.640866 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:54.641855 (+ 989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:42:54.641865 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:42:54.642556 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:42:54.642559 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:42:54.642748 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:42:54.651363 (+ 8615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:42:54.651387 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:42:54.653375 (+ 1988us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:42:54.655305 (+ 1930us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:54.655308 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:54.655310 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:54.655514 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:54.655831 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:42:54.655834 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:42:54.655836 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:42:54.655914 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:42:54.656617 (+ 703us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:42:54.656620 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:42:54.656772 (+ 152us) client_negotiation.cc:769] Sending connection context
0808 04:42:54.656980 (+ 208us) client_negotiation.cc:240] Negotiation successful
0808 04:42:54.657405 (+ 425us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"mutex_wait_us":283,"spinlock_wait_cycles":14336,"thread_start_us":90,"threads_started":1}
W20260808 04:42:54.660305 3023 leader_election.cc:341] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer af3c61c3d0ee4a548b5f6191b48631fa (127.12.148.66:41967): Not found: Tablet not found: 8002a577b3344a2c9742b819fa4e27a6
W20260808 04:42:54.660909 3027 leader_election.cc:341] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 09cf4fd35d284cf5b343ebbaff9e835d (127.12.148.67:37909): Not found: Tablet not found: 8002a577b3344a2c9742b819fa4e27a6
I20260808 04:42:54.660986 3027 leader_election.cc:302] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8272dbbed81f4156be5d5b45f2f7176c; no voters: 09cf4fd35d284cf5b343ebbaff9e835d, af3c61c3d0ee4a548b5f6191b48631fa
I20260808 04:42:54.661211 3656 raft_consensus.cc:2726] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 04:42:55.265774 3664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:55.265322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.65:37967)
0808 04:42:55.265594 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:55.265671 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":82,"threads_started":1}
I20260808 04:42:55.430490 3665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:55.430074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.66:49777)
0808 04:42:55.430322 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:55.430380 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":79,"threads_started":1}
I20260808 04:42:55.608945 3668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:55.608539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.67:41063)
0808 04:42:55.608792 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:55.608850 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":76,"threads_started":1}
I20260808 04:42:56.266893 3670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:56.266489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.65:47281)
0808 04:42:56.266735 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:56.266791 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":79,"threads_started":1}
I20260808 04:42:56.431712 3672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:56.431231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.66:56665)
0808 04:42:56.431542 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:56.431610 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":108,"threads_started":1}
I20260808 04:42:56.610157 3674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:56.609726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.67:39993)
0808 04:42:56.609988 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:56.610054 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":77,"threads_started":1}
I20260808 04:42:56.843871 3678 raft_consensus.cc:482] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:42:56.844023 3678 raft_consensus.cc:504] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09cf4fd35d284cf5b343ebbaff9e835d" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37909 } } peers { permanent_uuid: "8272dbbed81f4156be5d5b45f2f7176c" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40099 } } peers { permanent_uuid: "af3c61c3d0ee4a548b5f6191b48631fa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41967 } }
I20260808 04:42:56.844542 3678 leader_election.cc:288] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09cf4fd35d284cf5b343ebbaff9e835d (127.12.148.67:37909), af3c61c3d0ee4a548b5f6191b48631fa (127.12.148.66:41967)
W20260808 04:42:56.845296 3023 leader_election.cc:341] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer af3c61c3d0ee4a548b5f6191b48631fa (127.12.148.66:41967): Not found: Tablet not found: 8002a577b3344a2c9742b819fa4e27a6
W20260808 04:42:56.845397 3027 leader_election.cc:341] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 09cf4fd35d284cf5b343ebbaff9e835d (127.12.148.67:37909): Not found: Tablet not found: 8002a577b3344a2c9742b819fa4e27a6
I20260808 04:42:56.845487 3027 leader_election.cc:302] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8272dbbed81f4156be5d5b45f2f7176c; no voters: 09cf4fd35d284cf5b343ebbaff9e835d, af3c61c3d0ee4a548b5f6191b48631fa
I20260808 04:42:56.845625 3678 raft_consensus.cc:2726] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 04:42:57.268075 3679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:57.267631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.65:58683)
0808 04:42:57.267902 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:57.267971 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":94,"threads_started":1}
I20260808 04:42:57.432785 3680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:57.432404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.66:60757)
0808 04:42:57.432637 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:57.432693 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":71,"threads_started":1}
I20260808 04:42:57.611304 3681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:57.610885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.67:52815)
0808 04:42:57.611145 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:57.611204 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":96,"threads_started":1}
I20260808 04:42:58.269373 3682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:58.268944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.65:56481)
0808 04:42:58.269218 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:58.269273 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":76,"threads_started":1}
I20260808 04:42:58.434078 3683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:58.433557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.66:56763)
0808 04:42:58.433875 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:58.433954 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":105,"threads_started":1}
I20260808 04:42:58.612533 3685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:58.612079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.67:50561)
0808 04:42:58.612339 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:58.612399 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":82,"threads_started":1}
I20260808 04:42:59.270627 3686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:59.270155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.65:52531)
0808 04:42:59.270466 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:59.270527 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":95,"threads_started":1}
I20260808 04:42:59.435225 3688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:59.434816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.66:54263)
0808 04:42:59.435062 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:59.435126 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":74,"threads_started":1}
I20260808 04:42:59.613842 3690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:42:59.613337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.67:33853)
0808 04:42:59.613635 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0808 04:42:59.613739 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":100,"threads_started":1}
I20260808 04:43:00.184316 3693 raft_consensus.cc:482] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:43:00.184473 3693 raft_consensus.cc:504] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09cf4fd35d284cf5b343ebbaff9e835d" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37909 } } peers { permanent_uuid: "8272dbbed81f4156be5d5b45f2f7176c" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40099 } } peers { permanent_uuid: "af3c61c3d0ee4a548b5f6191b48631fa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41967 } }
I20260808 04:43:00.184849 3693 leader_election.cc:288] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09cf4fd35d284cf5b343ebbaff9e835d (127.12.148.67:37909), af3c61c3d0ee4a548b5f6191b48631fa (127.12.148.66:41967)
W20260808 04:43:00.185673 3023 leader_election.cc:341] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer af3c61c3d0ee4a548b5f6191b48631fa (127.12.148.66:41967): Not found: Tablet not found: 8002a577b3344a2c9742b819fa4e27a6
W20260808 04:43:00.185819 3027 leader_election.cc:341] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 09cf4fd35d284cf5b343ebbaff9e835d (127.12.148.67:37909): Not found: Tablet not found: 8002a577b3344a2c9742b819fa4e27a6
I20260808 04:43:00.185928 3027 leader_election.cc:302] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8272dbbed81f4156be5d5b45f2f7176c; no voters: 09cf4fd35d284cf5b343ebbaff9e835d, af3c61c3d0ee4a548b5f6191b48631fa
I20260808 04:43:00.186084 3693 raft_consensus.cc:2726] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 04:43:00.271757 3695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:00.271314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.65:45731)
0808 04:43:00.271601 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:00.271659 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":101,"threads_started":1}
I20260808 04:43:00.436445 3696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:00.435919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.66:55833)
0808 04:43:00.436264 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:00.436325 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":81,"threads_started":1}
I20260808 04:43:00.614975 3699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:00.614553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.67:58089)
0808 04:43:00.614827 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:00.614881 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":74,"threads_started":1}
I20260808 04:43:01.272934 3703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:01.272448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.65:54843)
0808 04:43:01.272745 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:01.272807 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":96,"threads_started":1}
I20260808 04:43:01.437547 3704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:01.437136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.66:52515)
0808 04:43:01.437386 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:01.437438 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":79,"threads_started":1}
I20260808 04:43:01.616182 3705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:01.615733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.67:48163)
0808 04:43:01.616021 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:01.616084 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":85,"threads_started":1}
I20260808 04:43:02.274096 3707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:02.273709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.65:42521)
0808 04:43:02.273941 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:02.273997 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":72,"threads_started":1}
I20260808 04:43:02.438756 3711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:02.438282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.66:36917)
0808 04:43:02.438587 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:02.438653 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":84,"threads_started":1}
I20260808 04:43:02.617274 3712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:02.616868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.67:55737)
0808 04:43:02.617124 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:02.617180 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":91,"threads_started":1}
I20260808 04:43:03.275355 3713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:03.274905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.65:41579)
0808 04:43:03.275190 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:03.275253 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":97,"threads_started":1}
I20260808 04:43:03.440080 3718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:03.439616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.66:52995)
0808 04:43:03.439910 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:03.439977 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":96,"threads_started":1}
I20260808 04:43:03.618526 3722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:03.618071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.67:36751)
0808 04:43:03.618359 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:03.618422 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":97,"threads_started":1}
I20260808 04:43:04.276537 3723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:04.276119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.65:35621)
0808 04:43:04.276380 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:04.276437 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":84,"threads_started":1}
I20260808 04:43:04.441479 3724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:04.441017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.66:58289)
0808 04:43:04.441307 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:04.441375 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":87,"threads_started":1}
I20260808 04:43:04.619781 3727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:04.619320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.67:48645)
0808 04:43:04.619610 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:04.619672 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":83,"threads_started":1}
I20260808 04:43:04.728849 3728 raft_consensus.cc:482] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:43:04.729012 3728 raft_consensus.cc:504] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09cf4fd35d284cf5b343ebbaff9e835d" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37909 } } peers { permanent_uuid: "8272dbbed81f4156be5d5b45f2f7176c" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40099 } } peers { permanent_uuid: "af3c61c3d0ee4a548b5f6191b48631fa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41967 } }
I20260808 04:43:04.729485 3728 leader_election.cc:288] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09cf4fd35d284cf5b343ebbaff9e835d (127.12.148.67:37909), af3c61c3d0ee4a548b5f6191b48631fa (127.12.148.66:41967)
W20260808 04:43:04.730268 3023 leader_election.cc:341] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer af3c61c3d0ee4a548b5f6191b48631fa (127.12.148.66:41967): Not found: Tablet not found: 8002a577b3344a2c9742b819fa4e27a6
W20260808 04:43:04.730391 3027 leader_election.cc:341] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 09cf4fd35d284cf5b343ebbaff9e835d (127.12.148.67:37909): Not found: Tablet not found: 8002a577b3344a2c9742b819fa4e27a6
I20260808 04:43:04.730463 3027 leader_election.cc:302] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8272dbbed81f4156be5d5b45f2f7176c; no voters: 09cf4fd35d284cf5b343ebbaff9e835d, af3c61c3d0ee4a548b5f6191b48631fa
I20260808 04:43:04.730605 3728 raft_consensus.cc:2726] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 04:43:05.277850 3731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:05.277386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.65:50475)
0808 04:43:05.277683 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:05.277748 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":83,"threads_started":1}
I20260808 04:43:05.442652 3732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:05.442253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.66:51511)
0808 04:43:05.442498 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:05.442552 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":76,"threads_started":1}
I20260808 04:43:05.621053 3733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:05.620616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.67:41519)
0808 04:43:05.620890 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:05.620951 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":95,"threads_started":1}
I20260808 04:43:06.279155 3734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:06.278628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.65:34363)
0808 04:43:06.278990 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:06.279052 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":104,"threads_started":1}
I20260808 04:43:06.443895 3735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:06.443414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.66:47035)
0808 04:43:06.443713 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:06.443779 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":122,"threads_started":1}
I20260808 04:43:06.622201 3737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:06.621798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.67:40139)
0808 04:43:06.622043 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:06.622102 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":72,"threads_started":1}
I20260808 04:43:07.280433 3738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:07.279973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.65:52845)
0808 04:43:07.280268 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:07.280332 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":107,"threads_started":1}
I20260808 04:43:07.445042 3739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:07.444583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.66:48215)
0808 04:43:07.444884 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:07.444944 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":98,"threads_started":1}
I20260808 04:43:07.623484 3740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:07.622993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.67:43829)
0808 04:43:07.623310 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:07.623380 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":81,"threads_started":1}
I20260808 04:43:07.969565 3741 raft_consensus.cc:482] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:43:07.969724 3741 raft_consensus.cc:504] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09cf4fd35d284cf5b343ebbaff9e835d" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37909 } } peers { permanent_uuid: "8272dbbed81f4156be5d5b45f2f7176c" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40099 } } peers { permanent_uuid: "af3c61c3d0ee4a548b5f6191b48631fa" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 41967 } }
I20260808 04:43:07.970144 3741 leader_election.cc:288] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 09cf4fd35d284cf5b343ebbaff9e835d (127.12.148.67:37909), af3c61c3d0ee4a548b5f6191b48631fa (127.12.148.66:41967)
W20260808 04:43:07.970887 3027 leader_election.cc:341] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 09cf4fd35d284cf5b343ebbaff9e835d (127.12.148.67:37909): Not found: Tablet not found: 8002a577b3344a2c9742b819fa4e27a6
W20260808 04:43:07.971017 3023 leader_election.cc:341] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer af3c61c3d0ee4a548b5f6191b48631fa (127.12.148.66:41967): Not found: Tablet not found: 8002a577b3344a2c9742b819fa4e27a6
I20260808 04:43:07.971103 3023 leader_election.cc:302] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8272dbbed81f4156be5d5b45f2f7176c; no voters: 09cf4fd35d284cf5b343ebbaff9e835d, af3c61c3d0ee4a548b5f6191b48631fa
I20260808 04:43:07.971238 3741 raft_consensus.cc:2726] T 8002a577b3344a2c9742b819fa4e27a6 P 8272dbbed81f4156be5d5b45f2f7176c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 04:43:08.281838 3744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:08.281355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.65:56657)
0808 04:43:08.281644 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:08.281739 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":97,"threads_started":1}
I20260808 04:43:08.446278 3746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:08.445867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.66:33237)
0808 04:43:08.446125 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:08.446181 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":86,"threads_started":1}
I20260808 04:43:08.612840 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 2940
I20260808 04:43:08.624858 3747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:08.624435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40051 (local address 127.12.148.67:34237)
0808 04:43:08.624697 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:08.624759 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":73,"threads_started":1}
I20260808 04:43:08.627044 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 3217
I20260808 04:43:08.637435 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 3438
2026-08-08T04:43:08Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19324 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:43:08 dist-test-slave-t7g5 krb5kdc[3750](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:43:08 dist-test-slave-t7g5 krb5kdc[3750](info): set up 2 sockets
Aug 08 04:43:08 dist-test-slave-t7g5 krb5kdc[3750](info): commencing operation
krb5kdc: starting...
W20260808 04:43:09.805811 12881 mini_kdc.cc:121] Time spent starting KDC: real 1.138s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Aug 08 04:43:09 dist-test-slave-t7g5 krb5kdc[3750](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164189, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:43:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:43:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.148.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
I20260808 04:43:09.934588 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:40217
--webserver_interface=127.12.148.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:40841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:40217
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:43:10.049280 3771 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:43:10.049546 3771 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:43:10.049585 3771 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:43:10.053619 3771 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 04:43:10.053696 3771 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 04:43:10.053717 3771 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 04:43:10.053731 3771 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:43:10.053747 3771 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:43:10.053767 3771 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:43:10.053795 3771 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:43:10.053825 3771 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:43:10.059046 3771 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:40841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:40217
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:40217
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3771
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:43:10.060086 3771 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:43:10.061134 3771 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:43:10.069617 3781 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:43:10.069707 3771 server_base.cc:1034] running on GCE node
W20260808 04:43:10.069844 3784 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:10.069720 3779 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:43:10.070428 3771 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:43:10.071518 3771 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:43:10.072685 3771 hybrid_clock.cc:648] HybridClock initialized: now 1786164190072666 us; error 30 us; skew 500 ppm
Aug 08 04:43:10 dist-test-slave-t7g5 krb5kdc[3750](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164190, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:43:10.075390 3771 init.cc:377] Logged in from keytab as kudu/127.12.148.126@KRBTEST.COM (short username kudu)
I20260808 04:43:10.076293 3771 webserver.cc:460] Webserver started at http://127.12.148.126:43499/ using document root <none> and password file <none>
I20260808 04:43:10.076804 3771 fs_manager.cc:359] Metadata directory not provided
I20260808 04:43:10.076871 3771 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:43:10.077046 3771 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:43:10.079216 3771 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "45dae89a5cd24dafb440ac6802ae999f"
format_stamp: "Formatted at 2026-08-08 04:43:10 on dist-test-slave-t7g5"
server_key: "d21579006ad6f02e2e2a802893d63174"
server_key_iv: "bc4fdbe3a1d3fe57f13cc3e58a067c83"
server_key_version: "encryptionkey@0"
I20260808 04:43:10.079723 3771 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "45dae89a5cd24dafb440ac6802ae999f"
format_stamp: "Formatted at 2026-08-08 04:43:10 on dist-test-slave-t7g5"
server_key: "d21579006ad6f02e2e2a802893d63174"
server_key_iv: "bc4fdbe3a1d3fe57f13cc3e58a067c83"
server_key_version: "encryptionkey@0"
I20260808 04:43:10.083406 3771 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.001s
I20260808 04:43:10.085719 3794 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:10.086962 3771 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 04:43:10.087088 3771 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "45dae89a5cd24dafb440ac6802ae999f"
format_stamp: "Formatted at 2026-08-08 04:43:10 on dist-test-slave-t7g5"
server_key: "d21579006ad6f02e2e2a802893d63174"
server_key_iv: "bc4fdbe3a1d3fe57f13cc3e58a067c83"
server_key_version: "encryptionkey@0"
I20260808 04:43:10.087191 3771 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:43:10.097179 3771 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:43:10.099984 3771 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:43:10.100163 3771 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:43:10.107051 3771 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:40217
I20260808 04:43:10.107323 3876 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:40217 every 8 connection(s)
I20260808 04:43:10.108064 3771 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:43:10.111004 3879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:43:10.111466 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 3771
I20260808 04:43:10.111577 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:43:10.111896 12881 external_mini_cluster.cc:1428] Setting key f83f532a40fcda040400aa02b9fc1b5e
I20260808 04:43:10.117767 3879 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f: Bootstrap starting.
I20260808 04:43:10.120090 3879 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f: Neither blocks nor log segments found. Creating new log.
Aug 08 04:43:10 dist-test-slave-t7g5 krb5kdc[3750](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164189, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:43:10.120879 3879 log.cc:824] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f: Log is configured to *not* fsync() on all Append() calls
I20260808 04:43:10.122880 3879 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f: No bootstrap required, opened a new log
I20260808 04:43:10.125695 3888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:10.113366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50838 (local address 127.12.148.126:40217)
0808 04:43:10.113846 (+ 480us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:10.113868 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:10.113905 (+ 37us) server_negotiation.cc:407] Connection header received
0808 04:43:10.114584 (+ 679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:10.114602 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:10.114947 (+ 345us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:10.115261 (+ 314us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:43:10.116085 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:10.117082 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:10.117994 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:10.118477 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:10.118623 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:10.121155 (+ 2532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:43:10.121162 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:43:10.121179 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:43:10.121212 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:43:10.122846 (+ 1634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:10.123348 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:10.123353 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:10.123358 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:10.123480 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:10.123754 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:10.123756 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:10.123757 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:10.124170 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:43:10.124316 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:10.124629 (+ 313us) server_negotiation.cc:299] Negotiation successful
0808 04:43:10.124920 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332,"thread_start_us":141,"threads_started":1}
I20260808 04:43:10.126870 3879 raft_consensus.cc:348] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45dae89a5cd24dafb440ac6802ae999f" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40217 } }
I20260808 04:43:10.127090 3879 raft_consensus.cc:374] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:43:10.127128 3879 raft_consensus.cc:729] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45dae89a5cd24dafb440ac6802ae999f, State: Initialized, Role: FOLLOWER
I20260808 04:43:10.127554 3879 consensus_queue.cc:260] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45dae89a5cd24dafb440ac6802ae999f" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40217 } }
I20260808 04:43:10.127691 3879 raft_consensus.cc:388] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:43:10.127755 3879 raft_consensus.cc:482] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:43:10.127864 3879 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:43:10.128782 3879 raft_consensus.cc:504] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45dae89a5cd24dafb440ac6802ae999f" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40217 } }
I20260808 04:43:10.129119 3879 leader_election.cc:302] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 45dae89a5cd24dafb440ac6802ae999f; no voters:
I20260808 04:43:10.129458 3879 leader_election.cc:288] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:43:10.129573 3895 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:43:10.129804 3895 raft_consensus.cc:686] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [term 1 LEADER]: Becoming Leader. State: Replica: 45dae89a5cd24dafb440ac6802ae999f, State: Running, Role: LEADER
I20260808 04:43:10.130154 3895 consensus_queue.cc:237] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45dae89a5cd24dafb440ac6802ae999f" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40217 } }
I20260808 04:43:10.130646 3879 sys_catalog.cc:564] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:43:10.131892 3897 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 45dae89a5cd24dafb440ac6802ae999f. Latest consensus state: current_term: 1 leader_uuid: "45dae89a5cd24dafb440ac6802ae999f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45dae89a5cd24dafb440ac6802ae999f" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40217 } } }
I20260808 04:43:10.132026 3897 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [sys.catalog]: This master's current role is: LEADER
I20260808 04:43:10.132422 3909 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:43:10.133215 3896 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "45dae89a5cd24dafb440ac6802ae999f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45dae89a5cd24dafb440ac6802ae999f" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40217 } } }
I20260808 04:43:10.133312 3896 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [sys.catalog]: This master's current role is: LEADER
I20260808 04:43:10.135602 3909 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:43:10.140954 3909 catalog_manager.cc:1347] Generated new cluster ID: d3cac24476aa41888d762950dcd15845
I20260808 04:43:10.141023 3909 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:43:10.152051 3909 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:43:10.153258 3909 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:43:10.162057 3909 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f: Generated new TSK 0
I20260808 04:43:10.162735 3909 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.148.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab.
Entry for principal kudu/127.12.148.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab.
I20260808 04:43:10.200230 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.65:0
--local_ip_for_outbound_sockets=127.12.148.65
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:40217
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:40841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:43:10.312732 3927 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:43:10.313030 3927 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:43:10.313079 3927 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:43:10.317263 3927 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:43:10.317344 3927 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:43:10.317435 3927 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.65
I20260808 04:43:10.322785 3927 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:40841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:40217
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3927
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.65
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:43:10.323899 3927 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:43:10.324949 3927 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:43:10.334498 3938 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:10.334637 3939 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:10.334498 3943 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:43:10.335247 3927 server_base.cc:1034] running on GCE node
I20260808 04:43:10.335659 3927 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:43:10.336313 3927 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:43:10.337514 3927 hybrid_clock.cc:648] HybridClock initialized: now 1786164190337494 us; error 34 us; skew 500 ppm
Aug 08 04:43:10 dist-test-slave-t7g5 krb5kdc[3750](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164190, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:43:10.340242 3927 init.cc:377] Logged in from keytab as kudu/127.12.148.65@KRBTEST.COM (short username kudu)
I20260808 04:43:10.341143 3927 webserver.cc:460] Webserver started at http://127.12.148.65:42665/ using document root <none> and password file <none>
I20260808 04:43:10.341773 3927 fs_manager.cc:359] Metadata directory not provided
I20260808 04:43:10.341854 3927 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:43:10.342067 3927 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:43:10.344139 3927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/data/instance:
uuid: "7939bc8b48b44291a5696834e82809e2"
format_stamp: "Formatted at 2026-08-08 04:43:10 on dist-test-slave-t7g5"
server_key: "64cdd24abb3cf39e90d902562f12179c"
server_key_iv: "97e70c07e2cf51f88e0087197f07f8c5"
server_key_version: "encryptionkey@0"
I20260808 04:43:10.344736 3927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance:
uuid: "7939bc8b48b44291a5696834e82809e2"
format_stamp: "Formatted at 2026-08-08 04:43:10 on dist-test-slave-t7g5"
server_key: "64cdd24abb3cf39e90d902562f12179c"
server_key_iv: "97e70c07e2cf51f88e0087197f07f8c5"
server_key_version: "encryptionkey@0"
I20260808 04:43:10.348681 3927 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 04:43:10.351302 3956 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:10.352571 3927 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 04:43:10.352671 3927 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/wal
uuid: "7939bc8b48b44291a5696834e82809e2"
format_stamp: "Formatted at 2026-08-08 04:43:10 on dist-test-slave-t7g5"
server_key: "64cdd24abb3cf39e90d902562f12179c"
server_key_iv: "97e70c07e2cf51f88e0087197f07f8c5"
server_key_version: "encryptionkey@0"
I20260808 04:43:10.352785 3927 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:43:10.366488 3927 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:43:10.369589 3927 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:43:10.369792 3927 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:43:10.370368 3927 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:43:10.371203 3927 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:43:10.371251 3927 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:10.371292 3927 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:43:10.371321 3927 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:10.379976 3927 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.65:37349
I20260808 04:43:10.380016 4148 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.65:37349 every 8 connection(s)
I20260808 04:43:10.380878 3927 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
I20260808 04:43:10.387579 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 3927
I20260808 04:43:10.387733 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance
I20260808 04:43:10.388037 12881 external_mini_cluster.cc:1428] Setting key 4ee7f8609116d9b4baf3287c05383db6
Aug 08 04:43:10 dist-test-slave-t7g5 krb5kdc[3750](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164190, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:43:10.395210 3888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:10.382722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:34573 (local address 127.12.148.126:40217)
0808 04:43:10.382875 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:10.382879 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:10.383689 (+ 810us) server_negotiation.cc:407] Connection header received
0808 04:43:10.385024 (+ 1335us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:10.385027 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:10.385100 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:10.385172 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:43:10.386443 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:10.386975 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:10.388540 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:10.388771 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:10.388863 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:10.391649 (+ 2786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:43:10.391652 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:43:10.391654 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:43:10.391680 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:43:10.392984 (+ 1304us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:10.393583 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:10.393586 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:10.393588 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:10.393715 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:10.394052 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:10.394055 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:10.394057 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:10.394286 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:43:10.394381 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:10.394884 (+ 503us) server_negotiation.cc:299] Negotiation successful
0808 04:43:10.395036 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 04:43:10.396040 4153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:10.383083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.65:34573)
0808 04:43:10.383542 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:10.383588 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:10.384802 (+ 1214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:10.385363 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:43:10.385370 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:43:10.385790 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:43:10.386290 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:10.386305 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:10.387106 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:10.387109 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:10.388416 (+ 1307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:10.388428 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:10.388919 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:10.388922 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:10.389083 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:10.389724 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:43:10.389745 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:43:10.391486 (+ 1741us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:43:10.393103 (+ 1617us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:43:10.393109 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:43:10.393133 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:43:10.393482 (+ 349us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:43:10.393797 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:43:10.393799 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:43:10.393800 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:43:10.393964 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:43:10.394383 (+ 419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:43:10.394388 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:43:10.394635 (+ 247us) client_negotiation.cc:769] Sending connection context
0808 04:43:10.394790 (+ 155us) client_negotiation.cc:240] Negotiation successful
0808 04:43:10.395078 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":119,"threads_started":1}
I20260808 04:43:10.397280 4149 heartbeater.cc:347] Connected to a master server at 127.12.148.126:40217
I20260808 04:43:10.397516 4149 heartbeater.cc:464] Registering TS with master...
I20260808 04:43:10.398030 4149 heartbeater.cc:511] Master 127.12.148.126:40217 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.12.148.66@KRBTEST.COM; defaulting to no policy
I20260808 04:43:10.399755 3821 ts_manager.cc:194] Registered new tserver with Master: 7939bc8b48b44291a5696834e82809e2 (127.12.148.65:37349)
I20260808 04:43:10.400890 3821 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.65@KRBTEST.COM'} at 127.12.148.65:34573
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab.
Entry for principal kudu/127.12.148.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab.
I20260808 04:43:10.417003 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.66:0
--local_ip_for_outbound_sockets=127.12.148.66
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:40217
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:40841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:43:10.529160 4160 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:43:10.529439 4160 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:43:10.529482 4160 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:43:10.533845 4160 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:43:10.533910 4160 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:43:10.533995 4160 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.66
I20260808 04:43:10.539310 4160 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:40841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:40217
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4160
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.66
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:43:10.540315 4160 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:43:10.541290 4160 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:43:10.550629 4170 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:10.550629 4169 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:43:10.550768 4160 server_base.cc:1034] running on GCE node
W20260808 04:43:10.550666 4175 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:43:10.551311 4160 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:43:10.551931 4160 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:43:10.553085 4160 hybrid_clock.cc:648] HybridClock initialized: now 1786164190553059 us; error 41 us; skew 500 ppm
Aug 08 04:43:10 dist-test-slave-t7g5 krb5kdc[3750](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164190, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:43:10.555750 4160 init.cc:377] Logged in from keytab as kudu/127.12.148.66@KRBTEST.COM (short username kudu)
I20260808 04:43:10.556795 4160 webserver.cc:460] Webserver started at http://127.12.148.66:42741/ using document root <none> and password file <none>
I20260808 04:43:10.557389 4160 fs_manager.cc:359] Metadata directory not provided
I20260808 04:43:10.557461 4160 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:43:10.557699 4160 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:43:10.559734 4160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/data/instance:
uuid: "4f5a7ad44b7a48dd84022268de5053c5"
format_stamp: "Formatted at 2026-08-08 04:43:10 on dist-test-slave-t7g5"
server_key: "9520535ee10b4545d3373cdf7bc7fc51"
server_key_iv: "d85d7d6f35016e9814f4b493cea4241e"
server_key_version: "encryptionkey@0"
I20260808 04:43:10.560287 4160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance:
uuid: "4f5a7ad44b7a48dd84022268de5053c5"
format_stamp: "Formatted at 2026-08-08 04:43:10 on dist-test-slave-t7g5"
server_key: "9520535ee10b4545d3373cdf7bc7fc51"
server_key_iv: "d85d7d6f35016e9814f4b493cea4241e"
server_key_version: "encryptionkey@0"
I20260808 04:43:10.564095 4160 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 04:43:10.566552 4189 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:10.567772 4160 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:43:10.567884 4160 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/wal
uuid: "4f5a7ad44b7a48dd84022268de5053c5"
format_stamp: "Formatted at 2026-08-08 04:43:10 on dist-test-slave-t7g5"
server_key: "9520535ee10b4545d3373cdf7bc7fc51"
server_key_iv: "d85d7d6f35016e9814f4b493cea4241e"
server_key_version: "encryptionkey@0"
I20260808 04:43:10.567994 4160 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:43:10.583884 4160 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:43:10.586998 4160 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:43:10.587173 4160 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:43:10.587774 4160 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:43:10.588598 4160 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:43:10.588649 4160 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:10.588703 4160 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:43:10.588728 4160 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:10.597572 4160 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.66:37015
I20260808 04:43:10.597610 4371 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.66:37015 every 8 connection(s)
I20260808 04:43:10.598487 4160 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
I20260808 04:43:10.604334 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 4160
I20260808 04:43:10.604475 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance
I20260808 04:43:10.604789 12881 external_mini_cluster.cc:1428] Setting key bf0a7974cb216f6ff91d16f551edd67b
Aug 08 04:43:10 dist-test-slave-t7g5 krb5kdc[3750](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164190, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:43:10.612445 3888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:10.600269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:59307 (local address 127.12.148.126:40217)
0808 04:43:10.600403 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:10.600406 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:10.601264 (+ 858us) server_negotiation.cc:407] Connection header received
0808 04:43:10.602671 (+ 1407us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:10.602674 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:10.602721 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:10.602792 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:43:10.603914 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:10.604609 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:10.605988 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:10.606312 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:10.606419 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:10.608939 (+ 2520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:43:10.608943 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:43:10.608946 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:43:10.608975 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:43:10.610308 (+ 1333us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:10.610865 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:10.610869 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:10.610871 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:10.610961 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:10.611304 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:10.611308 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:10.611310 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:10.611509 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:43:10.611607 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:10.612116 (+ 509us) server_negotiation.cc:299] Negotiation successful
0808 04:43:10.612262 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 04:43:10.613231 4374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:10.600653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.66:59307)
0808 04:43:10.601104 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:10.601149 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:10.602477 (+ 1328us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:10.602934 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:43:10.602941 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:43:10.603304 (+ 363us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:43:10.603792 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:10.603807 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:10.604767 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:10.604770 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:10.605857 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:10.605869 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:10.606468 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:10.606472 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:10.606650 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:10.607235 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:43:10.607253 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:43:10.608772 (+ 1519us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:43:10.610426 (+ 1654us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:43:10.610433 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:43:10.610448 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:43:10.610760 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:43:10.611051 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:43:10.611055 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:43:10.611057 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:43:10.611204 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:43:10.611617 (+ 413us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:43:10.611624 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:43:10.611874 (+ 250us) client_negotiation.cc:769] Sending connection context
0808 04:43:10.612053 (+ 179us) client_negotiation.cc:240] Negotiation successful
0808 04:43:10.612388 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":111,"threads_started":1}
I20260808 04:43:10.614586 4372 heartbeater.cc:347] Connected to a master server at 127.12.148.126:40217
I20260808 04:43:10.614867 4372 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.12.148.67@KRBTEST.COM; defaulting to no policy
I20260808 04:43:10.615353 4372 heartbeater.cc:511] Master 127.12.148.126:40217 requested a full tablet report, sending...
I20260808 04:43:10.616367 3821 ts_manager.cc:194] Registered new tserver with Master: 4f5a7ad44b7a48dd84022268de5053c5 (127.12.148.66:37015)
I20260808 04:43:10.616948 3821 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.66@KRBTEST.COM'} at 127.12.148.66:59307
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab.
Entry for principal kudu/127.12.148.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab.
I20260808 04:43:10.632477 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.67:0
--local_ip_for_outbound_sockets=127.12.148.67
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:40217
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:40841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:43:10.745105 4380 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:43:10.745402 4380 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:43:10.745450 4380 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:43:10.749595 4380 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:43:10.749689 4380 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:43:10.749769 4380 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.67
I20260808 04:43:10.755169 4380 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:40841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:40217
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4380
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.67
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:43:10.756326 4380 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:43:10.757457 4380 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:43:10.767324 4392 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:10.767285 4394 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:10.767266 4391 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:43:10.767364 4380 server_base.cc:1034] running on GCE node
I20260808 04:43:10.768034 4380 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:43:10.768699 4380 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:43:10.769853 4380 hybrid_clock.cc:648] HybridClock initialized: now 1786164190769819 us; error 47 us; skew 500 ppm
Aug 08 04:43:10 dist-test-slave-t7g5 krb5kdc[3750](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164190, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:43:10.772678 4380 init.cc:377] Logged in from keytab as kudu/127.12.148.67@KRBTEST.COM (short username kudu)
I20260808 04:43:10.773547 4380 webserver.cc:460] Webserver started at http://127.12.148.67:33001/ using document root <none> and password file <none>
I20260808 04:43:10.774120 4380 fs_manager.cc:359] Metadata directory not provided
I20260808 04:43:10.774190 4380 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:43:10.774425 4380 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:43:10.776477 4380 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/data/instance:
uuid: "7f4a390317fb44429480ca1ff43c01c1"
format_stamp: "Formatted at 2026-08-08 04:43:10 on dist-test-slave-t7g5"
server_key: "67f0d728e0dbef6beae78c8e4595c93f"
server_key_iv: "7454afa2f62a2ea7754f0bf393f3016a"
server_key_version: "encryptionkey@0"
I20260808 04:43:10.777024 4380 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance:
uuid: "7f4a390317fb44429480ca1ff43c01c1"
format_stamp: "Formatted at 2026-08-08 04:43:10 on dist-test-slave-t7g5"
server_key: "67f0d728e0dbef6beae78c8e4595c93f"
server_key_iv: "7454afa2f62a2ea7754f0bf393f3016a"
server_key_version: "encryptionkey@0"
I20260808 04:43:10.780815 4380 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 04:43:10.783306 4403 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:10.784499 4380 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 04:43:10.784610 4380 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/wal
uuid: "7f4a390317fb44429480ca1ff43c01c1"
format_stamp: "Formatted at 2026-08-08 04:43:10 on dist-test-slave-t7g5"
server_key: "67f0d728e0dbef6beae78c8e4595c93f"
server_key_iv: "7454afa2f62a2ea7754f0bf393f3016a"
server_key_version: "encryptionkey@0"
I20260808 04:43:10.784713 4380 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:43:10.795895 4380 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:43:10.798583 4380 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:43:10.798750 4380 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:43:10.799301 4380 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:43:10.800089 4380 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:43:10.800148 4380 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:10.800200 4380 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:43:10.800228 4380 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:10.808607 4380 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.67:44961
I20260808 04:43:10.808638 4607 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.67:44961 every 8 connection(s)
I20260808 04:43:10.809458 4380 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
Aug 08 04:43:10 dist-test-slave-t7g5 krb5kdc[3750](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164190, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:43:10.818871 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 4380
I20260808 04:43:10.819006 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance
I20260808 04:43:10.819357 12881 external_mini_cluster.cc:1428] Setting key 4ddafd02caf1c541c0cda6a46fbfe315
I20260808 04:43:10.823215 3888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:10.811304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:35065 (local address 127.12.148.126:40217)
0808 04:43:10.811455 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:10.811459 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:10.812335 (+ 876us) server_negotiation.cc:407] Connection header received
0808 04:43:10.813626 (+ 1291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:10.813629 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:10.813707 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:10.813793 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:43:10.814947 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:10.815503 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:10.816592 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:10.816822 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:10.816908 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:10.819562 (+ 2654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:43:10.819566 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:43:10.819568 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:43:10.819595 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:43:10.821200 (+ 1605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:10.821836 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:10.821839 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:10.821841 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:10.821924 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:10.822258 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:10.822260 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:10.822261 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:10.822427 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:43:10.822507 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:10.822998 (+ 491us) server_negotiation.cc:299] Negotiation successful
0808 04:43:10.823096 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 04:43:10.824028 4611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:10.811691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.67:35065)
0808 04:43:10.812181 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:10.812224 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:10.813423 (+ 1199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:10.813954 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:43:10.813960 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:43:10.814318 (+ 358us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:43:10.814789 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:10.814803 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:10.815602 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:10.815604 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:10.816478 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:10.816488 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:10.816953 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:10.816956 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:10.817100 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:10.817703 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:43:10.817719 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:43:10.819341 (+ 1622us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:43:10.821330 (+ 1989us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:43:10.821338 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:43:10.821356 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:43:10.821745 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:43:10.822036 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:43:10.822039 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:43:10.822040 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:43:10.822187 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:43:10.822533 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:43:10.822538 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:43:10.822805 (+ 267us) client_negotiation.cc:769] Sending connection context
0808 04:43:10.822968 (+ 163us) client_negotiation.cc:240] Negotiation successful
0808 04:43:10.823221 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":128,"threads_started":1}
I20260808 04:43:10.825106 4608 heartbeater.cc:347] Connected to a master server at 127.12.148.126:40217
I20260808 04:43:10.825338 4608 heartbeater.cc:464] Registering TS with master...
I20260808 04:43:10.825839 4608 heartbeater.cc:511] Master 127.12.148.126:40217 requested a full tablet report, sending...
I20260808 04:43:10.826869 3821 ts_manager.cc:194] Registered new tserver with Master: 7f4a390317fb44429480ca1ff43c01c1 (127.12.148.67:44961)
I20260808 04:43:10.827405 3821 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.67@KRBTEST.COM'} at 127.12.148.67:35065
I20260808 04:43:10.833053 12881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 04:43:10.841288 3888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:10.834910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50848 (local address 127.12.148.126:40217)
0808 04:43:10.835034 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:10.835038 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:10.835230 (+ 192us) server_negotiation.cc:407] Connection header received
0808 04:43:10.835319 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:10.835321 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:10.835358 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:10.835423 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:43:10.836058 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:10.836550 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:10.837287 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:10.837493 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:10.837557 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:10.838776 (+ 1219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:43:10.838779 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:43:10.838781 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:43:10.838803 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:43:10.840046 (+ 1243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:10.840355 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:10.840357 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:10.840359 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:10.840434 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:10.840612 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:10.840614 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:10.840615 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:10.840811 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:43:10.840908 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:10.841052 (+ 144us) server_negotiation.cc:299] Negotiation successful
0808 04:43:10.841141 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 04:43:10.843954 3821 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50848:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:43:10.846896 3821 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:43:10.860934 4629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:10.854902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.67:44961 (local address 127.0.0.1:39222)
0808 04:43:10.855245 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:10.855303 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:10.855426 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:10.856584 (+ 1158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:43:10.856590 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:43:10.856614 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:43:10.856751 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:10.856759 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:10.858547 (+ 1788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:10.858550 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:10.859538 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:10.859547 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:10.860489 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:10.860492 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:10.860570 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:10.860600 (+ 30us) client_negotiation.cc:769] Sending connection context
0808 04:43:10.860674 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 04:43:10.860777 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"mutex_wait_us":39,"thread_start_us":81,"threads_started":1}
I20260808 04:43:10.860970 4630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:10.855077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39222 (local address 127.12.148.67:44961)
0808 04:43:10.856095 (+ 1018us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:10.856106 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:10.856130 (+ 24us) server_negotiation.cc:407] Connection header received
0808 04:43:10.856209 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:10.856214 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:10.856427 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:10.856587 (+ 160us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:43:10.856878 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:10.858412 (+ 1534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:10.859647 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:10.860374 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:10.860494 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:10.860644 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:10.860704 (+ 60us) server_negotiation.cc:299] Negotiation successful
0808 04:43:10.860798 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":917,"thread_start_us":132,"threads_started":1}
I20260808 04:43:10.861346 4631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:10.855224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:37015 (local address 127.0.0.1:42082)
0808 04:43:10.855747 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:10.855760 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:10.855847 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:10.856798 (+ 951us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:43:10.856802 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:43:10.856819 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:43:10.856926 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:10.856933 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:10.858302 (+ 1369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:10.858305 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:10.859759 (+ 1454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:10.859771 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:10.860786 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:10.860790 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:10.860881 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:10.860903 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 04:43:10.860986 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 04:43:10.861221 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":465,"mutex_wait_us":102,"thread_start_us":92,"threads_started":1}
I20260808 04:43:10.862203 4635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:10.855699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42082 (local address 127.12.148.66:37015)
0808 04:43:10.856387 (+ 688us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:10.856398 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:10.856420 (+ 22us) server_negotiation.cc:407] Connection header received
0808 04:43:10.856480 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:10.856483 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:10.856660 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:10.856810 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:43:10.857044 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:10.858181 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:10.859887 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:10.860675 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:10.860772 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:10.860898 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:10.861949 (+ 1051us) server_negotiation.cc:299] Negotiation successful
0808 04:43:10.862054 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":588,"thread_start_us":118,"threads_started":1}
I20260808 04:43:10.862486 4634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:10.855625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:37349 (local address 127.0.0.1:39184)
0808 04:43:10.856063 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:10.856076 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:10.856155 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:10.857068 (+ 913us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:43:10.857071 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:43:10.857087 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:43:10.857155 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:10.857159 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:10.858230 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:10.858233 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:10.859764 (+ 1531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:10.859771 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:10.862119 (+ 2348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:10.862122 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:10.862207 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:10.862230 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 04:43:10.862298 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 04:43:10.862363 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":380,"mutex_wait_us":112,"thread_start_us":91,"threads_started":1}
I20260808 04:43:10.862949 4637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:10.856081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39184 (local address 127.12.148.65:37349)
0808 04:43:10.856489 (+ 408us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:10.856503 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:10.856526 (+ 23us) server_negotiation.cc:407] Connection header received
0808 04:43:10.856600 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:10.856604 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:10.856790 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:10.856932 (+ 142us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:43:10.857256 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:10.858107 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:10.860970 (+ 2863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:10.861804 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:10.861901 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:10.862057 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:10.862734 (+ 677us) server_negotiation.cc:299] Negotiation successful
0808 04:43:10.862817 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":72,"threads_started":1}
I20260808 04:43:10.864283 4490 tablet_service.cc:1467] Processing CreateTablet for tablet d3460eac0f1749578f39742207f756ac (DEFAULT_TABLE table=test-table [id=c61dc0b34f2f4fadac84d72da1c0a6be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:43:10.865213 4490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3460eac0f1749578f39742207f756ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:43:10.864820 4274 tablet_service.cc:1467] Processing CreateTablet for tablet d3460eac0f1749578f39742207f756ac (DEFAULT_TABLE table=test-table [id=c61dc0b34f2f4fadac84d72da1c0a6be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:43:10.866024 4274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3460eac0f1749578f39742207f756ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:43:10.865522 4033 tablet_service.cc:1467] Processing CreateTablet for tablet d3460eac0f1749578f39742207f756ac (DEFAULT_TABLE table=test-table [id=c61dc0b34f2f4fadac84d72da1c0a6be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:43:10.866624 4033 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3460eac0f1749578f39742207f756ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:43:10.871912 4638 tablet_bootstrap.cc:492] T d3460eac0f1749578f39742207f756ac P 7f4a390317fb44429480ca1ff43c01c1: Bootstrap starting.
I20260808 04:43:10.873617 4639 tablet_bootstrap.cc:492] T d3460eac0f1749578f39742207f756ac P 4f5a7ad44b7a48dd84022268de5053c5: Bootstrap starting.
I20260808 04:43:10.874241 4638 tablet_bootstrap.cc:654] T d3460eac0f1749578f39742207f756ac P 7f4a390317fb44429480ca1ff43c01c1: Neither blocks nor log segments found. Creating new log.
I20260808 04:43:10.874938 4640 tablet_bootstrap.cc:492] T d3460eac0f1749578f39742207f756ac P 7939bc8b48b44291a5696834e82809e2: Bootstrap starting.
I20260808 04:43:10.875643 4638 log.cc:824] T d3460eac0f1749578f39742207f756ac P 7f4a390317fb44429480ca1ff43c01c1: Log is configured to *not* fsync() on all Append() calls
I20260808 04:43:10.876246 4639 tablet_bootstrap.cc:654] T d3460eac0f1749578f39742207f756ac P 4f5a7ad44b7a48dd84022268de5053c5: Neither blocks nor log segments found. Creating new log.
I20260808 04:43:10.876820 4640 tablet_bootstrap.cc:654] T d3460eac0f1749578f39742207f756ac P 7939bc8b48b44291a5696834e82809e2: Neither blocks nor log segments found. Creating new log.
I20260808 04:43:10.877080 4639 log.cc:824] T d3460eac0f1749578f39742207f756ac P 4f5a7ad44b7a48dd84022268de5053c5: Log is configured to *not* fsync() on all Append() calls
I20260808 04:43:10.877897 4638 tablet_bootstrap.cc:492] T d3460eac0f1749578f39742207f756ac P 7f4a390317fb44429480ca1ff43c01c1: No bootstrap required, opened a new log
I20260808 04:43:10.878050 4640 log.cc:824] T d3460eac0f1749578f39742207f756ac P 7939bc8b48b44291a5696834e82809e2: Log is configured to *not* fsync() on all Append() calls
I20260808 04:43:10.878103 4638 ts_tablet_manager.cc:1397] T d3460eac0f1749578f39742207f756ac P 7f4a390317fb44429480ca1ff43c01c1: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 04:43:10.878875 4639 tablet_bootstrap.cc:492] T d3460eac0f1749578f39742207f756ac P 4f5a7ad44b7a48dd84022268de5053c5: No bootstrap required, opened a new log
I20260808 04:43:10.879056 4639 ts_tablet_manager.cc:1397] T d3460eac0f1749578f39742207f756ac P 4f5a7ad44b7a48dd84022268de5053c5: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 04:43:10.879984 4640 tablet_bootstrap.cc:492] T d3460eac0f1749578f39742207f756ac P 7939bc8b48b44291a5696834e82809e2: No bootstrap required, opened a new log
I20260808 04:43:10.880165 4640 ts_tablet_manager.cc:1397] T d3460eac0f1749578f39742207f756ac P 7939bc8b48b44291a5696834e82809e2: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 04:43:10.881865 4639 raft_consensus.cc:348] T d3460eac0f1749578f39742207f756ac P 4f5a7ad44b7a48dd84022268de5053c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f4a390317fb44429480ca1ff43c01c1" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44961 } } peers { permanent_uuid: "7939bc8b48b44291a5696834e82809e2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 37349 } } peers { permanent_uuid: "4f5a7ad44b7a48dd84022268de5053c5" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 37015 } }
I20260808 04:43:10.881847 4638 raft_consensus.cc:348] T d3460eac0f1749578f39742207f756ac P 7f4a390317fb44429480ca1ff43c01c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f4a390317fb44429480ca1ff43c01c1" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44961 } } peers { permanent_uuid: "7939bc8b48b44291a5696834e82809e2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 37349 } } peers { permanent_uuid: "4f5a7ad44b7a48dd84022268de5053c5" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 37015 } }
I20260808 04:43:10.882110 4639 raft_consensus.cc:374] T d3460eac0f1749578f39742207f756ac P 4f5a7ad44b7a48dd84022268de5053c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:43:10.882115 4638 raft_consensus.cc:374] T d3460eac0f1749578f39742207f756ac P 7f4a390317fb44429480ca1ff43c01c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:43:10.882165 4639 raft_consensus.cc:729] T d3460eac0f1749578f39742207f756ac P 4f5a7ad44b7a48dd84022268de5053c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f5a7ad44b7a48dd84022268de5053c5, State: Initialized, Role: FOLLOWER
I20260808 04:43:10.882172 4638 raft_consensus.cc:729] T d3460eac0f1749578f39742207f756ac P 7f4a390317fb44429480ca1ff43c01c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f4a390317fb44429480ca1ff43c01c1, State: Initialized, Role: FOLLOWER
I20260808 04:43:10.882588 4639 consensus_queue.cc:260] T d3460eac0f1749578f39742207f756ac P 4f5a7ad44b7a48dd84022268de5053c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f4a390317fb44429480ca1ff43c01c1" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44961 } } peers { permanent_uuid: "7939bc8b48b44291a5696834e82809e2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 37349 } } peers { permanent_uuid: "4f5a7ad44b7a48dd84022268de5053c5" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 37015 } }
I20260808 04:43:10.882597 4638 consensus_queue.cc:260] T d3460eac0f1749578f39742207f756ac P 7f4a390317fb44429480ca1ff43c01c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f4a390317fb44429480ca1ff43c01c1" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44961 } } peers { permanent_uuid: "7939bc8b48b44291a5696834e82809e2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 37349 } } peers { permanent_uuid: "4f5a7ad44b7a48dd84022268de5053c5" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 37015 } }
I20260808 04:43:10.883203 4372 heartbeater.cc:503] Master 127.12.148.126:40217 was elected leader, sending a full tablet report...
I20260808 04:43:10.883561 4638 ts_tablet_manager.cc:1428] T d3460eac0f1749578f39742207f756ac P 7f4a390317fb44429480ca1ff43c01c1: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260808 04:43:10.883570 4639 ts_tablet_manager.cc:1428] T d3460eac0f1749578f39742207f756ac P 4f5a7ad44b7a48dd84022268de5053c5: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260808 04:43:10.883878 4608 heartbeater.cc:503] Master 127.12.148.126:40217 was elected leader, sending a full tablet report...
I20260808 04:43:10.883786 4640 raft_consensus.cc:348] T d3460eac0f1749578f39742207f756ac P 7939bc8b48b44291a5696834e82809e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f4a390317fb44429480ca1ff43c01c1" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44961 } } peers { permanent_uuid: "7939bc8b48b44291a5696834e82809e2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 37349 } } peers { permanent_uuid: "4f5a7ad44b7a48dd84022268de5053c5" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 37015 } }
I20260808 04:43:10.883987 4640 raft_consensus.cc:374] T d3460eac0f1749578f39742207f756ac P 7939bc8b48b44291a5696834e82809e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:43:10.884023 4640 raft_consensus.cc:729] T d3460eac0f1749578f39742207f756ac P 7939bc8b48b44291a5696834e82809e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7939bc8b48b44291a5696834e82809e2, State: Initialized, Role: FOLLOWER
I20260808 04:43:10.884352 4640 consensus_queue.cc:260] T d3460eac0f1749578f39742207f756ac P 7939bc8b48b44291a5696834e82809e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f4a390317fb44429480ca1ff43c01c1" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44961 } } peers { permanent_uuid: "7939bc8b48b44291a5696834e82809e2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 37349 } } peers { permanent_uuid: "4f5a7ad44b7a48dd84022268de5053c5" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 37015 } }
I20260808 04:43:10.885228 4640 ts_tablet_manager.cc:1428] T d3460eac0f1749578f39742207f756ac P 7939bc8b48b44291a5696834e82809e2: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260808 04:43:10.885583 4149 heartbeater.cc:503] Master 127.12.148.126:40217 was elected leader, sending a full tablet report...
I20260808 04:43:11.018332 4650 raft_consensus.cc:482] T d3460eac0f1749578f39742207f756ac P 7f4a390317fb44429480ca1ff43c01c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:43:11.018554 4650 raft_consensus.cc:504] T d3460eac0f1749578f39742207f756ac P 7f4a390317fb44429480ca1ff43c01c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f4a390317fb44429480ca1ff43c01c1" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44961 } } peers { permanent_uuid: "7939bc8b48b44291a5696834e82809e2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 37349 } } peers { permanent_uuid: "4f5a7ad44b7a48dd84022268de5053c5" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 37015 } }
I20260808 04:43:11.019726 4650 leader_election.cc:288] T d3460eac0f1749578f39742207f756ac P 7f4a390317fb44429480ca1ff43c01c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7939bc8b48b44291a5696834e82809e2 (127.12.148.65:37349), 4f5a7ad44b7a48dd84022268de5053c5 (127.12.148.66:37015)
I20260808 04:43:11.023214 4611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:11.019993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:37349 (local address 127.12.148.67:41229)
0808 04:43:11.020142 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:11.020159 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:11.020260 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:11.020520 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:43:11.020523 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:43:11.020541 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:43:11.020655 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:11.020661 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:11.021385 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:11.021388 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:11.022181 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:11.022190 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:11.022813 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:11.022816 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:11.022919 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:11.022938 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 04:43:11.023004 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 04:43:11.023075 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66}
I20260808 04:43:11.023214 4637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:11.020062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:41229 (local address 127.12.148.65:37349)
0808 04:43:11.020185 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:11.020189 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:11.020207 (+ 18us) server_negotiation.cc:407] Connection header received
0808 04:43:11.020388 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:11.020391 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:11.020434 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:11.020493 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:43:11.020764 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:11.021277 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:11.022304 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:11.022703 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:11.022813 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:11.022868 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:11.023032 (+ 164us) server_negotiation.cc:299] Negotiation successful
0808 04:43:11.023104 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 04:43:11.023422 4652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:11.020022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:37015 (local address 127.12.148.67:58041)
0808 04:43:11.020412 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:11.020423 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:11.020529 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:11.020769 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:43:11.020772 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:43:11.020787 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:43:11.020895 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:11.020900 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:11.021593 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:11.021596 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:11.022396 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:11.022406 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:11.023020 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:11.023023 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:11.023130 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:11.023149 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 04:43:11.023213 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 04:43:11.023280 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":124,"threads_started":1}
I20260808 04:43:11.023408 4635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:11.020241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:58041 (local address 127.12.148.66:37015)
0808 04:43:11.020363 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:11.020367 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:11.020501 (+ 134us) server_negotiation.cc:407] Connection header received
0808 04:43:11.020626 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:11.020629 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:11.020679 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:11.020739 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:43:11.021005 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:11.021483 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:11.022520 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:11.022903 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:11.023012 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:11.023062 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:11.023236 (+ 174us) server_negotiation.cc:299] Negotiation successful
0808 04:43:11.023302 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 04:43:11.024188 4307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3460eac0f1749578f39742207f756ac" candidate_uuid: "7f4a390317fb44429480ca1ff43c01c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f5a7ad44b7a48dd84022268de5053c5" is_pre_election: true
I20260808 04:43:11.024314 4071 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3460eac0f1749578f39742207f756ac" candidate_uuid: "7f4a390317fb44429480ca1ff43c01c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7939bc8b48b44291a5696834e82809e2" is_pre_election: true
I20260808 04:43:11.024503 4307 raft_consensus.cc:2454] T d3460eac0f1749578f39742207f756ac P 4f5a7ad44b7a48dd84022268de5053c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f4a390317fb44429480ca1ff43c01c1 in term 0.
I20260808 04:43:11.024609 4071 raft_consensus.cc:2454] T d3460eac0f1749578f39742207f756ac P 7939bc8b48b44291a5696834e82809e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f4a390317fb44429480ca1ff43c01c1 in term 0.
I20260808 04:43:11.024991 4414 leader_election.cc:302] T d3460eac0f1749578f39742207f756ac P 7f4a390317fb44429480ca1ff43c01c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f5a7ad44b7a48dd84022268de5053c5, 7f4a390317fb44429480ca1ff43c01c1; no voters:
I20260808 04:43:11.025259 4650 raft_consensus.cc:2781] T d3460eac0f1749578f39742207f756ac P 7f4a390317fb44429480ca1ff43c01c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:43:11.025348 4650 raft_consensus.cc:482] T d3460eac0f1749578f39742207f756ac P 7f4a390317fb44429480ca1ff43c01c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:43:11.025396 4650 raft_consensus.cc:3037] T d3460eac0f1749578f39742207f756ac P 7f4a390317fb44429480ca1ff43c01c1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:43:11.026448 4650 raft_consensus.cc:504] T d3460eac0f1749578f39742207f756ac P 7f4a390317fb44429480ca1ff43c01c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f4a390317fb44429480ca1ff43c01c1" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44961 } } peers { permanent_uuid: "7939bc8b48b44291a5696834e82809e2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 37349 } } peers { permanent_uuid: "4f5a7ad44b7a48dd84022268de5053c5" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 37015 } }
I20260808 04:43:11.026758 4650 leader_election.cc:288] T d3460eac0f1749578f39742207f756ac P 7f4a390317fb44429480ca1ff43c01c1 [CANDIDATE]: Term 1 election: Requested vote from peers 7939bc8b48b44291a5696834e82809e2 (127.12.148.65:37349), 4f5a7ad44b7a48dd84022268de5053c5 (127.12.148.66:37015)
I20260808 04:43:11.027127 4071 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3460eac0f1749578f39742207f756ac" candidate_uuid: "7f4a390317fb44429480ca1ff43c01c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7939bc8b48b44291a5696834e82809e2"
I20260808 04:43:11.027132 4307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3460eac0f1749578f39742207f756ac" candidate_uuid: "7f4a390317fb44429480ca1ff43c01c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f5a7ad44b7a48dd84022268de5053c5"
I20260808 04:43:11.027231 4071 raft_consensus.cc:3037] T d3460eac0f1749578f39742207f756ac P 7939bc8b48b44291a5696834e82809e2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:43:11.027240 4307 raft_consensus.cc:3037] T d3460eac0f1749578f39742207f756ac P 4f5a7ad44b7a48dd84022268de5053c5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:43:11.028214 4071 raft_consensus.cc:2454] T d3460eac0f1749578f39742207f756ac P 7939bc8b48b44291a5696834e82809e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4a390317fb44429480ca1ff43c01c1 in term 1.
I20260808 04:43:11.028268 4307 raft_consensus.cc:2454] T d3460eac0f1749578f39742207f756ac P 4f5a7ad44b7a48dd84022268de5053c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f4a390317fb44429480ca1ff43c01c1 in term 1.
I20260808 04:43:11.028527 4407 leader_election.cc:302] T d3460eac0f1749578f39742207f756ac P 7f4a390317fb44429480ca1ff43c01c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7939bc8b48b44291a5696834e82809e2, 7f4a390317fb44429480ca1ff43c01c1; no voters:
I20260808 04:43:11.028708 4650 raft_consensus.cc:2781] T d3460eac0f1749578f39742207f756ac P 7f4a390317fb44429480ca1ff43c01c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:43:11.028947 4650 raft_consensus.cc:686] T d3460eac0f1749578f39742207f756ac P 7f4a390317fb44429480ca1ff43c01c1 [term 1 LEADER]: Becoming Leader. State: Replica: 7f4a390317fb44429480ca1ff43c01c1, State: Running, Role: LEADER
I20260808 04:43:11.029268 4650 consensus_queue.cc:237] T d3460eac0f1749578f39742207f756ac P 7f4a390317fb44429480ca1ff43c01c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f4a390317fb44429480ca1ff43c01c1" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44961 } } peers { permanent_uuid: "7939bc8b48b44291a5696834e82809e2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 37349 } } peers { permanent_uuid: "4f5a7ad44b7a48dd84022268de5053c5" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 37015 } }
I20260808 04:43:11.032725 3820 catalog_manager.cc:5495] T d3460eac0f1749578f39742207f756ac P 7f4a390317fb44429480ca1ff43c01c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f4a390317fb44429480ca1ff43c01c1 (127.12.148.67). New cstate: current_term: 1 leader_uuid: "7f4a390317fb44429480ca1ff43c01c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f4a390317fb44429480ca1ff43c01c1" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7939bc8b48b44291a5696834e82809e2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f5a7ad44b7a48dd84022268de5053c5" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 37015 } health_report { overall_health: UNKNOWN } } }
I20260808 04:43:11.049643 4630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:11.046652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39230 (local address 127.12.148.67:44961)
0808 04:43:11.046770 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:11.046773 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:11.046786 (+ 13us) server_negotiation.cc:407] Connection header received
0808 04:43:11.046880 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:11.046882 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:11.046934 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:11.047017 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:43:11.047199 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:11.047691 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:11.048469 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:11.048665 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:11.048730 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:11.048950 (+ 220us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:43:11.049355 (+ 405us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:43:11.049439 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:11.049467 (+ 28us) server_negotiation.cc:299] Negotiation successful
0808 04:43:11.049515 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 04:43:11.055377 4307 raft_consensus.cc:1261] T d3460eac0f1749578f39742207f756ac P 4f5a7ad44b7a48dd84022268de5053c5 [term 1 FOLLOWER]: Refusing update from remote peer 7f4a390317fb44429480ca1ff43c01c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:43:11.055377 4071 raft_consensus.cc:1261] T d3460eac0f1749578f39742207f756ac P 7939bc8b48b44291a5696834e82809e2 [term 1 FOLLOWER]: Refusing update from remote peer 7f4a390317fb44429480ca1ff43c01c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:43:11.056103 4654 consensus_queue.cc:1035] T d3460eac0f1749578f39742207f756ac P 7f4a390317fb44429480ca1ff43c01c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7939bc8b48b44291a5696834e82809e2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:43:11.056319 4650 consensus_queue.cc:1035] T d3460eac0f1749578f39742207f756ac P 7f4a390317fb44429480ca1ff43c01c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f5a7ad44b7a48dd84022268de5053c5" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 37015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 04:43:11.060365 4609 tablet.cc:2369] T d3460eac0f1749578f39742207f756ac P 7f4a390317fb44429480ca1ff43c01c1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:43:11.063943 4659 mvcc.cc:205] Tried to move back new op lower bound from 7316128526555860992 to 7316128526458781696. Current Snapshot: MvccSnapshot[applied={T|T < 7316128526555860992}]
I20260808 04:43:11.074486 3821 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50848:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:43:11.074636 3821 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50848:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:43:11.076936 3821 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f: Sending DeleteTablet for 3 replicas of tablet d3460eac0f1749578f39742207f756ac
I20260808 04:43:11.077777 4490 tablet_service.cc:1514] Processing DeleteTablet for tablet d3460eac0f1749578f39742207f756ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:43:11 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:39222
I20260808 04:43:11.077845 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 3927
I20260808 04:43:11.077778 4274 tablet_service.cc:1514] Processing DeleteTablet for tablet d3460eac0f1749578f39742207f756ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:43:11 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:42082
I20260808 04:43:11.086850 4673 tablet_replica.cc:330] T d3460eac0f1749578f39742207f756ac P 4f5a7ad44b7a48dd84022268de5053c5: stopping tablet replica
I20260808 04:43:11.087204 4673 raft_consensus.cc:2229] T d3460eac0f1749578f39742207f756ac P 4f5a7ad44b7a48dd84022268de5053c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:43:11.087502 4673 raft_consensus.cc:2258] T d3460eac0f1749578f39742207f756ac P 4f5a7ad44b7a48dd84022268de5053c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:43:11.089033 4673 ts_tablet_manager.cc:1905] T d3460eac0f1749578f39742207f756ac P 4f5a7ad44b7a48dd84022268de5053c5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:43:11.091358 4673 ts_tablet_manager.cc:1918] T d3460eac0f1749578f39742207f756ac P 4f5a7ad44b7a48dd84022268de5053c5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:43:11.091432 4673 log.cc:1196] T d3460eac0f1749578f39742207f756ac P 4f5a7ad44b7a48dd84022268de5053c5: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/wal/wals/d3460eac0f1749578f39742207f756ac
I20260808 04:43:11.091677 4673 ts_tablet_manager.cc:1939] T d3460eac0f1749578f39742207f756ac P 4f5a7ad44b7a48dd84022268de5053c5: Deleting consensus metadata
I20260808 04:43:11.092777 3800 catalog_manager.cc:4841] TS 4f5a7ad44b7a48dd84022268de5053c5 (127.12.148.66:37015): tablet d3460eac0f1749578f39742207f756ac (table test-table [id=c61dc0b34f2f4fadac84d72da1c0a6be]) successfully deleted
W20260808 04:43:11.093680 3795 connection.cc:535] client connection to 127.12.148.65:37349 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 04:43:11.093823 3795 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 04:43:11.094785 4634 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:43:11.094510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:37349 (local address 127.0.0.1:39194)
0808 04:43:11.094650 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:11.094711 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.65:37349: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":58}
W20260808 04:43:11.094945 3795 catalog_manager.cc:4584] TS 7939bc8b48b44291a5696834e82809e2 (127.12.148.65:37349): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d3460eac0f1749578f39742207f756ac: Network error: Client connection negotiation failed: client connection to 127.12.148.65:37349: connect: Connection reset by peer (error 104)
I20260808 04:43:11.095276 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 4160
I20260808 04:43:11.095346 4676 tablet_replica.cc:330] T d3460eac0f1749578f39742207f756ac P 7f4a390317fb44429480ca1ff43c01c1: stopping tablet replica
I20260808 04:43:11.095685 4676 raft_consensus.cc:2229] T d3460eac0f1749578f39742207f756ac P 7f4a390317fb44429480ca1ff43c01c1 [term 1 LEADER]: Raft consensus shutting down.
I20260808 04:43:11.096076 4676 raft_consensus.cc:2258] T d3460eac0f1749578f39742207f756ac P 7f4a390317fb44429480ca1ff43c01c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:43:11.101550 4676 ts_tablet_manager.cc:1905] T d3460eac0f1749578f39742207f756ac P 7f4a390317fb44429480ca1ff43c01c1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:43:11.104300 4676 ts_tablet_manager.cc:1918] T d3460eac0f1749578f39742207f756ac P 7f4a390317fb44429480ca1ff43c01c1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:43:11.104405 4676 log.cc:1196] T d3460eac0f1749578f39742207f756ac P 7f4a390317fb44429480ca1ff43c01c1: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/wal/wals/d3460eac0f1749578f39742207f756ac
I20260808 04:43:11.104748 4676 ts_tablet_manager.cc:1939] T d3460eac0f1749578f39742207f756ac P 7f4a390317fb44429480ca1ff43c01c1: Deleting consensus metadata
I20260808 04:43:11.105265 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 4380
I20260808 04:43:11.117030 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 3771
I20260808 04:43:31.131965 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:40217
--webserver_interface=127.12.148.126
--webserver_port=43499
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:40841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:40217
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:43:31.242888 4680 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:43:31.243152 4680 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:43:31.243196 4680 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:43:31.247306 4680 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 04:43:31.247370 4680 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 04:43:31.247393 4680 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 04:43:31.247411 4680 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:43:31.247435 4680 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:43:31.247467 4680 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:43:31.247490 4680 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:43:31.247509 4680 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:43:31.253479 4680 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:40841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:40217
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:40217
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=43499
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4680
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:43:31.254590 4680 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:43:31.255648 4680 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:43:31.269883 4692 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:31.269857 4688 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:43:31.269938 4680 server_base.cc:1034] running on GCE node
W20260808 04:43:31.269834 4690 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:43:31.270666 4680 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:43:31.271816 4680 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:43:31.272989 4680 hybrid_clock.cc:648] HybridClock initialized: now 1786164211272958 us; error 44 us; skew 500 ppm
Aug 08 04:43:31 dist-test-slave-t7g5 krb5kdc[3750](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164211, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:43:31.275884 4680 init.cc:377] Logged in from keytab as kudu/127.12.148.126@KRBTEST.COM (short username kudu)
I20260808 04:43:31.276813 4680 webserver.cc:460] Webserver started at http://127.12.148.126:43499/ using document root <none> and password file <none>
I20260808 04:43:31.277401 4680 fs_manager.cc:359] Metadata directory not provided
I20260808 04:43:31.277490 4680 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:43:31.281472 4680 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.001s
I20260808 04:43:31.283658 4704 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:31.284938 4680 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:43:31.285072 4680 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "45dae89a5cd24dafb440ac6802ae999f"
format_stamp: "Formatted at 2026-08-08 04:43:10 on dist-test-slave-t7g5"
server_key: "d21579006ad6f02e2e2a802893d63174"
server_key_iv: "bc4fdbe3a1d3fe57f13cc3e58a067c83"
server_key_version: "encryptionkey@0"
I20260808 04:43:31.285724 4680 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:43:31.303364 4680 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:43:31.306636 4680 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:43:31.306833 4680 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:43:31.314222 4680 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:40217
I20260808 04:43:31.314559 4789 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:40217 every 8 connection(s)
I20260808 04:43:31.315368 4680 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:43:31.319742 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 4680
I20260808 04:43:31.319772 4792 sys_catalog.cc:263] Verifying existing consensus state
I20260808 04:43:31.320186 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.65:37349
--local_ip_for_outbound_sockets=127.12.148.65
--tserver_master_addrs=127.12.148.126:40217
--webserver_port=42665
--webserver_interface=127.12.148.65
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:40841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 04:43:31.321517 4792 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f: Bootstrap starting.
I20260808 04:43:31.343741 4792 log.cc:824] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f: Log is configured to *not* fsync() on all Append() calls
I20260808 04:43:31.355054 4792 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 04:43:31.355521 4792 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f: Bootstrap complete.
I20260808 04:43:31.360993 4792 raft_consensus.cc:348] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45dae89a5cd24dafb440ac6802ae999f" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40217 } }
I20260808 04:43:31.361512 4792 raft_consensus.cc:729] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45dae89a5cd24dafb440ac6802ae999f, State: Initialized, Role: FOLLOWER
I20260808 04:43:31.362097 4792 consensus_queue.cc:260] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45dae89a5cd24dafb440ac6802ae999f" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40217 } }
I20260808 04:43:31.362250 4792 raft_consensus.cc:388] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:43:31.362326 4792 raft_consensus.cc:482] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:43:31.362425 4792 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [term 1 FOLLOWER]: Advancing to term 2
I20260808 04:43:31.364948 4792 raft_consensus.cc:504] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45dae89a5cd24dafb440ac6802ae999f" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40217 } }
I20260808 04:43:31.365322 4792 leader_election.cc:302] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 45dae89a5cd24dafb440ac6802ae999f; no voters:
I20260808 04:43:31.365698 4792 leader_election.cc:288] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 04:43:31.365819 4796 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [term 2 FOLLOWER]: Leader election won for term 2
I20260808 04:43:31.366060 4796 raft_consensus.cc:686] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [term 2 LEADER]: Becoming Leader. State: Replica: 45dae89a5cd24dafb440ac6802ae999f, State: Running, Role: LEADER
I20260808 04:43:31.366389 4796 consensus_queue.cc:237] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45dae89a5cd24dafb440ac6802ae999f" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40217 } }
I20260808 04:43:31.366986 4792 sys_catalog.cc:564] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:43:31.367851 4803 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 45dae89a5cd24dafb440ac6802ae999f. Latest consensus state: current_term: 2 leader_uuid: "45dae89a5cd24dafb440ac6802ae999f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45dae89a5cd24dafb440ac6802ae999f" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40217 } } }
I20260808 04:43:31.367902 4802 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "45dae89a5cd24dafb440ac6802ae999f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45dae89a5cd24dafb440ac6802ae999f" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40217 } } }
I20260808 04:43:31.367992 4802 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [sys.catalog]: This master's current role is: LEADER
I20260808 04:43:31.367992 4803 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [sys.catalog]: This master's current role is: LEADER
I20260808 04:43:31.371810 4821 catalog_manager.cc:1259] Loaded cluster ID: d3cac24476aa41888d762950dcd15845
I20260808 04:43:31.371863 4821 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f: loading cluster ID for follower catalog manager: success
I20260808 04:43:31.373579 4821 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f: acquiring CA information for follower catalog manager: success
I20260808 04:43:31.374774 4821 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 04:43:31.374903 4812 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:43:31.377250 4812 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:43:31.377784 4812 catalog_manager.cc:1259] Loaded cluster ID: d3cac24476aa41888d762950dcd15845
I20260808 04:43:31.377851 4812 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:43:31.378505 4812 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:43:31.378966 4812 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f: Loaded TSK: 0
I20260808 04:43:31.393380 4812 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f: Generated new TSK 1
I20260808 04:43:31.393646 4812 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 04:43:31.453917 4794 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:43:31.454180 4794 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:43:31.454223 4794 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:43:31.458259 4794 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:43:31.458319 4794 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:43:31.458386 4794 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.65
I20260808 04:43:31.463582 4794 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:40841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.65:37349
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.148.65
--webserver_port=42665
--tserver_master_addrs=127.12.148.126:40217
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4794
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.65
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:43:31.464600 4794 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:43:31.465730 4794 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:43:31.475018 4840 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:31.475096 4838 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:31.475132 4842 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:43:31.475409 4794 server_base.cc:1034] running on GCE node
I20260808 04:43:31.475896 4794 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:43:31.476485 4794 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:43:31.477675 4794 hybrid_clock.cc:648] HybridClock initialized: now 1786164211477632 us; error 33 us; skew 500 ppm
Aug 08 04:43:31 dist-test-slave-t7g5 krb5kdc[3750](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164211, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:43:31.480309 4794 init.cc:377] Logged in from keytab as kudu/127.12.148.65@KRBTEST.COM (short username kudu)
I20260808 04:43:31.481148 4794 webserver.cc:460] Webserver started at http://127.12.148.65:42665/ using document root <none> and password file <none>
I20260808 04:43:31.481705 4794 fs_manager.cc:359] Metadata directory not provided
I20260808 04:43:31.481786 4794 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:43:31.485436 4794 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:43:31.487469 4852 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:31.488708 4794 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 04:43:31.488804 4794 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/wal
uuid: "7939bc8b48b44291a5696834e82809e2"
format_stamp: "Formatted at 2026-08-08 04:43:10 on dist-test-slave-t7g5"
server_key: "64cdd24abb3cf39e90d902562f12179c"
server_key_iv: "97e70c07e2cf51f88e0087197f07f8c5"
server_key_version: "encryptionkey@0"
I20260808 04:43:31.489318 4794 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:43:31.502915 4794 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:43:31.505982 4794 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:43:31.506155 4794 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:43:31.506747 4794 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:43:31.507962 4866 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 04:43:31.512085 4794 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 04:43:31.512167 4794 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.001s sys 0.000s
I20260808 04:43:31.512252 4794 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 04:43:31.514092 4794 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 04:43:31.514147 4794 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.002s sys 0.000s
I20260808 04:43:31.514416 4866 tablet_bootstrap.cc:492] T d3460eac0f1749578f39742207f756ac P 7939bc8b48b44291a5696834e82809e2: Bootstrap starting.
I20260808 04:43:31.525131 4794 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.65:37349
I20260808 04:43:31.525194 5036 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.65:37349 every 8 connection(s)
I20260808 04:43:31.526221 4794 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
I20260808 04:43:31.528479 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 4794
I20260808 04:43:31.529035 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.66:37015
--local_ip_for_outbound_sockets=127.12.148.66
--tserver_master_addrs=127.12.148.126:40217
--webserver_port=42741
--webserver_interface=127.12.148.66
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:40841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 04:43:31.532076 4866 log.cc:824] T d3460eac0f1749578f39742207f756ac P 7939bc8b48b44291a5696834e82809e2: Log is configured to *not* fsync() on all Append() calls
I20260808 04:43:31.540022 4866 tablet_bootstrap.cc:492] T d3460eac0f1749578f39742207f756ac P 7939bc8b48b44291a5696834e82809e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
Aug 08 04:43:31 dist-test-slave-t7g5 krb5kdc[3750](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164211, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:43:31.540432 4866 tablet_bootstrap.cc:492] T d3460eac0f1749578f39742207f756ac P 7939bc8b48b44291a5696834e82809e2: Bootstrap complete.
I20260808 04:43:31.541575 4866 ts_tablet_manager.cc:1397] T d3460eac0f1749578f39742207f756ac P 7939bc8b48b44291a5696834e82809e2: Time spent bootstrapping tablet: real 0.027s user 0.014s sys 0.009s
I20260808 04:43:31.544595 4866 raft_consensus.cc:348] T d3460eac0f1749578f39742207f756ac P 7939bc8b48b44291a5696834e82809e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f4a390317fb44429480ca1ff43c01c1" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44961 } } peers { permanent_uuid: "7939bc8b48b44291a5696834e82809e2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 37349 } } peers { permanent_uuid: "4f5a7ad44b7a48dd84022268de5053c5" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 37015 } }
I20260808 04:43:31.545171 4866 raft_consensus.cc:729] T d3460eac0f1749578f39742207f756ac P 7939bc8b48b44291a5696834e82809e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7939bc8b48b44291a5696834e82809e2, State: Initialized, Role: FOLLOWER
I20260808 04:43:31.545711 4866 consensus_queue.cc:260] T d3460eac0f1749578f39742207f756ac P 7939bc8b48b44291a5696834e82809e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f4a390317fb44429480ca1ff43c01c1" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44961 } } peers { permanent_uuid: "7939bc8b48b44291a5696834e82809e2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 37349 } } peers { permanent_uuid: "4f5a7ad44b7a48dd84022268de5053c5" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 37015 } }
I20260808 04:43:31.546795 4866 ts_tablet_manager.cc:1428] T d3460eac0f1749578f39742207f756ac P 7939bc8b48b44291a5696834e82809e2: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260808 04:43:31.547075 5045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:31.528255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.65:59169)
0808 04:43:31.529492 (+ 1237us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:31.529565 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:31.530739 (+ 1174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:31.532308 (+ 1569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:43:31.532317 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:43:31.532789 (+ 472us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:43:31.533437 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:31.533457 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:31.535352 (+ 1895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:31.535357 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:31.536732 (+ 1375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:31.536745 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:31.537821 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:31.537825 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:31.538060 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:31.538765 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:43:31.538787 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:43:31.540751 (+ 1964us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:43:31.543459 (+ 2708us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:43:31.543465 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:43:31.543479 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:43:31.543830 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:43:31.544280 (+ 450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:43:31.544284 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:43:31.544286 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:43:31.544461 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:43:31.545281 (+ 820us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:43:31.545288 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:43:31.545585 (+ 297us) client_negotiation.cc:769] Sending connection context
0808 04:43:31.545803 (+ 218us) client_negotiation.cc:240] Negotiation successful
0808 04:43:31.546144 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":814,"thread_start_us":170,"threads_started":1}
I20260808 04:43:31.547601 5040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:31.528301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:59169 (local address 127.12.148.126:40217)
0808 04:43:31.528912 (+ 611us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:31.528932 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:31.529735 (+ 803us) server_negotiation.cc:407] Connection header received
0808 04:43:31.531292 (+ 1557us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:31.531310 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:31.531766 (+ 456us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:31.532162 (+ 396us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:43:31.533639 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:31.535158 (+ 1519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:31.536877 (+ 1719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:31.537626 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:31.537854 (+ 228us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:31.540971 (+ 3117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:43:31.540978 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:43:31.540994 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:43:31.541030 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:43:31.543306 (+ 2276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:31.543976 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:31.543983 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:31.543990 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:31.544160 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:31.544558 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:31.544561 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:31.544563 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:31.545052 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:43:31.545210 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:31.546065 (+ 855us) server_negotiation.cc:299] Negotiation successful
0808 04:43:31.546394 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":449,"thread_start_us":173,"threads_started":1}
I20260808 04:43:31.549628 5037 heartbeater.cc:347] Connected to a master server at 127.12.148.126:40217
I20260808 04:43:31.549911 5037 heartbeater.cc:464] Registering TS with master...
I20260808 04:43:31.550451 5037 heartbeater.cc:511] Master 127.12.148.126:40217 requested a full tablet report, sending...
I20260808 04:43:31.553026 4731 ts_manager.cc:194] Registered new tserver with Master: 7939bc8b48b44291a5696834e82809e2 (127.12.148.65:37349)
I20260808 04:43:31.556370 4731 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.65@KRBTEST.COM'} at 127.12.148.65:59169
I20260808 04:43:31.559015 5037 heartbeater.cc:503] Master 127.12.148.126:40217 was elected leader, sending a full tablet report...
Aug 08 04:43:31 dist-test-slave-t7g5 krb5kdc[3750](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164211, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for kudu/127.12.148.65@KRBTEST.COM
I20260808 04:43:31.566588 5054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:31.555796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:37349 (local address 127.0.0.1:60870)
0808 04:43:31.556547 (+ 751us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:31.556588 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:31.556723 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:31.557219 (+ 496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:43:31.557225 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:43:31.557602 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:43:31.557775 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:31.557783 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:31.558955 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:31.558959 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:31.559786 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:31.559797 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:31.560646 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:31.560650 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:31.560762 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:31.561277 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:43:31.561292 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:43:31.562906 (+ 1614us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:43:31.564663 (+ 1757us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:43:31.564672 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:43:31.564677 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:43:31.565003 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:43:31.565328 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:43:31.565331 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:43:31.565333 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:43:31.565432 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:43:31.565922 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:43:31.565929 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:43:31.566056 (+ 127us) client_negotiation.cc:769] Sending connection context
0808 04:43:31.566215 (+ 159us) client_negotiation.cc:240] Negotiation successful
0808 04:43:31.566414 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":583,"thread_start_us":136,"threads_started":1}
I20260808 04:43:31.566784 5055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:31.555895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60870 (local address 127.12.148.65:37349)
0808 04:43:31.556293 (+ 398us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:31.556304 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:31.556686 (+ 382us) server_negotiation.cc:407] Connection header received
0808 04:43:31.556860 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:31.556865 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:31.557070 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:31.557202 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:43:31.557894 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:31.558848 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:31.559934 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:31.560415 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:31.560518 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:31.563058 (+ 2540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:43:31.563067 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:43:31.563077 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:43:31.563099 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:43:31.564560 (+ 1461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:31.565131 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:31.565136 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:31.565137 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:31.565226 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:31.565525 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:31.565528 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:31.565529 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:31.565807 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:43:31.565912 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:31.566371 (+ 459us) server_negotiation.cc:299] Negotiation successful
0808 04:43:31.566522 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298,"thread_start_us":112,"threads_started":1}
I20260808 04:43:31.567698 4937 tablet_service.cc:1514] Processing DeleteTablet for tablet d3460eac0f1749578f39742207f756ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:43:11 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:60870
I20260808 04:43:31.568590 5056 tablet_replica.cc:330] stopping tablet replica
I20260808 04:43:31.568943 5056 raft_consensus.cc:2229] T d3460eac0f1749578f39742207f756ac P 7939bc8b48b44291a5696834e82809e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:43:31.569304 5056 raft_consensus.cc:2258] T d3460eac0f1749578f39742207f756ac P 7939bc8b48b44291a5696834e82809e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:43:31.570442 5056 ts_tablet_manager.cc:1905] T d3460eac0f1749578f39742207f756ac P 7939bc8b48b44291a5696834e82809e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:43:31.574983 5056 ts_tablet_manager.cc:1918] T d3460eac0f1749578f39742207f756ac P 7939bc8b48b44291a5696834e82809e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:43:31.575086 5056 log.cc:1196] T d3460eac0f1749578f39742207f756ac P 7939bc8b48b44291a5696834e82809e2: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/wal/wals/d3460eac0f1749578f39742207f756ac
I20260808 04:43:31.575338 5056 ts_tablet_manager.cc:1939] T d3460eac0f1749578f39742207f756ac P 7939bc8b48b44291a5696834e82809e2: Deleting consensus metadata
I20260808 04:43:31.577244 4706 catalog_manager.cc:4841] TS 7939bc8b48b44291a5696834e82809e2 (127.12.148.65:37349): tablet d3460eac0f1749578f39742207f756ac (table test-table [id=c61dc0b34f2f4fadac84d72da1c0a6be]) successfully deleted
W20260808 04:43:31.651271 5047 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:43:31.651520 5047 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:43:31.651559 5047 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:43:31.655509 5047 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:43:31.655572 5047 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:43:31.655630 5047 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.66
I20260808 04:43:31.660753 5047 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:40841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.66:37015
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.148.66
--webserver_port=42741
--tserver_master_addrs=127.12.148.126:40217
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5047
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.66
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:43:31.661809 5047 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:43:31.662823 5047 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 04:43:31.672348 5047 server_base.cc:1034] running on GCE node
W20260808 04:43:31.672307 5068 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:31.672312 5066 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:31.672312 5065 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:43:31.672921 5047 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:43:31.673540 5047 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:43:31.674696 5047 hybrid_clock.cc:648] HybridClock initialized: now 1786164211674677 us; error 34 us; skew 500 ppm
Aug 08 04:43:31 dist-test-slave-t7g5 krb5kdc[3750](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164211, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:43:31.677454 5047 init.cc:377] Logged in from keytab as kudu/127.12.148.66@KRBTEST.COM (short username kudu)
I20260808 04:43:31.678297 5047 webserver.cc:460] Webserver started at http://127.12.148.66:42741/ using document root <none> and password file <none>
I20260808 04:43:31.678822 5047 fs_manager.cc:359] Metadata directory not provided
I20260808 04:43:31.678900 5047 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:43:31.682634 5047 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260808 04:43:31.684597 5080 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:31.685820 5047 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 04:43:31.685920 5047 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/wal
uuid: "4f5a7ad44b7a48dd84022268de5053c5"
format_stamp: "Formatted at 2026-08-08 04:43:10 on dist-test-slave-t7g5"
server_key: "9520535ee10b4545d3373cdf7bc7fc51"
server_key_iv: "d85d7d6f35016e9814f4b493cea4241e"
server_key_version: "encryptionkey@0"
I20260808 04:43:31.686442 5047 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:43:31.706566 5047 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:43:31.709540 5047 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:43:31.709780 5047 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:43:31.710433 5047 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:43:31.711333 5047 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:43:31.711387 5047 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:31.711436 5047 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:43:31.711470 5047 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:31.720713 5047 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.66:37015
I20260808 04:43:31.720764 5247 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.66:37015 every 8 connection(s)
I20260808 04:43:31.721812 5047 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
I20260808 04:43:31.727530 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 5047
I20260808 04:43:31.727958 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.67:44961
--local_ip_for_outbound_sockets=127.12.148.67
--tserver_master_addrs=127.12.148.126:40217
--webserver_port=33001
--webserver_interface=127.12.148.67
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:40841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 04:43:31 dist-test-slave-t7g5 krb5kdc[3750](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164211, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:43:31.736733 5040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:31.723676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:35453 (local address 127.12.148.126:40217)
0808 04:43:31.723874 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:31.723878 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:31.724654 (+ 776us) server_negotiation.cc:407] Connection header received
0808 04:43:31.726067 (+ 1413us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:31.726070 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:31.726132 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:31.726204 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:43:31.727399 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:31.727964 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:31.729188 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:31.729445 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:31.729535 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:31.732275 (+ 2740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:43:31.732279 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:43:31.732280 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:43:31.732310 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:43:31.733858 (+ 1548us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:31.734559 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:31.734564 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:31.734566 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:31.734693 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:31.735128 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:31.735132 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:31.735134 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:31.735414 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:43:31.735532 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:31.736295 (+ 763us) server_negotiation.cc:299] Negotiation successful
0808 04:43:31.736491 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107}
I20260808 04:43:31.737752 5252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:31.724052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.66:35453)
0808 04:43:31.724500 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:31.724543 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:31.725854 (+ 1311us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:31.726396 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:43:31.726403 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:43:31.726776 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:43:31.727250 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:31.727265 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:31.728171 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:31.728174 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:31.729071 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:31.729081 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:31.729590 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:31.729594 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:31.729802 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:31.730373 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:43:31.730389 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:43:31.732088 (+ 1699us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:43:31.733991 (+ 1903us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:43:31.733997 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:43:31.734012 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:43:31.734431 (+ 419us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:43:31.734820 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:43:31.734823 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:43:31.734824 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:43:31.735023 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:43:31.735597 (+ 574us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:43:31.735605 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:43:31.735957 (+ 352us) client_negotiation.cc:769] Sending connection context
0808 04:43:31.736187 (+ 230us) client_negotiation.cc:240] Negotiation successful
0808 04:43:31.736584 (+ 397us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":114,"threads_started":1}
I20260808 04:43:31.739120 5250 heartbeater.cc:347] Connected to a master server at 127.12.148.126:40217
I20260808 04:43:31.739351 5250 heartbeater.cc:464] Registering TS with master...
I20260808 04:43:31.739809 5250 heartbeater.cc:511] Master 127.12.148.126:40217 requested a full tablet report, sending...
I20260808 04:43:31.740780 4731 ts_manager.cc:194] Registered new tserver with Master: 4f5a7ad44b7a48dd84022268de5053c5 (127.12.148.66:37015)
I20260808 04:43:31.741367 4731 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.66@KRBTEST.COM'} at 127.12.148.66:35453
W20260808 04:43:31.844286 5255 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:43:31.844547 5255 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:43:31.844587 5255 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:43:31.848589 5255 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:43:31.848647 5255 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:43:31.848708 5255 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.67
I20260808 04:43:31.853820 5255 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:40841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.67:44961
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.148.67
--webserver_port=33001
--tserver_master_addrs=127.12.148.126:40217
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5255
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.67
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:43:31.854792 5255 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:43:31.855792 5255 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:43:31.865247 5267 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:31.865283 5265 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:43:31.865551 5255 server_base.cc:1034] running on GCE node
W20260808 04:43:31.865283 5264 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:43:31.866032 5255 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:43:31.866665 5255 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:43:31.867795 5255 hybrid_clock.cc:648] HybridClock initialized: now 1786164211867756 us; error 50 us; skew 500 ppm
Aug 08 04:43:31 dist-test-slave-t7g5 krb5kdc[3750](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164211, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:43:31.870631 5255 init.cc:377] Logged in from keytab as kudu/127.12.148.67@KRBTEST.COM (short username kudu)
I20260808 04:43:31.871444 5255 webserver.cc:460] Webserver started at http://127.12.148.67:33001/ using document root <none> and password file <none>
I20260808 04:43:31.871958 5255 fs_manager.cc:359] Metadata directory not provided
I20260808 04:43:31.872032 5255 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:43:31.875780 5255 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260808 04:43:31.877851 5278 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:31.879006 5255 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:43:31.879112 5255 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/wal
uuid: "7f4a390317fb44429480ca1ff43c01c1"
format_stamp: "Formatted at 2026-08-08 04:43:10 on dist-test-slave-t7g5"
server_key: "67f0d728e0dbef6beae78c8e4595c93f"
server_key_iv: "7454afa2f62a2ea7754f0bf393f3016a"
server_key_version: "encryptionkey@0"
I20260808 04:43:31.879629 5255 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:43:31.892047 5255 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:43:31.895147 5255 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:43:31.895303 5255 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:43:31.895902 5255 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:43:31.896704 5255 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:43:31.896760 5255 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:31.896808 5255 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:43:31.896827 5255 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:31.905203 5255 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.67:44961
I20260808 04:43:31.905230 5475 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.67:44961 every 8 connection(s)
I20260808 04:43:31.906260 5255 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
Aug 08 04:43:31 dist-test-slave-t7g5 krb5kdc[3750](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164211, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:43:31.915934 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 5255
I20260808 04:43:31.919946 5040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:31.908036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:49031 (local address 127.12.148.126:40217)
0808 04:43:31.908169 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:31.908173 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:31.909039 (+ 866us) server_negotiation.cc:407] Connection header received
0808 04:43:31.910380 (+ 1341us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:31.910383 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:31.910434 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:31.910509 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:43:31.911719 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:31.912246 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:31.913418 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:31.913628 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:31.913727 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:31.916170 (+ 2443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:43:31.916173 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:43:31.916175 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:43:31.916199 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:43:31.917792 (+ 1593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:31.918356 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:31.918360 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:31.918362 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:31.918459 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:31.918787 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:31.918790 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:31.918791 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:31.918991 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:43:31.919065 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:31.919660 (+ 595us) server_negotiation.cc:299] Negotiation successful
0808 04:43:31.919792 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 04:43:31.920897 5479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:31.908418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.67:49031)
0808 04:43:31.908890 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:31.908932 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:31.910183 (+ 1251us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:31.910704 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:43:31.910711 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:43:31.911112 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:43:31.911592 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:31.911606 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:31.912380 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:31.912383 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:31.913319 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:31.913330 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:31.913798 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:31.913802 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:31.913964 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:31.914496 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:43:31.914514 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:43:31.916004 (+ 1490us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:43:31.917902 (+ 1898us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:43:31.917909 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:43:31.917924 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:43:31.918266 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:43:31.918548 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:43:31.918550 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:43:31.918551 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:43:31.918679 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:43:31.919084 (+ 405us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:43:31.919091 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:43:31.919407 (+ 316us) client_negotiation.cc:769] Sending connection context
0808 04:43:31.919608 (+ 201us) client_negotiation.cc:240] Negotiation successful
0808 04:43:31.919935 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":114,"threads_started":1}
I20260808 04:43:31.922135 5476 heartbeater.cc:347] Connected to a master server at 127.12.148.126:40217
I20260808 04:43:31.922398 5476 heartbeater.cc:464] Registering TS with master...
I20260808 04:43:31.923026 5476 heartbeater.cc:511] Master 127.12.148.126:40217 requested a full tablet report, sending...
I20260808 04:43:31.924067 4731 ts_manager.cc:194] Registered new tserver with Master: 7f4a390317fb44429480ca1ff43c01c1 (127.12.148.67:44961)
I20260808 04:43:31.924693 5482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:31.916587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36716 (local address 127.12.148.126:40217)
0808 04:43:31.916823 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:31.916827 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:31.917028 (+ 201us) server_negotiation.cc:407] Connection header received
0808 04:43:31.917162 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:31.917165 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:31.917214 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:31.917337 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:43:31.918149 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:31.918800 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:31.919876 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:31.920180 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:31.920279 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:31.921581 (+ 1302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:43:31.921585 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:43:31.921588 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:43:31.921610 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:43:31.923144 (+ 1534us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:31.923541 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:31.923545 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:31.923547 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:31.923631 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:31.923886 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:31.923889 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:31.923891 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:31.924092 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:43:31.924304 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:31.924422 (+ 118us) server_negotiation.cc:299] Negotiation successful
0808 04:43:31.924539 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":68,"threads_started":1}
I20260808 04:43:31.924768 4731 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.67@KRBTEST.COM'} at 127.12.148.67:49031
I20260808 04:43:31.926417 12881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 04:43:31.929898 5482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:31.926989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36724 (local address 127.12.148.126:40217)
0808 04:43:31.927089 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:31.927092 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:31.927250 (+ 158us) server_negotiation.cc:407] Connection header received
0808 04:43:31.927368 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:31.927370 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:31.927455 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:31.927530 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:43:31.927672 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:31.928131 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:31.928972 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:31.929177 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:31.929240 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:31.929455 (+ 215us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:43:31.929569 (+ 114us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0808 04:43:31.929808 (+ 239us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:36724: token expired
Metrics: {"server-negotiator.queue_time_us":35}
W20260808 04:43:31.929952 5482 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:36724: token expired
W20260808 04:43:31.930337 4613 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.12.148.126:40217)
I20260808 04:43:31.936866 5482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:31.930656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36740 (local address 127.12.148.126:40217)
0808 04:43:31.930750 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:31.930754 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:31.930777 (+ 23us) server_negotiation.cc:407] Connection header received
0808 04:43:31.930861 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:31.930863 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:31.930894 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:31.930951 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:43:31.931454 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:31.931897 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:31.932586 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:31.932774 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:31.932834 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:31.934213 (+ 1379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:43:31.934216 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:43:31.934218 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:43:31.934240 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:43:31.935585 (+ 1345us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:31.936007 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:31.936009 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:31.936011 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:31.936079 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:31.936265 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:31.936266 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:31.936267 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:31.936429 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:43:31.936523 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:31.936669 (+ 146us) server_negotiation.cc:299] Negotiation successful
0808 04:43:31.936756 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 04:43:31.939291 4730 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36740:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:43:31.942448 4730 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:43:31.949970 4937 tablet_service.cc:1467] Processing CreateTablet for tablet 0353bbd0d61246228365c2bc33a50e9c (DEFAULT_TABLE table=test-table [id=e48375757d22437897138b62126ce255]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:43:31.950659 4937 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0353bbd0d61246228365c2bc33a50e9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:43:31.953593 4866 tablet_bootstrap.cc:492] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2: Bootstrap starting.
I20260808 04:43:31.953675 5494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:31.949018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.67:44961 (local address 127.0.0.1:48648)
0808 04:43:31.949442 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:31.949456 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:31.949537 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:31.950181 (+ 644us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:43:31.950184 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:43:31.950201 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:43:31.950316 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:31.950323 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:31.951366 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:31.951369 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:31.952417 (+ 1048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:31.952427 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:31.953204 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:31.953208 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:31.953301 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:31.953344 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 04:43:31.953421 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 04:43:31.953493 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":366,"mutex_wait_us":2,"thread_start_us":82,"threads_started":1}
I20260808 04:43:31.953711 5497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:31.949307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48648 (local address 127.12.148.67:44961)
0808 04:43:31.949796 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:31.949806 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:31.949824 (+ 18us) server_negotiation.cc:407] Connection header received
0808 04:43:31.949884 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:31.949887 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:31.950036 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:31.950174 (+ 138us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:43:31.950421 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:31.951251 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:31.952537 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:31.953086 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:31.953184 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:31.953350 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:31.953457 (+ 107us) server_negotiation.cc:299] Negotiation successful
0808 04:43:31.953548 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":390,"thread_start_us":158,"threads_started":1}
I20260808 04:43:31.954474 4866 tablet_bootstrap.cc:654] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2: Neither blocks nor log segments found. Creating new log.
I20260808 04:43:31.954502 5054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:31.948702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:37015 (local address 127.0.0.1:38374)
0808 04:43:31.948882 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:31.948912 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:31.948995 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:31.950346 (+ 1351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:43:31.950349 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:43:31.950368 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:43:31.950476 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:31.950482 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:31.951979 (+ 1497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:31.951982 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:31.953042 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:31.953053 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:31.954132 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:31.954136 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:31.954240 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:31.954262 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 04:43:31.954311 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 04:43:31.954387 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110}
I20260808 04:43:31.955209 5495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:31.949191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38374 (local address 127.12.148.66:37015)
0808 04:43:31.949720 (+ 529us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:31.949733 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:31.949757 (+ 24us) server_negotiation.cc:407] Connection header received
0808 04:43:31.949833 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:31.949839 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:31.950061 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:31.950624 (+ 563us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:43:31.950789 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:31.951829 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:31.953195 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:31.953996 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:31.954753 (+ 757us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:31.954926 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:31.954978 (+ 52us) server_negotiation.cc:299] Negotiation successful
0808 04:43:31.955064 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":111,"threads_started":1}
I20260808 04:43:31.955977 4866 tablet_bootstrap.cc:492] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2: No bootstrap required, opened a new log
I20260808 04:43:31.956060 4866 ts_tablet_manager.cc:1397] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 04:43:31.956483 4866 raft_consensus.cc:348] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f5a7ad44b7a48dd84022268de5053c5" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 37015 } } peers { permanent_uuid: "7f4a390317fb44429480ca1ff43c01c1" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44961 } } peers { permanent_uuid: "7939bc8b48b44291a5696834e82809e2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 37349 } }
I20260808 04:43:31.956595 4866 raft_consensus.cc:374] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:43:31.956632 4866 raft_consensus.cc:729] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7939bc8b48b44291a5696834e82809e2, State: Initialized, Role: FOLLOWER
I20260808 04:43:31.956755 4866 consensus_queue.cc:260] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f5a7ad44b7a48dd84022268de5053c5" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 37015 } } peers { permanent_uuid: "7f4a390317fb44429480ca1ff43c01c1" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44961 } } peers { permanent_uuid: "7939bc8b48b44291a5696834e82809e2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 37349 } }
I20260808 04:43:31.956657 5362 tablet_service.cc:1467] Processing CreateTablet for tablet 0353bbd0d61246228365c2bc33a50e9c (DEFAULT_TABLE table=test-table [id=e48375757d22437897138b62126ce255]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:43:31.957419 4866 ts_tablet_manager.cc:1428] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 04:43:31.958077 5362 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0353bbd0d61246228365c2bc33a50e9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:43:31.958038 5149 tablet_service.cc:1467] Processing CreateTablet for tablet 0353bbd0d61246228365c2bc33a50e9c (DEFAULT_TABLE table=test-table [id=e48375757d22437897138b62126ce255]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:43:31.958989 5149 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0353bbd0d61246228365c2bc33a50e9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:43:31.964607 5500 tablet_bootstrap.cc:492] T 0353bbd0d61246228365c2bc33a50e9c P 7f4a390317fb44429480ca1ff43c01c1: Bootstrap starting.
I20260808 04:43:31.965088 5503 tablet_bootstrap.cc:492] T 0353bbd0d61246228365c2bc33a50e9c P 4f5a7ad44b7a48dd84022268de5053c5: Bootstrap starting.
I20260808 04:43:31.966660 5500 tablet_bootstrap.cc:654] T 0353bbd0d61246228365c2bc33a50e9c P 7f4a390317fb44429480ca1ff43c01c1: Neither blocks nor log segments found. Creating new log.
I20260808 04:43:31.967530 5503 tablet_bootstrap.cc:654] T 0353bbd0d61246228365c2bc33a50e9c P 4f5a7ad44b7a48dd84022268de5053c5: Neither blocks nor log segments found. Creating new log.
I20260808 04:43:31.967830 5500 log.cc:824] T 0353bbd0d61246228365c2bc33a50e9c P 7f4a390317fb44429480ca1ff43c01c1: Log is configured to *not* fsync() on all Append() calls
I20260808 04:43:31.968262 5503 log.cc:824] T 0353bbd0d61246228365c2bc33a50e9c P 4f5a7ad44b7a48dd84022268de5053c5: Log is configured to *not* fsync() on all Append() calls
I20260808 04:43:31.969691 5500 tablet_bootstrap.cc:492] T 0353bbd0d61246228365c2bc33a50e9c P 7f4a390317fb44429480ca1ff43c01c1: No bootstrap required, opened a new log
I20260808 04:43:31.969861 5500 ts_tablet_manager.cc:1397] T 0353bbd0d61246228365c2bc33a50e9c P 7f4a390317fb44429480ca1ff43c01c1: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260808 04:43:31.970000 5503 tablet_bootstrap.cc:492] T 0353bbd0d61246228365c2bc33a50e9c P 4f5a7ad44b7a48dd84022268de5053c5: No bootstrap required, opened a new log
I20260808 04:43:31.970170 5503 ts_tablet_manager.cc:1397] T 0353bbd0d61246228365c2bc33a50e9c P 4f5a7ad44b7a48dd84022268de5053c5: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 04:43:31.972702 5500 raft_consensus.cc:348] T 0353bbd0d61246228365c2bc33a50e9c P 7f4a390317fb44429480ca1ff43c01c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f5a7ad44b7a48dd84022268de5053c5" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 37015 } } peers { permanent_uuid: "7f4a390317fb44429480ca1ff43c01c1" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44961 } } peers { permanent_uuid: "7939bc8b48b44291a5696834e82809e2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 37349 } }
I20260808 04:43:31.972920 5500 raft_consensus.cc:374] T 0353bbd0d61246228365c2bc33a50e9c P 7f4a390317fb44429480ca1ff43c01c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:43:31.972961 5500 raft_consensus.cc:729] T 0353bbd0d61246228365c2bc33a50e9c P 7f4a390317fb44429480ca1ff43c01c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f4a390317fb44429480ca1ff43c01c1, State: Initialized, Role: FOLLOWER
I20260808 04:43:31.973181 5503 raft_consensus.cc:348] T 0353bbd0d61246228365c2bc33a50e9c P 4f5a7ad44b7a48dd84022268de5053c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f5a7ad44b7a48dd84022268de5053c5" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 37015 } } peers { permanent_uuid: "7f4a390317fb44429480ca1ff43c01c1" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44961 } } peers { permanent_uuid: "7939bc8b48b44291a5696834e82809e2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 37349 } }
I20260808 04:43:31.973321 5500 consensus_queue.cc:260] T 0353bbd0d61246228365c2bc33a50e9c P 7f4a390317fb44429480ca1ff43c01c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f5a7ad44b7a48dd84022268de5053c5" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 37015 } } peers { permanent_uuid: "7f4a390317fb44429480ca1ff43c01c1" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44961 } } peers { permanent_uuid: "7939bc8b48b44291a5696834e82809e2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 37349 } }
I20260808 04:43:31.973388 5503 raft_consensus.cc:374] T 0353bbd0d61246228365c2bc33a50e9c P 4f5a7ad44b7a48dd84022268de5053c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:43:31.973449 5503 raft_consensus.cc:729] T 0353bbd0d61246228365c2bc33a50e9c P 4f5a7ad44b7a48dd84022268de5053c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f5a7ad44b7a48dd84022268de5053c5, State: Initialized, Role: FOLLOWER
I20260808 04:43:31.973863 5503 consensus_queue.cc:260] T 0353bbd0d61246228365c2bc33a50e9c P 4f5a7ad44b7a48dd84022268de5053c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f5a7ad44b7a48dd84022268de5053c5" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 37015 } } peers { permanent_uuid: "7f4a390317fb44429480ca1ff43c01c1" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44961 } } peers { permanent_uuid: "7939bc8b48b44291a5696834e82809e2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 37349 } }
I20260808 04:43:31.973951 5476 heartbeater.cc:503] Master 127.12.148.126:40217 was elected leader, sending a full tablet report...
I20260808 04:43:31.974255 5500 ts_tablet_manager.cc:1428] T 0353bbd0d61246228365c2bc33a50e9c P 7f4a390317fb44429480ca1ff43c01c1: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260808 04:43:31.974562 5250 heartbeater.cc:503] Master 127.12.148.126:40217 was elected leader, sending a full tablet report...
I20260808 04:43:31.975709 5503 ts_tablet_manager.cc:1428] T 0353bbd0d61246228365c2bc33a50e9c P 4f5a7ad44b7a48dd84022268de5053c5: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
W20260808 04:43:32.027458 5039 tablet.cc:2369] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:43:32.033289 5052 raft_consensus.cc:482] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:43:32.033490 5052 raft_consensus.cc:504] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f5a7ad44b7a48dd84022268de5053c5" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 37015 } } peers { permanent_uuid: "7f4a390317fb44429480ca1ff43c01c1" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44961 } } peers { permanent_uuid: "7939bc8b48b44291a5696834e82809e2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 37349 } }
I20260808 04:43:32.034713 5052 leader_election.cc:288] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f5a7ad44b7a48dd84022268de5053c5 (127.12.148.66:37015), 7f4a390317fb44429480ca1ff43c01c1 (127.12.148.67:44961)
I20260808 04:43:32.038403 5045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:32.034946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:37015 (local address 127.12.148.65:44963)
0808 04:43:32.035130 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:32.035145 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:32.035250 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:32.035539 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:43:32.035542 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:43:32.035561 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:43:32.035680 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:32.035685 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:32.036392 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:32.036396 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:32.037251 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:32.037260 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:32.037911 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:32.037914 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:32.038062 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:32.038105 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 04:43:32.038170 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 04:43:32.038242 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"mutex_wait_us":49}
I20260808 04:43:32.038403 5495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:32.035094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:44963 (local address 127.12.148.66:37015)
0808 04:43:32.035221 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:32.035225 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:32.035241 (+ 16us) server_negotiation.cc:407] Connection header received
0808 04:43:32.035381 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:32.035384 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:32.035430 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:32.035505 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:43:32.035788 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:32.036279 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:32.037376 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:32.037803 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:32.037911 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:32.037966 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:32.038199 (+ 233us) server_negotiation.cc:299] Negotiation successful
0808 04:43:32.038269 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 04:43:32.038403 5497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:32.035070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:40899 (local address 127.12.148.67:44961)
0808 04:43:32.035201 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:32.035206 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:32.035399 (+ 193us) server_negotiation.cc:407] Connection header received
0808 04:43:32.035543 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:32.035547 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:32.035587 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:32.035649 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:43:32.035922 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:32.036389 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:32.037421 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:32.037834 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:32.037948 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:32.037997 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:32.038219 (+ 222us) server_negotiation.cc:299] Negotiation successful
0808 04:43:32.038286 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 04:43:32.038434 5511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:32.034970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.67:44961 (local address 127.12.148.65:40899)
0808 04:43:32.035297 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:32.035308 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:32.035429 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:32.035673 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:43:32.035675 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:43:32.035692 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:43:32.035809 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:32.035814 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:32.036496 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:32.036499 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:32.037295 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:32.037304 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:32.037948 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:32.037952 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:32.038105 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:32.038123 (+ 18us) client_negotiation.cc:769] Sending connection context
0808 04:43:32.038189 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 04:43:32.038257 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"mutex_wait_us":42,"thread_start_us":88,"threads_started":1}
I20260808 04:43:32.039000 5399 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0353bbd0d61246228365c2bc33a50e9c" candidate_uuid: "7939bc8b48b44291a5696834e82809e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f4a390317fb44429480ca1ff43c01c1" is_pre_election: true
I20260808 04:43:32.038997 5177 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0353bbd0d61246228365c2bc33a50e9c" candidate_uuid: "7939bc8b48b44291a5696834e82809e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f5a7ad44b7a48dd84022268de5053c5" is_pre_election: true
I20260808 04:43:32.039269 5177 raft_consensus.cc:2454] T 0353bbd0d61246228365c2bc33a50e9c P 4f5a7ad44b7a48dd84022268de5053c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7939bc8b48b44291a5696834e82809e2 in term 0.
I20260808 04:43:32.039278 5399 raft_consensus.cc:2454] T 0353bbd0d61246228365c2bc33a50e9c P 7f4a390317fb44429480ca1ff43c01c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7939bc8b48b44291a5696834e82809e2 in term 0.
I20260808 04:43:32.039729 4853 leader_election.cc:302] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7939bc8b48b44291a5696834e82809e2, 7f4a390317fb44429480ca1ff43c01c1; no voters:
I20260808 04:43:32.040002 5052 raft_consensus.cc:2781] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:43:32.040083 5052 raft_consensus.cc:482] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:43:32.040131 5052 raft_consensus.cc:3037] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:43:32.041153 5052 raft_consensus.cc:504] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f5a7ad44b7a48dd84022268de5053c5" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 37015 } } peers { permanent_uuid: "7f4a390317fb44429480ca1ff43c01c1" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44961 } } peers { permanent_uuid: "7939bc8b48b44291a5696834e82809e2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 37349 } }
I20260808 04:43:32.041478 5052 leader_election.cc:288] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [CANDIDATE]: Term 1 election: Requested vote from peers 4f5a7ad44b7a48dd84022268de5053c5 (127.12.148.66:37015), 7f4a390317fb44429480ca1ff43c01c1 (127.12.148.67:44961)
I20260808 04:43:32.041829 5177 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0353bbd0d61246228365c2bc33a50e9c" candidate_uuid: "7939bc8b48b44291a5696834e82809e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f5a7ad44b7a48dd84022268de5053c5"
I20260808 04:43:32.041836 5399 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0353bbd0d61246228365c2bc33a50e9c" candidate_uuid: "7939bc8b48b44291a5696834e82809e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f4a390317fb44429480ca1ff43c01c1"
I20260808 04:43:32.041950 5177 raft_consensus.cc:3037] T 0353bbd0d61246228365c2bc33a50e9c P 4f5a7ad44b7a48dd84022268de5053c5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:43:32.041950 5399 raft_consensus.cc:3037] T 0353bbd0d61246228365c2bc33a50e9c P 7f4a390317fb44429480ca1ff43c01c1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:43:32.043182 5177 raft_consensus.cc:2454] T 0353bbd0d61246228365c2bc33a50e9c P 4f5a7ad44b7a48dd84022268de5053c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7939bc8b48b44291a5696834e82809e2 in term 1.
I20260808 04:43:32.043182 5399 raft_consensus.cc:2454] T 0353bbd0d61246228365c2bc33a50e9c P 7f4a390317fb44429480ca1ff43c01c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7939bc8b48b44291a5696834e82809e2 in term 1.
I20260808 04:43:32.043489 4853 leader_election.cc:302] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7939bc8b48b44291a5696834e82809e2, 7f4a390317fb44429480ca1ff43c01c1; no voters:
I20260808 04:43:32.043684 5052 raft_consensus.cc:2781] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:43:32.043905 5052 raft_consensus.cc:686] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [term 1 LEADER]: Becoming Leader. State: Replica: 7939bc8b48b44291a5696834e82809e2, State: Running, Role: LEADER
I20260808 04:43:32.044144 5052 consensus_queue.cc:237] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f5a7ad44b7a48dd84022268de5053c5" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 37015 } } peers { permanent_uuid: "7f4a390317fb44429480ca1ff43c01c1" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44961 } } peers { permanent_uuid: "7939bc8b48b44291a5696834e82809e2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 37349 } }
I20260808 04:43:32.046995 4730 catalog_manager.cc:5495] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7939bc8b48b44291a5696834e82809e2 (127.12.148.65). New cstate: current_term: 1 leader_uuid: "7939bc8b48b44291a5696834e82809e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f5a7ad44b7a48dd84022268de5053c5" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 37015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f4a390317fb44429480ca1ff43c01c1" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7939bc8b48b44291a5696834e82809e2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 37349 } health_report { overall_health: HEALTHY } } }
I20260808 04:43:32.077761 5519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:32.074383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60886 (local address 127.12.148.65:37349)
0808 04:43:32.074619 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:32.074622 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:32.074636 (+ 14us) server_negotiation.cc:407] Connection header received
0808 04:43:32.074708 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:32.074710 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:32.074773 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:32.074878 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:43:32.075044 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:32.075556 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:32.076329 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:32.076586 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:32.076661 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:32.076931 (+ 270us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:43:32.077367 (+ 436us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:43:32.077462 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:32.077532 (+ 70us) server_negotiation.cc:299] Negotiation successful
0808 04:43:32.077581 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":80,"threads_started":1}
I20260808 04:43:32.081614 5399 raft_consensus.cc:1261] T 0353bbd0d61246228365c2bc33a50e9c P 7f4a390317fb44429480ca1ff43c01c1 [term 1 FOLLOWER]: Refusing update from remote peer 7939bc8b48b44291a5696834e82809e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:43:32.081614 5177 raft_consensus.cc:1261] T 0353bbd0d61246228365c2bc33a50e9c P 4f5a7ad44b7a48dd84022268de5053c5 [term 1 FOLLOWER]: Refusing update from remote peer 7939bc8b48b44291a5696834e82809e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:43:32.082443 5512 consensus_queue.cc:1035] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f4a390317fb44429480ca1ff43c01c1" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:43:32.082624 5052 consensus_queue.cc:1035] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f5a7ad44b7a48dd84022268de5053c5" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 37015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:43:32.090842 5520 mvcc.cc:205] Tried to move back new op lower bound from 7316128612679520256 to 7316128612535422976. Current Snapshot: MvccSnapshot[applied={T|T < 7316128612679520256}]
I20260808 04:43:32.099486 4730 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36740:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:43:32.099671 4730 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36740:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:43:32.101959 4730 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f: Sending DeleteTablet for 3 replicas of tablet 0353bbd0d61246228365c2bc33a50e9c
I20260808 04:43:32.102604 5149 tablet_service.cc:1514] Processing DeleteTablet for tablet 0353bbd0d61246228365c2bc33a50e9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:43:32 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:38374
I20260808 04:43:32.102754 5362 tablet_service.cc:1514] Processing DeleteTablet for tablet 0353bbd0d61246228365c2bc33a50e9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:43:32 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:48648
I20260808 04:43:32.103201 4937 tablet_service.cc:1514] Processing DeleteTablet for tablet 0353bbd0d61246228365c2bc33a50e9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:43:32 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:60870
I20260808 04:43:32.103304 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 4794
I20260808 04:43:32.107208 5536 tablet_replica.cc:330] T 0353bbd0d61246228365c2bc33a50e9c P 7f4a390317fb44429480ca1ff43c01c1: stopping tablet replica
I20260808 04:43:32.107537 5536 raft_consensus.cc:2229] T 0353bbd0d61246228365c2bc33a50e9c P 7f4a390317fb44429480ca1ff43c01c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:43:32.107824 5536 raft_consensus.cc:2258] T 0353bbd0d61246228365c2bc33a50e9c P 7f4a390317fb44429480ca1ff43c01c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:43:32.112577 5536 ts_tablet_manager.cc:1905] T 0353bbd0d61246228365c2bc33a50e9c P 7f4a390317fb44429480ca1ff43c01c1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:43:32.115170 5535 tablet_replica.cc:330] T 0353bbd0d61246228365c2bc33a50e9c P 4f5a7ad44b7a48dd84022268de5053c5: stopping tablet replica
I20260808 04:43:32.115609 5535 raft_consensus.cc:2229] T 0353bbd0d61246228365c2bc33a50e9c P 4f5a7ad44b7a48dd84022268de5053c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:43:32.115943 5536 ts_tablet_manager.cc:1918] T 0353bbd0d61246228365c2bc33a50e9c P 7f4a390317fb44429480ca1ff43c01c1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:43:32.116015 5535 raft_consensus.cc:2258] T 0353bbd0d61246228365c2bc33a50e9c P 4f5a7ad44b7a48dd84022268de5053c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:43:32.116053 5536 log.cc:1196] T 0353bbd0d61246228365c2bc33a50e9c P 7f4a390317fb44429480ca1ff43c01c1: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/wal/wals/0353bbd0d61246228365c2bc33a50e9c
I20260808 04:43:32.116416 5536 ts_tablet_manager.cc:1939] T 0353bbd0d61246228365c2bc33a50e9c P 7f4a390317fb44429480ca1ff43c01c1: Deleting consensus metadata
I20260808 04:43:32.117609 5535 ts_tablet_manager.cc:1905] T 0353bbd0d61246228365c2bc33a50e9c P 4f5a7ad44b7a48dd84022268de5053c5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:43:32.117873 4706 catalog_manager.cc:4841] TS 7f4a390317fb44429480ca1ff43c01c1 (127.12.148.67:44961): tablet 0353bbd0d61246228365c2bc33a50e9c (table test-table [id=e48375757d22437897138b62126ce255]) successfully deleted
I20260808 04:43:32.119762 5535 ts_tablet_manager.cc:1918] T 0353bbd0d61246228365c2bc33a50e9c P 4f5a7ad44b7a48dd84022268de5053c5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:43:32.119859 5535 log.cc:1196] T 0353bbd0d61246228365c2bc33a50e9c P 4f5a7ad44b7a48dd84022268de5053c5: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/wal/wals/0353bbd0d61246228365c2bc33a50e9c
I20260808 04:43:32.120148 5535 ts_tablet_manager.cc:1939] T 0353bbd0d61246228365c2bc33a50e9c P 4f5a7ad44b7a48dd84022268de5053c5: Deleting consensus metadata
W20260808 04:43:32.121021 4706 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.148.65:37349 (error 108)
I20260808 04:43:32.121322 4712 catalog_manager.cc:4841] TS 4f5a7ad44b7a48dd84022268de5053c5 (127.12.148.66:37015): tablet 0353bbd0d61246228365c2bc33a50e9c (table test-table [id=e48375757d22437897138b62126ce255]) successfully deleted
I20260808 04:43:32.121906 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 5047
I20260808 04:43:32.122079 5054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:32.121783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:37349 (local address 127.0.0.1:60902)
0808 04:43:32.121920 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:32.121997 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.65:37349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260808 04:43:32.131366 4706 catalog_manager.cc:4584] TS 7939bc8b48b44291a5696834e82809e2 (127.12.148.65:37349): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0353bbd0d61246228365c2bc33a50e9c: Network error: Client connection negotiation failed: client connection to 127.12.148.65:37349: connect: Connection refused (error 111)
I20260808 04:43:32.138365 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 5255
I20260808 04:43:32.153815 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 4680
I20260808 04:43:52.165517 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:40217
--webserver_interface=127.12.148.126
--webserver_port=43499
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:40841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:40217
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:43:52.280681 5538 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:43:52.280968 5538 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:43:52.281013 5538 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:43:52.284984 5538 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 04:43:52.285048 5538 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 04:43:52.285063 5538 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 04:43:52.285075 5538 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:43:52.285096 5538 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:43:52.285130 5538 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:43:52.285157 5538 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:43:52.285182 5538 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:43:52.290509 5538 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:40841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:40217
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:40217
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=43499
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5538
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:43:52.291613 5538 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:43:52.292663 5538 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:43:52.301194 5549 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:52.301186 5546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:52.301183 5547 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:43:52.301537 5538 server_base.cc:1034] running on GCE node
I20260808 04:43:52.302134 5538 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:43:52.303260 5538 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:43:52.304436 5538 hybrid_clock.cc:648] HybridClock initialized: now 1786164232304399 us; error 34 us; skew 500 ppm
Aug 08 04:43:52 dist-test-slave-t7g5 krb5kdc[3750](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164232, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:43:52.307197 5538 init.cc:377] Logged in from keytab as kudu/127.12.148.126@KRBTEST.COM (short username kudu)
I20260808 04:43:52.308099 5538 webserver.cc:460] Webserver started at http://127.12.148.126:43499/ using document root <none> and password file <none>
I20260808 04:43:52.308650 5538 fs_manager.cc:359] Metadata directory not provided
I20260808 04:43:52.308715 5538 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:43:52.312660 5538 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 04:43:52.314975 5571 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:52.316572 5538 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 04:43:52.316704 5538 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "45dae89a5cd24dafb440ac6802ae999f"
format_stamp: "Formatted at 2026-08-08 04:43:10 on dist-test-slave-t7g5"
server_key: "d21579006ad6f02e2e2a802893d63174"
server_key_iv: "bc4fdbe3a1d3fe57f13cc3e58a067c83"
server_key_version: "encryptionkey@0"
I20260808 04:43:52.317292 5538 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:43:52.333446 5538 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:43:52.336741 5538 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:43:52.336930 5538 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:43:52.344113 5538 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:40217
I20260808 04:43:52.344389 5676 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:40217 every 8 connection(s)
I20260808 04:43:52.345260 5538 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:43:52.349697 5678 sys_catalog.cc:263] Verifying existing consensus state
I20260808 04:43:52.351403 5678 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f: Bootstrap starting.
I20260808 04:43:52.352988 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 5538
I20260808 04:43:52.353420 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.65:37349
--local_ip_for_outbound_sockets=127.12.148.65
--tserver_master_addrs=127.12.148.126:40217
--webserver_port=42665
--webserver_interface=127.12.148.65
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:40841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 04:43:52.368716 5678 log.cc:824] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f: Log is configured to *not* fsync() on all Append() calls
I20260808 04:43:52.380471 5678 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 04:43:52.380825 5678 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f: Bootstrap complete.
I20260808 04:43:52.384688 5678 raft_consensus.cc:348] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45dae89a5cd24dafb440ac6802ae999f" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40217 } }
I20260808 04:43:52.385085 5678 raft_consensus.cc:729] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45dae89a5cd24dafb440ac6802ae999f, State: Initialized, Role: FOLLOWER
I20260808 04:43:52.385577 5678 consensus_queue.cc:260] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45dae89a5cd24dafb440ac6802ae999f" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40217 } }
I20260808 04:43:52.385738 5678 raft_consensus.cc:388] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:43:52.385812 5678 raft_consensus.cc:482] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:43:52.385910 5678 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [term 2 FOLLOWER]: Advancing to term 3
I20260808 04:43:52.387765 5678 raft_consensus.cc:504] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45dae89a5cd24dafb440ac6802ae999f" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40217 } }
I20260808 04:43:52.388093 5678 leader_election.cc:302] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 45dae89a5cd24dafb440ac6802ae999f; no voters:
I20260808 04:43:52.388418 5678 leader_election.cc:288] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 04:43:52.388531 5683 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [term 3 FOLLOWER]: Leader election won for term 3
I20260808 04:43:52.388716 5683 raft_consensus.cc:686] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [term 3 LEADER]: Becoming Leader. State: Replica: 45dae89a5cd24dafb440ac6802ae999f, State: Running, Role: LEADER
I20260808 04:43:52.389014 5683 consensus_queue.cc:237] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45dae89a5cd24dafb440ac6802ae999f" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40217 } }
I20260808 04:43:52.389693 5678 sys_catalog.cc:564] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:43:52.390041 5685 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 45dae89a5cd24dafb440ac6802ae999f. Latest consensus state: current_term: 3 leader_uuid: "45dae89a5cd24dafb440ac6802ae999f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45dae89a5cd24dafb440ac6802ae999f" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40217 } } }
I20260808 04:43:52.390172 5685 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [sys.catalog]: This master's current role is: LEADER
I20260808 04:43:52.390453 5684 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "45dae89a5cd24dafb440ac6802ae999f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45dae89a5cd24dafb440ac6802ae999f" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 40217 } } }
I20260808 04:43:52.390563 5684 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f [sys.catalog]: This master's current role is: LEADER
I20260808 04:43:52.391822 5689 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:43:52.396934 5689 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:43:52.397595 5689 catalog_manager.cc:1259] Loaded cluster ID: d3cac24476aa41888d762950dcd15845
I20260808 04:43:52.397688 5689 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:43:52.400775 5689 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:43:52.401582 5689 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f: Loaded TSK: 0
I20260808 04:43:52.401682 5689 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 45dae89a5cd24dafb440ac6802ae999f: Loaded TSK: 1
F20260808 04:43:52.402408 5689 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fa7453f09ad google::LogMessage::Fail() at ??:0
@ 0x7fa7453f388a google::LogMessage::SendToLog() at ??:0
@ 0x7fa7453f04de google::LogMessage::Flush() at ??:0
@ 0x7fa7453f1a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fa7480b418d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fa7480acf0d kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7fa74fd557bb kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7fa74fd2f99c kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7fa74fd30178 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlvE3_clEv at ??:0
@ 0x7fa74fd71df8 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7fa74fd9082b std::function<>::operator()() at ??:0
@ 0x7fa74fd2fb4f _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7fa74fd30f3e kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fa74fd2d579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7fa74fd71640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fa7476423d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fa747642c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7fa7476443f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fa747633512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fa748c776db start_thread at ??:0
@ 0x7fa743eee61f clone at ??:0
W20260808 04:43:52.504423 5680 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:43:52.504707 5680 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:43:52.504755 5680 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:43:52.508965 5680 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:43:52.509040 5680 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:43:52.509102 5680 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.65
I20260808 04:43:52.514667 5680 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:40841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.65:37349
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.148.65
--webserver_port=42665
--tserver_master_addrs=127.12.148.126:40217
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5680
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.65
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:43:52.515812 5680 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:43:52.516919 5680 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:43:52.526454 5770 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:52.526446 5772 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:52.526500 5767 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:43:52.527185 5680 server_base.cc:1034] running on GCE node
I20260808 04:43:52.527594 5680 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:43:52.528237 5680 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:43:52.529402 5680 hybrid_clock.cc:648] HybridClock initialized: now 1786164232529362 us; error 58 us; skew 500 ppm
Aug 08 04:43:52 dist-test-slave-t7g5 krb5kdc[3750](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164232, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:43:52.532384 5680 init.cc:377] Logged in from keytab as kudu/127.12.148.65@KRBTEST.COM (short username kudu)
I20260808 04:43:52.533555 5680 webserver.cc:460] Webserver started at http://127.12.148.65:42665/ using document root <none> and password file <none>
I20260808 04:43:52.534338 5680 fs_manager.cc:359] Metadata directory not provided
I20260808 04:43:52.534446 5680 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:43:52.539712 5680 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 04:43:52.542476 5781 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:52.544037 5680 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:43:52.544163 5680 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/wal
uuid: "7939bc8b48b44291a5696834e82809e2"
format_stamp: "Formatted at 2026-08-08 04:43:10 on dist-test-slave-t7g5"
server_key: "64cdd24abb3cf39e90d902562f12179c"
server_key_iv: "97e70c07e2cf51f88e0087197f07f8c5"
server_key_version: "encryptionkey@0"
I20260808 04:43:52.544878 5680 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:43:52.563109 5680 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:43:52.566715 5680 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:43:52.566933 5680 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:43:52.567663 5680 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:43:52.568971 5806 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 04:43:52.573069 5680 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 04:43:52.573148 5680 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.001s sys 0.000s
I20260808 04:43:52.573220 5680 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 04:43:52.575536 5680 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 04:43:52.575596 5680 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20260808 04:43:52.575874 5806 tablet_bootstrap.cc:492] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2: Bootstrap starting.
I20260808 04:43:52.586601 5680 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.65:37349
I20260808 04:43:52.586769 6008 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.65:37349 every 8 connection(s)
I20260808 04:43:52.587859 5680 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
I20260808 04:43:52.591486 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 5680
I20260808 04:43:52.592020 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.66:37015
--local_ip_for_outbound_sockets=127.12.148.66
--tserver_master_addrs=127.12.148.126:40217
--webserver_port=42741
--webserver_interface=127.12.148.66
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:40841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 04:43:52.595371 5806 log.cc:824] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2: Log is configured to *not* fsync() on all Append() calls
I20260808 04:43:52.604521 5806 tablet_bootstrap.cc:492] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 04:43:52.605001 5806 tablet_bootstrap.cc:492] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2: Bootstrap complete.
I20260808 04:43:52.606361 5806 ts_tablet_manager.cc:1397] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2: Time spent bootstrapping tablet: real 0.031s user 0.026s sys 0.004s
I20260808 04:43:52.609637 5806 raft_consensus.cc:348] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f5a7ad44b7a48dd84022268de5053c5" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 37015 } } peers { permanent_uuid: "7f4a390317fb44429480ca1ff43c01c1" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44961 } } peers { permanent_uuid: "7939bc8b48b44291a5696834e82809e2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 37349 } }
I20260808 04:43:52.610220 5806 raft_consensus.cc:729] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7939bc8b48b44291a5696834e82809e2, State: Initialized, Role: FOLLOWER
I20260808 04:43:52.610746 5806 consensus_queue.cc:260] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f5a7ad44b7a48dd84022268de5053c5" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 37015 } } peers { permanent_uuid: "7f4a390317fb44429480ca1ff43c01c1" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44961 } } peers { permanent_uuid: "7939bc8b48b44291a5696834e82809e2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 37349 } }
I20260808 04:43:52.611873 5806 ts_tablet_manager.cc:1428] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2: Time spent starting tablet: real 0.005s user 0.001s sys 0.004s
W20260808 04:43:52.649474 6011 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:43:52.590259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.65:48457)
0808 04:43:52.590847 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:52.590909 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:52.592073 (+ 1164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:52.648708 (+ 56635us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":153,"threads_started":1}
W20260808 04:43:52.649986 6009 heartbeater.cc:644] Failed to heartbeat to 127.12.148.126:40217 (0 consecutive failures): Network error: Failed to ping master at 127.12.148.126:40217: Client connection negotiation failed: client connection to 127.12.148.126:40217: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 04:43:52.650715 6011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:52.650479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.65:56729)
0808 04:43:52.650597 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:52.650662 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260808 04:43:52.651350 6011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:52.651175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.65:49447)
0808 04:43:52.651261 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:52.651302 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260808 04:43:52.651505 6009 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 04:43:52.715886 6012 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:43:52.716166 6012 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:43:52.716212 6012 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:43:52.720229 6012 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:43:52.720299 6012 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:43:52.720367 6012 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.66
I20260808 04:43:52.725868 6012 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:40841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.66:37015
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.148.66
--webserver_port=42741
--tserver_master_addrs=127.12.148.126:40217
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6012
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.66
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:43:52.726897 6012 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:43:52.727907 6012 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:43:52.737355 6027 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:52.737349 6023 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:52.737349 6022 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:43:52.737713 6012 server_base.cc:1034] running on GCE node
I20260808 04:43:52.738065 6012 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:43:52.738682 6012 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:43:52.739840 6012 hybrid_clock.cc:648] HybridClock initialized: now 1786164232739821 us; error 31 us; skew 500 ppm
Aug 08 04:43:52 dist-test-slave-t7g5 krb5kdc[3750](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164232, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:43:52.742692 6012 init.cc:377] Logged in from keytab as kudu/127.12.148.66@KRBTEST.COM (short username kudu)
I20260808 04:43:52.743552 6012 webserver.cc:460] Webserver started at http://127.12.148.66:42741/ using document root <none> and password file <none>
I20260808 04:43:52.744182 6012 fs_manager.cc:359] Metadata directory not provided
I20260808 04:43:52.744325 6012 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:43:52.748208 6012 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:43:52.750315 6042 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:52.751564 6012 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:43:52.751672 6012 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/wal
uuid: "4f5a7ad44b7a48dd84022268de5053c5"
format_stamp: "Formatted at 2026-08-08 04:43:10 on dist-test-slave-t7g5"
server_key: "9520535ee10b4545d3373cdf7bc7fc51"
server_key_iv: "d85d7d6f35016e9814f4b493cea4241e"
server_key_version: "encryptionkey@0"
I20260808 04:43:52.752216 6012 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:43:52.762638 6012 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:43:52.765326 6012 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:43:52.765496 6012 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:43:52.766124 6012 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:43:52.766927 6012 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:43:52.766983 6012 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:52.767026 6012 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:43:52.767057 6012 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:52.775831 6012 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.66:37015
I20260808 04:43:52.775854 6259 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.66:37015 every 8 connection(s)
I20260808 04:43:52.776839 6012 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
I20260808 04:43:52.780710 6266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:52.778981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.66:37459)
0808 04:43:52.779440 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:52.779551 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":110,"threads_started":1}
W20260808 04:43:52.781189 6260 heartbeater.cc:644] Failed to heartbeat to 127.12.148.126:40217 (0 consecutive failures): Network error: Failed to ping master at 127.12.148.126:40217: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
I20260808 04:43:52.781767 6266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:52.781543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.66:48371)
0808 04:43:52.781647 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:52.781713 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 04:43:52.782442 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 6012
I20260808 04:43:52.782717 6266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:52.782163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.66:54413)
0808 04:43:52.782619 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:52.782665 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":392}
I20260808 04:43:52.782845 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.67:44961
--local_ip_for_outbound_sockets=127.12.148.67
--tserver_master_addrs=127.12.148.126:40217
--webserver_port=33001
--webserver_interface=127.12.148.67
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:40841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:43:52.782922 6260 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 04:43:52.894637 6267 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:43:52.894928 6267 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:43:52.894989 6267 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:43:52.899091 6267 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:43:52.899170 6267 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:43:52.899252 6267 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.67
I20260808 04:43:52.904649 6267 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:40841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.67:44961
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.148.67
--webserver_port=33001
--tserver_master_addrs=127.12.148.126:40217
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6267
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.67
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:43:52.905778 6267 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:43:52.906824 6267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:43:52.916361 6282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:43:52.916383 6274 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:43:52.916620 6267 server_base.cc:1034] running on GCE node
W20260808 04:43:52.916666 6279 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:43:52.917179 6267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:43:52.917855 6267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:43:52.919041 6267 hybrid_clock.cc:648] HybridClock initialized: now 1786164232919004 us; error 45 us; skew 500 ppm
Aug 08 04:43:52 dist-test-slave-t7g5 krb5kdc[3750](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164232, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:43:52.921846 6267 init.cc:377] Logged in from keytab as kudu/127.12.148.67@KRBTEST.COM (short username kudu)
I20260808 04:43:52.922690 6267 webserver.cc:460] Webserver started at http://127.12.148.67:33001/ using document root <none> and password file <none>
I20260808 04:43:52.923247 6267 fs_manager.cc:359] Metadata directory not provided
I20260808 04:43:52.923317 6267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:43:52.927146 6267 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 04:43:52.929147 6291 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:52.930392 6267 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:43:52.930495 6267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/wal
uuid: "7f4a390317fb44429480ca1ff43c01c1"
format_stamp: "Formatted at 2026-08-08 04:43:10 on dist-test-slave-t7g5"
server_key: "67f0d728e0dbef6beae78c8e4595c93f"
server_key_iv: "7454afa2f62a2ea7754f0bf393f3016a"
server_key_version: "encryptionkey@0"
I20260808 04:43:52.931031 6267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:43:52.949870 6267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:43:52.953038 6267 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:43:52.953212 6267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:43:52.953831 6267 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:43:52.954648 6267 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:43:52.954696 6267 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:52.954741 6267 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:43:52.954768 6267 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:43:52.963259 6267 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.67:44961
I20260808 04:43:52.963294 6486 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.67:44961 every 8 connection(s)
I20260808 04:43:52.964188 6267 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
I20260808 04:43:52.967900 6489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:52.966202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.67:36469)
0808 04:43:52.966629 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:52.966731 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":115,"threads_started":1}
W20260808 04:43:52.968309 6487 heartbeater.cc:644] Failed to heartbeat to 127.12.148.126:40217 (0 consecutive failures): Network error: Failed to ping master at 127.12.148.126:40217: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
I20260808 04:43:52.968868 6489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:52.968658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.67:40457)
0808 04:43:52.968746 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:52.968792 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260808 04:43:52.969381 6489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:52.969226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.67:35495)
0808 04:43:52.969301 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:52.969339 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 04:43:52.969552 6487 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 04:43:52.969889 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 6267
I20260808 04:43:53.652514 6495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:53.652096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.65:47761)
0808 04:43:53.652359 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:53.652412 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":80,"threads_started":1}
I20260808 04:43:53.783824 6496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:53.783440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.66:38727)
0808 04:43:53.783662 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:53.783718 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":69,"threads_started":1}
I20260808 04:43:53.942083 6499 raft_consensus.cc:482] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:43:53.942276 6499 raft_consensus.cc:504] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f5a7ad44b7a48dd84022268de5053c5" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 37015 } } peers { permanent_uuid: "7f4a390317fb44429480ca1ff43c01c1" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44961 } } peers { permanent_uuid: "7939bc8b48b44291a5696834e82809e2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 37349 } }
I20260808 04:43:53.943503 6499 leader_election.cc:288] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f5a7ad44b7a48dd84022268de5053c5 (127.12.148.66:37015), 7f4a390317fb44429480ca1ff43c01c1 (127.12.148.67:44961)
Aug 08 04:43:53 dist-test-slave-t7g5 krb5kdc[3750](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164232, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for kudu/127.12.148.66@KRBTEST.COM
Aug 08 04:43:53 dist-test-slave-t7g5 krb5kdc[3750](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164232, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for kudu/127.12.148.67@KRBTEST.COM
I20260808 04:43:53.961699 6502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:53.943752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.67:44961 (local address 127.12.148.65:53667)
0808 04:43:53.944046 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:53.944057 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:53.944127 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:53.945748 (+ 1621us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:43:53.945754 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:43:53.946323 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:43:53.946817 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:53.946831 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:53.948137 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:53.948139 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:53.949154 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:53.949164 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:53.950128 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:53.950131 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:53.950195 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:53.954546 (+ 4351us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:43:53.954565 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:43:53.956614 (+ 2049us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:43:53.958763 (+ 2149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:43:53.958766 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:43:53.958768 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:43:53.959071 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:43:53.959470 (+ 399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:43:53.959473 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:43:53.959475 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:43:53.959703 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:43:53.960472 (+ 769us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:43:53.960479 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:43:53.960880 (+ 401us) client_negotiation.cc:769] Sending connection context
0808 04:43:53.961103 (+ 223us) client_negotiation.cc:240] Negotiation successful
0808 04:43:53.961460 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"mutex_wait_us":214,"spinlock_wait_cycles":29696,"thread_start_us":76,"threads_started":1}
I20260808 04:43:53.961759 6504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:53.943920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:53667 (local address 127.12.148.67:44961)
0808 04:43:53.944307 (+ 387us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:53.944319 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:53.944356 (+ 37us) server_negotiation.cc:407] Connection header received
0808 04:43:53.944996 (+ 640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:53.945001 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:53.945357 (+ 356us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:53.945638 (+ 281us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:43:53.947000 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:53.947982 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:53.949304 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:53.949805 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:53.949992 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:53.956827 (+ 6835us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:43:53.956835 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:43:53.956851 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:43:53.956888 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:43:53.958667 (+ 1779us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:53.959189 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:53.959195 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:53.959201 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:53.959372 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:53.959795 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:53.959798 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:53.959800 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:53.960358 (+ 558us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:43:53.960499 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:53.961234 (+ 735us) server_negotiation.cc:299] Negotiation successful
0808 04:43:53.961541 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":112,"threads_started":1}
I20260808 04:43:53.961759 6503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:53.943877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:42541 (local address 127.12.148.66:37015)
0808 04:43:53.944308 (+ 431us) server_negotiation.cc:206] Beginning negotiation
0808 04:43:53.944329 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 04:43:53.944362 (+ 33us) server_negotiation.cc:407] Connection header received
0808 04:43:53.945059 (+ 697us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:43:53.945065 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:43:53.945362 (+ 297us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:43:53.945638 (+ 276us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:43:53.946997 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:53.947997 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:53.949278 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:43:53.949794 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:43:53.949948 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:53.956492 (+ 6544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:43:53.956498 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:43:53.956512 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:43:53.956544 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:43:53.958522 (+ 1978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:53.959189 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:53.959195 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:53.959201 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:53.959372 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:43:53.959795 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:43:53.959798 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:43:53.959800 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:43:53.960359 (+ 559us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:43:53.960499 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 04:43:53.961234 (+ 735us) server_negotiation.cc:299] Negotiation successful
0808 04:43:53.961541 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":325,"thread_start_us":101,"threads_started":1}
I20260808 04:43:53.961699 6495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:53.943674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:37015 (local address 127.12.148.65:42541)
0808 04:43:53.943924 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:53.943938 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:43:53.944056 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:43:53.945748 (+ 1692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:43:53.945754 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:43:53.946322 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:43:53.946816 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:53.946831 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:53.948129 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:53.948132 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:53.949152 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:43:53.949163 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:43:53.949928 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:43:53.949932 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:43:53.950110 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:43:53.954559 (+ 4449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:43:53.954579 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:43:53.956213 (+ 1634us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:43:53.958641 (+ 2428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:43:53.958646 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:43:53.958658 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:43:53.959071 (+ 413us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:43:53.959470 (+ 399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:43:53.959473 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:43:53.959475 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:43:53.959703 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:43:53.960472 (+ 769us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:43:53.960479 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:43:53.960880 (+ 401us) client_negotiation.cc:769] Sending connection context
0808 04:43:53.961103 (+ 223us) client_negotiation.cc:240] Negotiation successful
0808 04:43:53.961517 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"mutex_wait_us":270,"spinlock_wait_cycles":26624}
W20260808 04:43:53.964435 5786 leader_election.cc:341] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4f5a7ad44b7a48dd84022268de5053c5 (127.12.148.66:37015): Not found: Tablet not found: 0353bbd0d61246228365c2bc33a50e9c
W20260808 04:43:53.964581 5783 leader_election.cc:341] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7f4a390317fb44429480ca1ff43c01c1 (127.12.148.67:44961): Not found: Tablet not found: 0353bbd0d61246228365c2bc33a50e9c
I20260808 04:43:53.964658 5783 leader_election.cc:302] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7939bc8b48b44291a5696834e82809e2; no voters: 4f5a7ad44b7a48dd84022268de5053c5, 7f4a390317fb44429480ca1ff43c01c1
I20260808 04:43:53.964910 6499 raft_consensus.cc:2726] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 04:43:53.970320 6506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:53.969993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.67:48585)
0808 04:43:53.970190 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:53.970236 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":66,"threads_started":1}
I20260808 04:43:54.653750 6510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:54.653266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.65:40499)
0808 04:43:54.653552 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:54.653627 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":86,"threads_started":1}
I20260808 04:43:54.785028 6511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:54.784557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.66:53597)
0808 04:43:54.784852 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:54.784913 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":78,"threads_started":1}
I20260808 04:43:54.971357 6512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:54.970933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.67:48593)
0808 04:43:54.971189 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:54.971247 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":76,"threads_started":1}
I20260808 04:43:55.654946 6516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:55.654508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.65:34265)
0808 04:43:55.654782 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:55.654844 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":94,"threads_started":1}
I20260808 04:43:55.750631 6518 raft_consensus.cc:482] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:43:55.750772 6518 raft_consensus.cc:504] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f5a7ad44b7a48dd84022268de5053c5" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 37015 } } peers { permanent_uuid: "7f4a390317fb44429480ca1ff43c01c1" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44961 } } peers { permanent_uuid: "7939bc8b48b44291a5696834e82809e2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 37349 } }
I20260808 04:43:55.751168 6518 leader_election.cc:288] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f5a7ad44b7a48dd84022268de5053c5 (127.12.148.66:37015), 7f4a390317fb44429480ca1ff43c01c1 (127.12.148.67:44961)
W20260808 04:43:55.751945 5783 leader_election.cc:341] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7f4a390317fb44429480ca1ff43c01c1 (127.12.148.67:44961): Not found: Tablet not found: 0353bbd0d61246228365c2bc33a50e9c
W20260808 04:43:55.752065 5786 leader_election.cc:341] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4f5a7ad44b7a48dd84022268de5053c5 (127.12.148.66:37015): Not found: Tablet not found: 0353bbd0d61246228365c2bc33a50e9c
I20260808 04:43:55.752166 5786 leader_election.cc:302] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7939bc8b48b44291a5696834e82809e2; no voters: 4f5a7ad44b7a48dd84022268de5053c5, 7f4a390317fb44429480ca1ff43c01c1
I20260808 04:43:55.752316 6518 raft_consensus.cc:2726] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 04:43:55.786121 6521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:55.785694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.66:45021)
0808 04:43:55.785976 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:55.786028 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":90,"threads_started":1}
I20260808 04:43:55.972483 6525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:55.972062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.67:36019)
0808 04:43:55.972326 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:55.972385 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":77,"threads_started":1}
I20260808 04:43:56.656116 6526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:56.655658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.65:44703)
0808 04:43:56.655919 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:56.655980 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":92,"threads_started":1}
I20260808 04:43:56.787202 6527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:56.786794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.66:37247)
0808 04:43:56.787045 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:56.787100 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":75,"threads_started":1}
I20260808 04:43:56.973524 6528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:56.973142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.67:41181)
0808 04:43:56.973374 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:56.973427 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":78,"threads_started":1}
I20260808 04:43:57.657485 6529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:57.657016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.65:47647)
0808 04:43:57.657323 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:57.657384 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":77,"threads_started":1}
I20260808 04:43:57.788334 6530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:57.787945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.66:50085)
0808 04:43:57.788177 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:57.788236 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":76,"threads_started":1}
I20260808 04:43:57.974668 6533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:57.974248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.67:43707)
0808 04:43:57.974514 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:57.974570 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":97,"threads_started":1}
I20260808 04:43:58.041956 6535 raft_consensus.cc:482] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:43:58.042104 6535 raft_consensus.cc:504] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f5a7ad44b7a48dd84022268de5053c5" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 37015 } } peers { permanent_uuid: "7f4a390317fb44429480ca1ff43c01c1" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44961 } } peers { permanent_uuid: "7939bc8b48b44291a5696834e82809e2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 37349 } }
I20260808 04:43:58.042531 6535 leader_election.cc:288] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f5a7ad44b7a48dd84022268de5053c5 (127.12.148.66:37015), 7f4a390317fb44429480ca1ff43c01c1 (127.12.148.67:44961)
W20260808 04:43:58.043287 5783 leader_election.cc:341] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7f4a390317fb44429480ca1ff43c01c1 (127.12.148.67:44961): Not found: Tablet not found: 0353bbd0d61246228365c2bc33a50e9c
W20260808 04:43:58.043426 5786 leader_election.cc:341] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4f5a7ad44b7a48dd84022268de5053c5 (127.12.148.66:37015): Not found: Tablet not found: 0353bbd0d61246228365c2bc33a50e9c
I20260808 04:43:58.043515 5786 leader_election.cc:302] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7939bc8b48b44291a5696834e82809e2; no voters: 4f5a7ad44b7a48dd84022268de5053c5, 7f4a390317fb44429480ca1ff43c01c1
I20260808 04:43:58.043651 6535 raft_consensus.cc:2726] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 04:43:58.658563 6536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:58.658168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.65:54569)
0808 04:43:58.658407 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:58.658468 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":86,"threads_started":1}
I20260808 04:43:58.789405 6537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:58.788999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.66:40841)
0808 04:43:58.789256 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:58.789312 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":75,"threads_started":1}
I20260808 04:43:58.975718 6538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:58.975304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.67:39625)
0808 04:43:58.975564 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:58.975621 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":76,"threads_started":1}
I20260808 04:43:59.659687 6541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:59.659260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.65:35841)
0808 04:43:59.659531 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:59.659589 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":90,"threads_started":1}
I20260808 04:43:59.790622 6543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:59.790152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.66:55863)
0808 04:43:59.790475 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:59.790530 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":86,"threads_started":1}
I20260808 04:43:59.976845 6548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:43:59.976355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.67:40813)
0808 04:43:59.976692 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0808 04:43:59.976749 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":99,"threads_started":1}
I20260808 04:44:00.660868 6549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:00.660383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.65:49549)
0808 04:44:00.660678 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:00.660741 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":85,"threads_started":1}
I20260808 04:44:00.791738 6551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:00.791332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.66:49869)
0808 04:44:00.791582 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:00.791641 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":94,"threads_started":1}
I20260808 04:44:00.977936 6554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:00.977511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.67:39139)
0808 04:44:00.977785 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:00.977841 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":92,"threads_started":1}
I20260808 04:44:01.662042 6556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:01.661589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.65:57291)
0808 04:44:01.661890 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:01.661944 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":120,"threads_started":1}
I20260808 04:44:01.792891 6557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:01.792455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.66:42697)
0808 04:44:01.792730 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:01.792789 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":77,"threads_started":1}
I20260808 04:44:01.956504 6560 raft_consensus.cc:482] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:44:01.956641 6560 raft_consensus.cc:504] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f5a7ad44b7a48dd84022268de5053c5" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 37015 } } peers { permanent_uuid: "7f4a390317fb44429480ca1ff43c01c1" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44961 } } peers { permanent_uuid: "7939bc8b48b44291a5696834e82809e2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 37349 } }
I20260808 04:44:01.957062 6560 leader_election.cc:288] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f5a7ad44b7a48dd84022268de5053c5 (127.12.148.66:37015), 7f4a390317fb44429480ca1ff43c01c1 (127.12.148.67:44961)
W20260808 04:44:01.957823 5783 leader_election.cc:341] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7f4a390317fb44429480ca1ff43c01c1 (127.12.148.67:44961): Not found: Tablet not found: 0353bbd0d61246228365c2bc33a50e9c
W20260808 04:44:01.957959 5786 leader_election.cc:341] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4f5a7ad44b7a48dd84022268de5053c5 (127.12.148.66:37015): Not found: Tablet not found: 0353bbd0d61246228365c2bc33a50e9c
I20260808 04:44:01.958032 5786 leader_election.cc:302] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7939bc8b48b44291a5696834e82809e2; no voters: 4f5a7ad44b7a48dd84022268de5053c5, 7f4a390317fb44429480ca1ff43c01c1
I20260808 04:44:01.958212 6560 raft_consensus.cc:2726] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 04:44:01.979100 6561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:01.978670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.67:48777)
0808 04:44:01.978943 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:01.979002 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":99,"threads_started":1}
I20260808 04:44:02.663311 6562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:02.662848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.65:35607)
0808 04:44:02.663147 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:02.663205 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":105,"threads_started":1}
I20260808 04:44:02.794018 6564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:02.793584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.66:60563)
0808 04:44:02.793864 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:02.793917 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":108,"threads_started":1}
I20260808 04:44:02.980198 6565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:02.979760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.67:48293)
0808 04:44:02.980044 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:02.980101 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":92,"threads_started":1}
I20260808 04:44:03.664420 6567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:03.664027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.65:45733)
0808 04:44:03.664265 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:03.664321 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":75,"threads_started":1}
I20260808 04:44:03.795197 6570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:03.794761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.66:40475)
0808 04:44:03.795038 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:03.795099 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":94,"threads_started":1}
I20260808 04:44:03.981267 6571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:03.980860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.67:58899)
0808 04:44:03.981119 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:03.981172 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":84,"threads_started":1}
I20260808 04:44:04.665512 6572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:04.665108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.65:46689)
0808 04:44:04.665359 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:04.665415 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":80,"threads_started":1}
I20260808 04:44:04.796393 6574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:04.795971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.66:44683)
0808 04:44:04.796234 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:04.796292 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":78,"threads_started":1}
I20260808 04:44:04.966850 6575 raft_consensus.cc:482] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:44:04.966975 6575 raft_consensus.cc:504] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f5a7ad44b7a48dd84022268de5053c5" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 37015 } } peers { permanent_uuid: "7f4a390317fb44429480ca1ff43c01c1" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44961 } } peers { permanent_uuid: "7939bc8b48b44291a5696834e82809e2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 37349 } }
I20260808 04:44:04.967324 6575 leader_election.cc:288] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f5a7ad44b7a48dd84022268de5053c5 (127.12.148.66:37015), 7f4a390317fb44429480ca1ff43c01c1 (127.12.148.67:44961)
W20260808 04:44:04.968065 5786 leader_election.cc:341] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4f5a7ad44b7a48dd84022268de5053c5 (127.12.148.66:37015): Not found: Tablet not found: 0353bbd0d61246228365c2bc33a50e9c
W20260808 04:44:04.968184 5783 leader_election.cc:341] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7f4a390317fb44429480ca1ff43c01c1 (127.12.148.67:44961): Not found: Tablet not found: 0353bbd0d61246228365c2bc33a50e9c
I20260808 04:44:04.968251 5783 leader_election.cc:302] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7939bc8b48b44291a5696834e82809e2; no voters: 4f5a7ad44b7a48dd84022268de5053c5, 7f4a390317fb44429480ca1ff43c01c1
I20260808 04:44:04.968381 6575 raft_consensus.cc:2726] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 04:44:04.982332 6579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:04.981928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.67:51085)
0808 04:44:04.982186 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:04.982241 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":71,"threads_started":1}
I20260808 04:44:05.666726 6580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:05.666268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.65:56897)
0808 04:44:05.666566 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:05.666628 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":95,"threads_started":1}
I20260808 04:44:05.797745 6581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:05.797224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.66:37743)
0808 04:44:05.797534 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:05.797600 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":101,"threads_started":1}
I20260808 04:44:05.983431 6582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:05.983021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.67:46507)
0808 04:44:05.983272 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:05.983331 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":74,"threads_started":1}
I20260808 04:44:06.667887 6584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:06.667415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.65:46751)
0808 04:44:06.667731 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:06.667789 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":92,"threads_started":1}
I20260808 04:44:06.799048 6586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:06.798562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.66:39353)
0808 04:44:06.798855 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:06.798925 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":97,"threads_started":1}
I20260808 04:44:06.984526 6587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:06.984113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.67:40279)
0808 04:44:06.984373 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:06.984427 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":94,"threads_started":1}
I20260808 04:44:07.400743 6588 raft_consensus.cc:482] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:44:07.400885 6588 raft_consensus.cc:504] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f5a7ad44b7a48dd84022268de5053c5" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 37015 } } peers { permanent_uuid: "7f4a390317fb44429480ca1ff43c01c1" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 44961 } } peers { permanent_uuid: "7939bc8b48b44291a5696834e82809e2" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 37349 } }
I20260808 04:44:07.401259 6588 leader_election.cc:288] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f5a7ad44b7a48dd84022268de5053c5 (127.12.148.66:37015), 7f4a390317fb44429480ca1ff43c01c1 (127.12.148.67:44961)
W20260808 04:44:07.402109 5783 leader_election.cc:341] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7f4a390317fb44429480ca1ff43c01c1 (127.12.148.67:44961): Not found: Tablet not found: 0353bbd0d61246228365c2bc33a50e9c
W20260808 04:44:07.402238 5786 leader_election.cc:341] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4f5a7ad44b7a48dd84022268de5053c5 (127.12.148.66:37015): Not found: Tablet not found: 0353bbd0d61246228365c2bc33a50e9c
I20260808 04:44:07.402307 5786 leader_election.cc:302] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7939bc8b48b44291a5696834e82809e2; no voters: 4f5a7ad44b7a48dd84022268de5053c5, 7f4a390317fb44429480ca1ff43c01c1
I20260808 04:44:07.402441 6588 raft_consensus.cc:2726] T 0353bbd0d61246228365c2bc33a50e9c P 7939bc8b48b44291a5696834e82809e2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 04:44:07.669396 6590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:07.668878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.65:35361)
0808 04:44:07.669202 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:07.669272 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":95,"threads_started":1}
I20260808 04:44:07.800343 6591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:07.799953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.66:42901)
0808 04:44:07.800190 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:07.800245 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":73,"threads_started":1}
I20260808 04:44:07.972913 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 5680
I20260808 04:44:07.986037 6592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:07.985528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:40217 (local address 127.12.148.67:40549)
0808 04:44:07.985854 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:07.985919 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.126:40217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":110,"threads_started":1}
I20260808 04:44:07.986603 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 6012
I20260808 04:44:07.998744 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 6267
2026-08-08T04:44:08Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59360 ms)
[----------] 30 tests from SecurityITest (243983 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:08 dist-test-slave-t7g5 krb5kdc[6595](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:08 dist-test-slave-t7g5 krb5kdc[6595](info): set up 2 sockets
Aug 08 04:44:08 dist-test-slave-t7g5 krb5kdc[6595](info): commencing operation
krb5kdc: starting...
W20260808 04:44:09.170854 12881 mini_kdc.cc:121] Time spent starting KDC: real 1.142s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Aug 08 04:44:09 dist-test-slave-t7g5 krb5kdc[6595](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164249, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.148.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
I20260808 04:44:09.305559 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:34847
--webserver_interface=127.12.148.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:40577
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:34847
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:09.428834 6617 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:09.429193 6617 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:09.429256 6617 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:09.433350 6617 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:09.433426 6617 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:09.433454 6617 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:09.433476 6617 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:09.433497 6617 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:09.439040 6617 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:40577
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:34847
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:34847
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6617
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:09.440237 6617 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:09.441318 6617 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:09.450335 6626 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:09.450451 6617 server_base.cc:1034] running on GCE node
W20260808 04:44:09.450397 6629 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:09.450347 6625 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:09.451191 6617 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:09.452473 6617 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:09.453673 6617 hybrid_clock.cc:648] HybridClock initialized: now 1786164249453626 us; error 45 us; skew 500 ppm
Aug 08 04:44:09 dist-test-slave-t7g5 krb5kdc[6595](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164249, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:09.456516 6617 init.cc:377] Logged in from keytab as kudu/127.12.148.126@KRBTEST.COM (short username kudu)
I20260808 04:44:09.457469 6617 webserver.cc:460] Webserver started at http://127.12.148.126:46381/ using document root <none> and password file <none>
I20260808 04:44:09.458065 6617 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:09.458130 6617 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:09.458345 6617 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:09.460467 6617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "da0033eb75684bffa860d6114228e6a1"
format_stamp: "Formatted at 2026-08-08 04:44:09 on dist-test-slave-t7g5"
server_key: "01aa095e5b0cc5015d6d2b6048a8f28e"
server_key_iv: "e3163d1ec9e06a61a960b74506fd4d29"
server_key_version: "encryptionkey@0"
I20260808 04:44:09.461056 6617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "da0033eb75684bffa860d6114228e6a1"
format_stamp: "Formatted at 2026-08-08 04:44:09 on dist-test-slave-t7g5"
server_key: "01aa095e5b0cc5015d6d2b6048a8f28e"
server_key_iv: "e3163d1ec9e06a61a960b74506fd4d29"
server_key_version: "encryptionkey@0"
I20260808 04:44:09.464924 6617 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 04:44:09.467479 6639 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:09.468731 6617 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:44:09.468894 6617 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "da0033eb75684bffa860d6114228e6a1"
format_stamp: "Formatted at 2026-08-08 04:44:09 on dist-test-slave-t7g5"
server_key: "01aa095e5b0cc5015d6d2b6048a8f28e"
server_key_iv: "e3163d1ec9e06a61a960b74506fd4d29"
server_key_version: "encryptionkey@0"
I20260808 04:44:09.469007 6617 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:09.501641 6617 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:09.505280 6617 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:09.505470 6617 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:09.513005 6617 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:34847
I20260808 04:44:09.513019 6732 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:34847 every 8 connection(s)
I20260808 04:44:09.514075 6617 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:09.517002 6733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:09.522838 6733 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da0033eb75684bffa860d6114228e6a1: Bootstrap starting.
I20260808 04:44:09.523897 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 6617
I20260808 04:44:09.524041 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:44:09.524362 12881 external_mini_cluster.cc:1428] Setting key 2b8023747126ef2b7747014a6282d8a4
I20260808 04:44:09.525898 6733 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P da0033eb75684bffa860d6114228e6a1: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:09.526650 6733 log.cc:824] T 00000000000000000000000000000000 P da0033eb75684bffa860d6114228e6a1: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:09.528975 6733 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da0033eb75684bffa860d6114228e6a1: No bootstrap required, opened a new log
I20260808 04:44:09.533340 6733 raft_consensus.cc:348] T 00000000000000000000000000000000 P da0033eb75684bffa860d6114228e6a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da0033eb75684bffa860d6114228e6a1" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 34847 } }
I20260808 04:44:09.533598 6733 raft_consensus.cc:374] T 00000000000000000000000000000000 P da0033eb75684bffa860d6114228e6a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:09.533689 6733 raft_consensus.cc:729] T 00000000000000000000000000000000 P da0033eb75684bffa860d6114228e6a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da0033eb75684bffa860d6114228e6a1, State: Initialized, Role: FOLLOWER
Aug 08 04:44:09 dist-test-slave-t7g5 krb5kdc[6595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164249, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:44:09.534191 6733 consensus_queue.cc:260] T 00000000000000000000000000000000 P da0033eb75684bffa860d6114228e6a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da0033eb75684bffa860d6114228e6a1" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 34847 } }
I20260808 04:44:09.534381 6733 raft_consensus.cc:388] T 00000000000000000000000000000000 P da0033eb75684bffa860d6114228e6a1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:09.534456 6733 raft_consensus.cc:482] T 00000000000000000000000000000000 P da0033eb75684bffa860d6114228e6a1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:09.534605 6733 raft_consensus.cc:3037] T 00000000000000000000000000000000 P da0033eb75684bffa860d6114228e6a1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:09.535539 6733 raft_consensus.cc:504] T 00000000000000000000000000000000 P da0033eb75684bffa860d6114228e6a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da0033eb75684bffa860d6114228e6a1" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 34847 } }
I20260808 04:44:09.535869 6733 leader_election.cc:302] T 00000000000000000000000000000000 P da0033eb75684bffa860d6114228e6a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: da0033eb75684bffa860d6114228e6a1; no voters:
I20260808 04:44:09.536167 6733 leader_election.cc:288] T 00000000000000000000000000000000 P da0033eb75684bffa860d6114228e6a1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:09.536293 6746 raft_consensus.cc:2781] T 00000000000000000000000000000000 P da0033eb75684bffa860d6114228e6a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:09.536522 6746 raft_consensus.cc:686] T 00000000000000000000000000000000 P da0033eb75684bffa860d6114228e6a1 [term 1 LEADER]: Becoming Leader. State: Replica: da0033eb75684bffa860d6114228e6a1, State: Running, Role: LEADER
I20260808 04:44:09.536896 6746 consensus_queue.cc:237] T 00000000000000000000000000000000 P da0033eb75684bffa860d6114228e6a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da0033eb75684bffa860d6114228e6a1" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 34847 } }
I20260808 04:44:09.537544 6733 sys_catalog.cc:564] T 00000000000000000000000000000000 P da0033eb75684bffa860d6114228e6a1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:09.538681 6747 sys_catalog.cc:455] T 00000000000000000000000000000000 P da0033eb75684bffa860d6114228e6a1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "da0033eb75684bffa860d6114228e6a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da0033eb75684bffa860d6114228e6a1" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 34847 } } }
I20260808 04:44:09.539146 6747 sys_catalog.cc:458] T 00000000000000000000000000000000 P da0033eb75684bffa860d6114228e6a1 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:09.539014 6748 sys_catalog.cc:455] T 00000000000000000000000000000000 P da0033eb75684bffa860d6114228e6a1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader da0033eb75684bffa860d6114228e6a1. Latest consensus state: current_term: 1 leader_uuid: "da0033eb75684bffa860d6114228e6a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da0033eb75684bffa860d6114228e6a1" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 34847 } } }
I20260808 04:44:09.539480 6748 sys_catalog.cc:458] T 00000000000000000000000000000000 P da0033eb75684bffa860d6114228e6a1 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:09.540565 6740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:09.525617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52352 (local address 127.12.148.126:34847)
0808 04:44:09.526082 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:09.526099 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:09.526136 (+ 37us) server_negotiation.cc:407] Connection header received
0808 04:44:09.526808 (+ 672us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:09.526835 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:09.527290 (+ 455us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:09.527673 (+ 383us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:09.528652 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:09.529759 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:09.530945 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:09.531417 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:09.531541 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:09.534606 (+ 3065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:09.534611 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:09.534625 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:09.534655 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:09.536500 (+ 1845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:09.537039 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:09.537045 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:09.537051 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:09.537197 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:09.537523 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:09.537526 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:09.537528 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:09.538109 (+ 581us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:09.538299 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:09.539248 (+ 949us) server_negotiation.cc:299] Negotiation successful
0808 04:44:09.539591 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":121,"threads_started":1}
W20260808 04:44:09.542841 6772 catalog_manager.cc:1558] T 00000000000000000000000000000000 P da0033eb75684bffa860d6114228e6a1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 04:44:09.542946 6772 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 04:44:09.543116 6769 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:09.543848 6769 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:09.549180 6769 catalog_manager.cc:1347] Generated new cluster ID: eede71e109554f94a27962d680f55838
I20260808 04:44:09.549257 6769 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:09.581514 6769 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:09.582914 6769 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:09.592059 6769 catalog_manager.cc:5868] T 00000000000000000000000000000000 P da0033eb75684bffa860d6114228e6a1: Generated new TSK 0
I20260808 04:44:09.592810 6769 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.148.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab.
Entry for principal kudu/127.12.148.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab.
I20260808 04:44:09.633957 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.65:0
--local_ip_for_outbound_sockets=127.12.148.65
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:34847
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:40577
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:09.749167 6785 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:09.749461 6785 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:09.749503 6785 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:09.753549 6785 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:09.753628 6785 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:09.753705 6785 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.65
I20260808 04:44:09.759316 6785 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:40577
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:34847
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6785
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.65
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:09.760370 6785 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:09.761412 6785 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:09.770907 6791 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:09.770917 6795 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:09.771013 6793 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:09.771198 6785 server_base.cc:1034] running on GCE node
I20260808 04:44:09.771620 6785 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:09.772315 6785 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:09.773483 6785 hybrid_clock.cc:648] HybridClock initialized: now 1786164249773462 us; error 30 us; skew 500 ppm
Aug 08 04:44:09 dist-test-slave-t7g5 krb5kdc[6595](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164249, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:09.776325 6785 init.cc:377] Logged in from keytab as kudu/127.12.148.65@KRBTEST.COM (short username kudu)
I20260808 04:44:09.777190 6785 webserver.cc:460] Webserver started at http://127.12.148.65:36341/ using document root <none> and password file <none>
I20260808 04:44:09.777774 6785 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:09.777845 6785 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:09.778023 6785 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:09.780062 6785 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-0/data/instance:
uuid: "fa47523fa59f46cbbb7eb570c795596f"
format_stamp: "Formatted at 2026-08-08 04:44:09 on dist-test-slave-t7g5"
server_key: "8404a5e20438c90dd08f242f60482079"
server_key_iv: "71a52807af00bcd15397e7300639ebea"
server_key_version: "encryptionkey@0"
I20260808 04:44:09.780586 6785 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance:
uuid: "fa47523fa59f46cbbb7eb570c795596f"
format_stamp: "Formatted at 2026-08-08 04:44:09 on dist-test-slave-t7g5"
server_key: "8404a5e20438c90dd08f242f60482079"
server_key_iv: "71a52807af00bcd15397e7300639ebea"
server_key_version: "encryptionkey@0"
I20260808 04:44:09.784250 6785 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 04:44:09.786795 6810 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:09.788058 6785 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:44:09.788187 6785 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-0/wal
uuid: "fa47523fa59f46cbbb7eb570c795596f"
format_stamp: "Formatted at 2026-08-08 04:44:09 on dist-test-slave-t7g5"
server_key: "8404a5e20438c90dd08f242f60482079"
server_key_iv: "71a52807af00bcd15397e7300639ebea"
server_key_version: "encryptionkey@0"
I20260808 04:44:09.788293 6785 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:09.808027 6785 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:09.811474 6785 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:09.811682 6785 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:09.812326 6785 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:44:09.813215 6785 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:44:09.813265 6785 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:09.813323 6785 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:44:09.813351 6785 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:09.822005 6785 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.65:43457
I20260808 04:44:09.822070 7016 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.65:43457 every 8 connection(s)
I20260808 04:44:09.822945 6785 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
I20260808 04:44:09.832157 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 6785
I20260808 04:44:09.832296 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance
I20260808 04:44:09.832690 12881 external_mini_cluster.cc:1428] Setting key ae2e8fc82e12e327faa50e054a620a53
Aug 08 04:44:09 dist-test-slave-t7g5 krb5kdc[6595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164249, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:44:09.837950 6740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:09.824823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:33239 (local address 127.12.148.126:34847)
0808 04:44:09.824964 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:09.824968 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:09.825850 (+ 882us) server_negotiation.cc:407] Connection header received
0808 04:44:09.827221 (+ 1371us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:09.827225 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:09.827287 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:09.827361 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:09.828644 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:09.829182 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:09.830800 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:09.831043 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:09.831140 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:09.834118 (+ 2978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:09.834121 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:09.834124 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:09.834154 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:09.835603 (+ 1449us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:09.836265 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:09.836269 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:09.836271 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:09.836380 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:09.836724 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:09.836727 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:09.836728 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:09.836964 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:09.837060 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:09.837608 (+ 548us) server_negotiation.cc:299] Negotiation successful
0808 04:44:09.837792 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 04:44:09.838785 7027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:09.825204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:34847 (local address 127.12.148.65:33239)
0808 04:44:09.825689 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:09.825734 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:09.826982 (+ 1248us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:09.827567 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:09.827574 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:09.827970 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:09.828473 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:09.828487 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:09.829320 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:09.829322 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:09.830677 (+ 1355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:09.830688 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:09.831207 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:09.831212 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:09.831403 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:09.832057 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:09.832077 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:09.833936 (+ 1859us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:09.835738 (+ 1802us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:09.835745 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:09.835761 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:09.836128 (+ 367us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:09.836481 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:09.836484 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:09.836485 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:09.836630 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:09.837055 (+ 425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:09.837060 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:09.837335 (+ 275us) client_negotiation.cc:769] Sending connection context
0808 04:44:09.837509 (+ 174us) client_negotiation.cc:240] Negotiation successful
0808 04:44:09.837836 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":111,"threads_started":1}
I20260808 04:44:09.840106 7018 heartbeater.cc:347] Connected to a master server at 127.12.148.126:34847
I20260808 04:44:09.840348 7018 heartbeater.cc:464] Registering TS with master...
I20260808 04:44:09.840831 7018 heartbeater.cc:511] Master 127.12.148.126:34847 requested a full tablet report, sending...
I20260808 04:44:09.842551 6660 ts_manager.cc:194] Registered new tserver with Master: fa47523fa59f46cbbb7eb570c795596f (127.12.148.65:43457)
WARNING: no policy specified for kudu/127.12.148.66@KRBTEST.COM; defaulting to no policy
I20260808 04:44:09.844143 6660 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.65@KRBTEST.COM'} at 127.12.148.65:33239
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab.
Entry for principal kudu/127.12.148.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab.
I20260808 04:44:09.864928 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.66:0
--local_ip_for_outbound_sockets=127.12.148.66
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:34847
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:40577
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:09.976933 7033 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:09.977195 7033 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:09.977238 7033 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:09.981174 7033 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:09.981236 7033 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:09.981292 7033 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.66
I20260808 04:44:09.986470 7033 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:40577
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:34847
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7033
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.66
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:09.987453 7033 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:09.988433 7033 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:09.998237 7047 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:09.998242 7042 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:09.998288 7044 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:09.998575 7033 server_base.cc:1034] running on GCE node
I20260808 04:44:09.998993 7033 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:09.999625 7033 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:10.000801 7033 hybrid_clock.cc:648] HybridClock initialized: now 1786164250000777 us; error 38 us; skew 500 ppm
Aug 08 04:44:10 dist-test-slave-t7g5 krb5kdc[6595](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164250, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:10.003659 7033 init.cc:377] Logged in from keytab as kudu/127.12.148.66@KRBTEST.COM (short username kudu)
I20260808 04:44:10.004781 7033 webserver.cc:460] Webserver started at http://127.12.148.66:43515/ using document root <none> and password file <none>
I20260808 04:44:10.005389 7033 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:10.005477 7033 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:10.005738 7033 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:10.007970 7033 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-1/data/instance:
uuid: "dca320bf8ae5490a9f58a770f772d5b8"
format_stamp: "Formatted at 2026-08-08 04:44:10 on dist-test-slave-t7g5"
server_key: "bbd0b6fb07fc86060e334a12876f9190"
server_key_iv: "d8e48eb13d04232e8275ba7083985fc5"
server_key_version: "encryptionkey@0"
I20260808 04:44:10.008580 7033 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance:
uuid: "dca320bf8ae5490a9f58a770f772d5b8"
format_stamp: "Formatted at 2026-08-08 04:44:10 on dist-test-slave-t7g5"
server_key: "bbd0b6fb07fc86060e334a12876f9190"
server_key_iv: "d8e48eb13d04232e8275ba7083985fc5"
server_key_version: "encryptionkey@0"
I20260808 04:44:10.012660 7033 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 04:44:10.015357 7055 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:10.016791 7033 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 04:44:10.016937 7033 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-1/wal
uuid: "dca320bf8ae5490a9f58a770f772d5b8"
format_stamp: "Formatted at 2026-08-08 04:44:10 on dist-test-slave-t7g5"
server_key: "bbd0b6fb07fc86060e334a12876f9190"
server_key_iv: "d8e48eb13d04232e8275ba7083985fc5"
server_key_version: "encryptionkey@0"
I20260808 04:44:10.017076 7033 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:10.049898 7033 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:10.052819 7033 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:10.053020 7033 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:10.053632 7033 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:44:10.054530 7033 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:44:10.054581 7033 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:10.054636 7033 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:44:10.054665 7033 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:10.063347 7033 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.66:35927
I20260808 04:44:10.063452 7254 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.66:35927 every 8 connection(s)
I20260808 04:44:10.064278 7033 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
I20260808 04:44:10.072077 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 7033
I20260808 04:44:10.072199 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance
I20260808 04:44:10.072506 12881 external_mini_cluster.cc:1428] Setting key 91fa9cd12dd6ac2c24196038ad45bbba
Aug 08 04:44:10 dist-test-slave-t7g5 krb5kdc[6595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164250, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:44:10.077961 6740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:10.066205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:50187 (local address 127.12.148.126:34847)
0808 04:44:10.066379 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:10.066383 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:10.067183 (+ 800us) server_negotiation.cc:407] Connection header received
0808 04:44:10.068473 (+ 1290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:10.068476 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:10.068525 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:10.068596 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:10.069726 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:10.070261 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:10.071343 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:10.071551 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:10.071617 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:10.074432 (+ 2815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:10.074435 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:10.074437 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:10.074470 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:10.075870 (+ 1400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:10.076387 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:10.076390 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:10.076391 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:10.076481 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:10.076830 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:10.076834 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:10.076835 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:10.077026 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:10.077114 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:10.077647 (+ 533us) server_negotiation.cc:299] Negotiation successful
0808 04:44:10.077796 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 04:44:10.078858 7261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:10.066586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:34847 (local address 127.12.148.66:50187)
0808 04:44:10.067029 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:10.067072 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:10.068270 (+ 1198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:10.068740 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:10.068747 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:10.069093 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:10.069596 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:10.069611 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:10.070361 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:10.070363 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:10.071248 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:10.071257 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:10.071669 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:10.071671 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:10.071831 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:10.072453 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:10.072471 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:10.074259 (+ 1788us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:10.075997 (+ 1738us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:10.076004 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:10.076020 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:10.076280 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:10.076576 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:10.076580 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:10.076582 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:10.076731 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:10.077139 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:10.077145 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:10.077404 (+ 259us) client_negotiation.cc:769] Sending connection context
0808 04:44:10.077579 (+ 175us) client_negotiation.cc:240] Negotiation successful
0808 04:44:10.077954 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":110,"threads_started":1}
I20260808 04:44:10.080075 7256 heartbeater.cc:347] Connected to a master server at 127.12.148.126:34847
I20260808 04:44:10.080354 7256 heartbeater.cc:464] Registering TS with master...
I20260808 04:44:10.080973 7256 heartbeater.cc:511] Master 127.12.148.126:34847 requested a full tablet report, sending...
I20260808 04:44:10.082178 6660 ts_manager.cc:194] Registered new tserver with Master: dca320bf8ae5490a9f58a770f772d5b8 (127.12.148.66:35927)
I20260808 04:44:10.082963 6660 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.66@KRBTEST.COM'} at 127.12.148.66:50187
WARNING: no policy specified for kudu/127.12.148.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab.
Entry for principal kudu/127.12.148.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab.
I20260808 04:44:10.103057 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.67:0
--local_ip_for_outbound_sockets=127.12.148.67
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:34847
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:40577
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:10.217733 7266 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:10.218055 7266 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:10.218099 7266 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:10.222407 7266 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:10.222481 7266 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:10.222543 7266 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.67
I20260808 04:44:10.227988 7266 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:40577
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:34847
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7266
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.67
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:10.229027 7266 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:10.230132 7266 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:10.239977 7272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:10.240005 7282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:10.239977 7277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:10.240454 7266 server_base.cc:1034] running on GCE node
I20260808 04:44:10.240809 7266 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:10.241415 7266 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:10.242569 7266 hybrid_clock.cc:648] HybridClock initialized: now 1786164250242541 us; error 37 us; skew 500 ppm
Aug 08 04:44:10 dist-test-slave-t7g5 krb5kdc[6595](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164250, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:10.245154 7266 init.cc:377] Logged in from keytab as kudu/127.12.148.67@KRBTEST.COM (short username kudu)
I20260808 04:44:10.246047 7266 webserver.cc:460] Webserver started at http://127.12.148.67:32985/ using document root <none> and password file <none>
I20260808 04:44:10.246666 7266 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:10.246749 7266 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:10.247028 7266 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:10.249032 7266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-2/data/instance:
uuid: "9ef3c397d9d845acb36b862871b62914"
format_stamp: "Formatted at 2026-08-08 04:44:10 on dist-test-slave-t7g5"
server_key: "81926682dd54f5193de28a0bcbf9077a"
server_key_iv: "94216bd208f2014d522ce222868748f9"
server_key_version: "encryptionkey@0"
I20260808 04:44:10.249578 7266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance:
uuid: "9ef3c397d9d845acb36b862871b62914"
format_stamp: "Formatted at 2026-08-08 04:44:10 on dist-test-slave-t7g5"
server_key: "81926682dd54f5193de28a0bcbf9077a"
server_key_iv: "94216bd208f2014d522ce222868748f9"
server_key_version: "encryptionkey@0"
I20260808 04:44:10.253115 7266 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 04:44:10.255477 7292 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:10.256661 7266 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:44:10.256771 7266 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-2/wal
uuid: "9ef3c397d9d845acb36b862871b62914"
format_stamp: "Formatted at 2026-08-08 04:44:10 on dist-test-slave-t7g5"
server_key: "81926682dd54f5193de28a0bcbf9077a"
server_key_iv: "94216bd208f2014d522ce222868748f9"
server_key_version: "encryptionkey@0"
I20260808 04:44:10.256871 7266 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:10.293038 7266 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:10.295974 7266 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:10.296159 7266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:10.296757 7266 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:44:10.297621 7266 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:44:10.297712 7266 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:10.297781 7266 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:44:10.297814 7266 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:10.306560 7266 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.67:36819
I20260808 04:44:10.306594 7502 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.67:36819 every 8 connection(s)
I20260808 04:44:10.307476 7266 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
I20260808 04:44:10.310844 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 7266
I20260808 04:44:10.311005 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance
I20260808 04:44:10.311350 12881 external_mini_cluster.cc:1428] Setting key abb84ca8f77edf3317c8a021e1d32d50
Aug 08 04:44:10 dist-test-slave-t7g5 krb5kdc[6595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164250, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:44:10.321282 6740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:10.309351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:54425 (local address 127.12.148.126:34847)
0808 04:44:10.309511 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:10.309515 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:10.310444 (+ 929us) server_negotiation.cc:407] Connection header received
0808 04:44:10.312070 (+ 1626us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:10.312073 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:10.312127 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:10.312211 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:10.313796 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:10.314324 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:10.315569 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:10.315771 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:10.315839 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:10.318206 (+ 2367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:10.318210 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:10.318212 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:10.318241 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:10.319473 (+ 1232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:10.319957 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:10.319960 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:10.319961 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:10.320040 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:10.320311 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:10.320313 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:10.320314 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:10.320482 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:10.320554 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:10.321053 (+ 499us) server_negotiation.cc:299] Negotiation successful
0808 04:44:10.321158 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 04:44:10.322232 7506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:10.309792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:34847 (local address 127.12.148.67:54425)
0808 04:44:10.310267 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:10.310313 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:10.311848 (+ 1535us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:10.312454 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:10.312465 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:10.312998 (+ 533us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:10.313619 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:10.313642 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:10.314453 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:10.314456 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:10.315469 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:10.315480 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:10.315882 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:10.315884 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:10.316027 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:10.316561 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:10.316577 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:10.318024 (+ 1447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:10.319579 (+ 1555us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:10.319584 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:10.319597 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:10.319857 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:10.320110 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:10.320112 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:10.320114 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:10.320242 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:10.320576 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:10.320582 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:10.320830 (+ 248us) client_negotiation.cc:769] Sending connection context
0808 04:44:10.320989 (+ 159us) client_negotiation.cc:240] Negotiation successful
0808 04:44:10.321295 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":128,"threads_started":1}
I20260808 04:44:10.323328 7503 heartbeater.cc:347] Connected to a master server at 127.12.148.126:34847
I20260808 04:44:10.323578 7503 heartbeater.cc:464] Registering TS with master...
I20260808 04:44:10.324105 7503 heartbeater.cc:511] Master 127.12.148.126:34847 requested a full tablet report, sending...
I20260808 04:44:10.325278 6670 ts_manager.cc:194] Registered new tserver with Master: 9ef3c397d9d845acb36b862871b62914 (127.12.148.67:36819)
I20260808 04:44:10.325899 6670 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.67@KRBTEST.COM'} at 127.12.148.67:54425
I20260808 04:44:10.337260 12881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 04:44:10.346344 6740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:10.339387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52364 (local address 127.12.148.126:34847)
0808 04:44:10.339541 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:10.339546 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:10.339751 (+ 205us) server_negotiation.cc:407] Connection header received
0808 04:44:10.339862 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:10.339865 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:10.339911 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:10.339984 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:10.340657 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:10.341172 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:10.342038 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:10.342249 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:10.342323 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:10.343563 (+ 1240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:10.343566 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:10.343568 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:10.343594 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:10.344887 (+ 1293us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:10.345228 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:10.345231 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:10.345232 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:10.345303 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:10.345512 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:10.345514 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:10.345516 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:10.345782 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:10.345889 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:10.346079 (+ 190us) server_negotiation.cc:299] Negotiation successful
0808 04:44:10.346180 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 04:44:10.349202 6670 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52364:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:44:10.352185 6670 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:44:10.366813 7530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:10.361583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59248 (local address 127.12.148.65:43457)
0808 04:44:10.362180 (+ 597us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:10.362186 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:10.362205 (+ 19us) server_negotiation.cc:407] Connection header received
0808 04:44:10.362271 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:10.362275 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:10.362431 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:10.362565 (+ 134us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:10.362847 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:10.363571 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:10.365048 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:10.365911 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:10.366019 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:10.366169 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:10.366562 (+ 393us) server_negotiation.cc:299] Negotiation successful
0808 04:44:10.366661 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":504,"thread_start_us":100,"threads_started":1}
I20260808 04:44:10.366812 7528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:10.361395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46590 (local address 127.12.148.67:36819)
0808 04:44:10.361902 (+ 507us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:10.361914 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:10.361937 (+ 23us) server_negotiation.cc:407] Connection header received
0808 04:44:10.362011 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:10.362016 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:10.362213 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:10.362371 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:10.362793 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:10.363983 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:10.365385 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:10.366013 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:10.366115 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:10.366256 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:10.366597 (+ 341us) server_negotiation.cc:299] Negotiation successful
0808 04:44:10.366693 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":414,"thread_start_us":150,"threads_started":1}
I20260808 04:44:10.366799 7522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:10.360559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:43457 (local address 127.0.0.1:59248)
0808 04:44:10.361000 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:10.361014 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:10.361104 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:10.362548 (+ 1444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:10.362551 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:10.362570 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:10.362730 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:10.362736 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:10.363695 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:10.363698 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:10.364909 (+ 1211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:10.364920 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:10.366038 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:10.366042 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:10.366160 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:10.366199 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 04:44:10.366450 (+ 251us) client_negotiation.cc:240] Negotiation successful
0808 04:44:10.366640 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":377,"mutex_wait_us":63,"thread_start_us":112,"threads_started":1}
I20260808 04:44:10.366806 7520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:10.360434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:35927 (local address 127.0.0.1:34604)
0808 04:44:10.360805 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:10.360859 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:10.360982 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:10.362330 (+ 1348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:10.362337 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:10.362375 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:10.362641 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:10.362650 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:10.364134 (+ 1484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:10.364137 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:10.365290 (+ 1153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:10.365300 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:10.366371 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:10.366374 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:10.366449 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:10.366469 (+ 20us) client_negotiation.cc:769] Sending connection context
0808 04:44:10.366509 (+ 40us) client_negotiation.cc:240] Negotiation successful
0808 04:44:10.366632 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"mutex_wait_us":67,"spinlock_wait_cycles":7680,"thread_start_us":80,"threads_started":1}
I20260808 04:44:10.367177 7523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:10.361140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.67:36819 (local address 127.0.0.1:46590)
0808 04:44:10.361392 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:10.361404 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:10.361504 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:10.362331 (+ 827us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:10.362337 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:10.362373 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:10.362678 (+ 305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:10.362685 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:10.364142 (+ 1457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:10.364144 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:10.365259 (+ 1115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:10.365269 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:10.366257 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:10.366261 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:10.366355 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:10.366379 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 04:44:10.366454 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 04:44:10.367058 (+ 604us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"mutex_wait_us":728,"spinlock_wait_cycles":6144,"thread_start_us":106,"threads_started":1}
I20260808 04:44:10.367650 7527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:10.361121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34604 (local address 127.12.148.66:35927)
0808 04:44:10.361837 (+ 716us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:10.361849 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:10.361872 (+ 23us) server_negotiation.cc:407] Connection header received
0808 04:44:10.361952 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:10.361956 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:10.362156 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:10.362777 (+ 621us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:10.362935 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:10.363999 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:10.365419 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:10.366249 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:10.367118 (+ 869us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:10.367368 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:10.367425 (+ 57us) server_negotiation.cc:299] Negotiation successful
0808 04:44:10.367520 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":607,"thread_start_us":112,"threads_started":1}
I20260808 04:44:10.369925 7389 tablet_service.cc:1467] Processing CreateTablet for tablet 2490250c91f24f4f93f918ec4cdb353d (DEFAULT_TABLE table=test-table [id=917327c6994a40519f9f5081a63cec2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:44:10.370217 6889 tablet_service.cc:1467] Processing CreateTablet for tablet 2490250c91f24f4f93f918ec4cdb353d (DEFAULT_TABLE table=test-table [id=917327c6994a40519f9f5081a63cec2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:44:10.370217 7137 tablet_service.cc:1467] Processing CreateTablet for tablet 2490250c91f24f4f93f918ec4cdb353d (DEFAULT_TABLE table=test-table [id=917327c6994a40519f9f5081a63cec2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:44:10.370920 7389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2490250c91f24f4f93f918ec4cdb353d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:10.371217 7137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2490250c91f24f4f93f918ec4cdb353d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:10.371217 6889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2490250c91f24f4f93f918ec4cdb353d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:10.378374 7531 tablet_bootstrap.cc:492] T 2490250c91f24f4f93f918ec4cdb353d P fa47523fa59f46cbbb7eb570c795596f: Bootstrap starting.
I20260808 04:44:10.378823 7532 tablet_bootstrap.cc:492] T 2490250c91f24f4f93f918ec4cdb353d P dca320bf8ae5490a9f58a770f772d5b8: Bootstrap starting.
I20260808 04:44:10.379630 7538 tablet_bootstrap.cc:492] T 2490250c91f24f4f93f918ec4cdb353d P 9ef3c397d9d845acb36b862871b62914: Bootstrap starting.
I20260808 04:44:10.380877 7532 tablet_bootstrap.cc:654] T 2490250c91f24f4f93f918ec4cdb353d P dca320bf8ae5490a9f58a770f772d5b8: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:10.381362 7538 tablet_bootstrap.cc:654] T 2490250c91f24f4f93f918ec4cdb353d P 9ef3c397d9d845acb36b862871b62914: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:10.382510 7532 log.cc:824] T 2490250c91f24f4f93f918ec4cdb353d P dca320bf8ae5490a9f58a770f772d5b8: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:10.382584 7538 log.cc:824] T 2490250c91f24f4f93f918ec4cdb353d P 9ef3c397d9d845acb36b862871b62914: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:10.383167 7531 tablet_bootstrap.cc:654] T 2490250c91f24f4f93f918ec4cdb353d P fa47523fa59f46cbbb7eb570c795596f: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:10.383953 7531 log.cc:824] T 2490250c91f24f4f93f918ec4cdb353d P fa47523fa59f46cbbb7eb570c795596f: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:10.384640 7532 tablet_bootstrap.cc:492] T 2490250c91f24f4f93f918ec4cdb353d P dca320bf8ae5490a9f58a770f772d5b8: No bootstrap required, opened a new log
I20260808 04:44:10.384848 7532 ts_tablet_manager.cc:1397] T 2490250c91f24f4f93f918ec4cdb353d P dca320bf8ae5490a9f58a770f772d5b8: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 04:44:10.385641 7531 tablet_bootstrap.cc:492] T 2490250c91f24f4f93f918ec4cdb353d P fa47523fa59f46cbbb7eb570c795596f: No bootstrap required, opened a new log
I20260808 04:44:10.385860 7531 ts_tablet_manager.cc:1397] T 2490250c91f24f4f93f918ec4cdb353d P fa47523fa59f46cbbb7eb570c795596f: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.001s
I20260808 04:44:10.386041 7538 tablet_bootstrap.cc:492] T 2490250c91f24f4f93f918ec4cdb353d P 9ef3c397d9d845acb36b862871b62914: No bootstrap required, opened a new log
I20260808 04:44:10.386226 7538 ts_tablet_manager.cc:1397] T 2490250c91f24f4f93f918ec4cdb353d P 9ef3c397d9d845acb36b862871b62914: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.003s
I20260808 04:44:10.388768 7532 raft_consensus.cc:348] T 2490250c91f24f4f93f918ec4cdb353d P dca320bf8ae5490a9f58a770f772d5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca320bf8ae5490a9f58a770f772d5b8" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 35927 } } peers { permanent_uuid: "fa47523fa59f46cbbb7eb570c795596f" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 43457 } } peers { permanent_uuid: "9ef3c397d9d845acb36b862871b62914" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36819 } }
I20260808 04:44:10.389179 7532 raft_consensus.cc:374] T 2490250c91f24f4f93f918ec4cdb353d P dca320bf8ae5490a9f58a770f772d5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:10.389292 7532 raft_consensus.cc:729] T 2490250c91f24f4f93f918ec4cdb353d P dca320bf8ae5490a9f58a770f772d5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dca320bf8ae5490a9f58a770f772d5b8, State: Initialized, Role: FOLLOWER
I20260808 04:44:10.389212 7531 raft_consensus.cc:348] T 2490250c91f24f4f93f918ec4cdb353d P fa47523fa59f46cbbb7eb570c795596f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca320bf8ae5490a9f58a770f772d5b8" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 35927 } } peers { permanent_uuid: "fa47523fa59f46cbbb7eb570c795596f" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 43457 } } peers { permanent_uuid: "9ef3c397d9d845acb36b862871b62914" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36819 } }
I20260808 04:44:10.389498 7531 raft_consensus.cc:374] T 2490250c91f24f4f93f918ec4cdb353d P fa47523fa59f46cbbb7eb570c795596f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:10.389585 7531 raft_consensus.cc:729] T 2490250c91f24f4f93f918ec4cdb353d P fa47523fa59f46cbbb7eb570c795596f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa47523fa59f46cbbb7eb570c795596f, State: Initialized, Role: FOLLOWER
I20260808 04:44:10.389879 7532 consensus_queue.cc:260] T 2490250c91f24f4f93f918ec4cdb353d P dca320bf8ae5490a9f58a770f772d5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca320bf8ae5490a9f58a770f772d5b8" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 35927 } } peers { permanent_uuid: "fa47523fa59f46cbbb7eb570c795596f" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 43457 } } peers { permanent_uuid: "9ef3c397d9d845acb36b862871b62914" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36819 } }
I20260808 04:44:10.390012 7531 consensus_queue.cc:260] T 2490250c91f24f4f93f918ec4cdb353d P fa47523fa59f46cbbb7eb570c795596f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca320bf8ae5490a9f58a770f772d5b8" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 35927 } } peers { permanent_uuid: "fa47523fa59f46cbbb7eb570c795596f" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 43457 } } peers { permanent_uuid: "9ef3c397d9d845acb36b862871b62914" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36819 } }
I20260808 04:44:10.389942 7538 raft_consensus.cc:348] T 2490250c91f24f4f93f918ec4cdb353d P 9ef3c397d9d845acb36b862871b62914 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca320bf8ae5490a9f58a770f772d5b8" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 35927 } } peers { permanent_uuid: "fa47523fa59f46cbbb7eb570c795596f" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 43457 } } peers { permanent_uuid: "9ef3c397d9d845acb36b862871b62914" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36819 } }
I20260808 04:44:10.390161 7538 raft_consensus.cc:374] T 2490250c91f24f4f93f918ec4cdb353d P 9ef3c397d9d845acb36b862871b62914 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:10.390228 7538 raft_consensus.cc:729] T 2490250c91f24f4f93f918ec4cdb353d P 9ef3c397d9d845acb36b862871b62914 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ef3c397d9d845acb36b862871b62914, State: Initialized, Role: FOLLOWER
I20260808 04:44:10.390635 7256 heartbeater.cc:503] Master 127.12.148.126:34847 was elected leader, sending a full tablet report...
I20260808 04:44:10.390728 7538 consensus_queue.cc:260] T 2490250c91f24f4f93f918ec4cdb353d P 9ef3c397d9d845acb36b862871b62914 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca320bf8ae5490a9f58a770f772d5b8" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 35927 } } peers { permanent_uuid: "fa47523fa59f46cbbb7eb570c795596f" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 43457 } } peers { permanent_uuid: "9ef3c397d9d845acb36b862871b62914" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36819 } }
I20260808 04:44:10.391135 7531 ts_tablet_manager.cc:1428] T 2490250c91f24f4f93f918ec4cdb353d P fa47523fa59f46cbbb7eb570c795596f: Time spent starting tablet: real 0.005s user 0.003s sys 0.002s
I20260808 04:44:10.391248 7532 ts_tablet_manager.cc:1428] T 2490250c91f24f4f93f918ec4cdb353d P dca320bf8ae5490a9f58a770f772d5b8: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260808 04:44:10.391448 7018 heartbeater.cc:503] Master 127.12.148.126:34847 was elected leader, sending a full tablet report...
I20260808 04:44:10.391556 7538 ts_tablet_manager.cc:1428] T 2490250c91f24f4f93f918ec4cdb353d P 9ef3c397d9d845acb36b862871b62914: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260808 04:44:10.391857 7503 heartbeater.cc:503] Master 127.12.148.126:34847 was elected leader, sending a full tablet report...
I20260808 04:44:10.490309 7550 raft_consensus.cc:482] T 2490250c91f24f4f93f918ec4cdb353d P 9ef3c397d9d845acb36b862871b62914 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:44:10.490547 7550 raft_consensus.cc:504] T 2490250c91f24f4f93f918ec4cdb353d P 9ef3c397d9d845acb36b862871b62914 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca320bf8ae5490a9f58a770f772d5b8" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 35927 } } peers { permanent_uuid: "fa47523fa59f46cbbb7eb570c795596f" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 43457 } } peers { permanent_uuid: "9ef3c397d9d845acb36b862871b62914" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36819 } }
I20260808 04:44:10.491761 7550 leader_election.cc:288] T 2490250c91f24f4f93f918ec4cdb353d P 9ef3c397d9d845acb36b862871b62914 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dca320bf8ae5490a9f58a770f772d5b8 (127.12.148.66:35927), fa47523fa59f46cbbb7eb570c795596f (127.12.148.65:43457)
I20260808 04:44:10.495698 7530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:10.492292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:53567 (local address 127.12.148.65:43457)
0808 04:44:10.492415 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:10.492419 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:10.492436 (+ 17us) server_negotiation.cc:407] Connection header received
0808 04:44:10.492491 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:10.492494 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:10.492547 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:10.492621 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:10.492897 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:10.493549 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:10.494652 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:10.495103 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:10.495196 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:10.495254 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:10.495496 (+ 242us) server_negotiation.cc:299] Negotiation successful
0808 04:44:10.495572 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 04:44:10.495702 7527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:10.492194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:48727 (local address 127.12.148.66:35927)
0808 04:44:10.492322 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:10.492326 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:10.492604 (+ 278us) server_negotiation.cc:407] Connection header received
0808 04:44:10.492712 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:10.492715 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:10.492765 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:10.492851 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:10.493112 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:10.493715 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:10.494735 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:10.495159 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:10.495281 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:10.495332 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:10.495521 (+ 189us) server_negotiation.cc:299] Negotiation successful
0808 04:44:10.495596 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 04:44:10.495702 7506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:10.492010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:43457 (local address 127.12.148.67:53567)
0808 04:44:10.492196 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:10.492213 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:10.492317 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:10.492641 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:10.492644 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:10.492662 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:10.492789 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:10.492796 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:10.493679 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:10.493682 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:10.494512 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:10.494522 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:10.495234 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:10.495238 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:10.495344 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:10.495368 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 04:44:10.495430 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 04:44:10.495521 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99}
I20260808 04:44:10.495723 7551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:10.492015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:35927 (local address 127.12.148.67:48727)
0808 04:44:10.492498 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:10.492511 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:10.492615 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:10.492867 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:10.492870 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:10.492887 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:10.493004 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:10.493010 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:10.493816 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:10.493818 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:10.494582 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:10.494593 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:10.495291 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:10.495295 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:10.495371 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:10.495389 (+ 18us) client_negotiation.cc:769] Sending connection context
0808 04:44:10.495486 (+ 97us) client_negotiation.cc:240] Negotiation successful
0808 04:44:10.495557 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":425,"mutex_wait_us":53,"thread_start_us":141,"threads_started":1}
I20260808 04:44:10.496344 7174 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2490250c91f24f4f93f918ec4cdb353d" candidate_uuid: "9ef3c397d9d845acb36b862871b62914" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dca320bf8ae5490a9f58a770f772d5b8" is_pre_election: true
I20260808 04:44:10.496470 6930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2490250c91f24f4f93f918ec4cdb353d" candidate_uuid: "9ef3c397d9d845acb36b862871b62914" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa47523fa59f46cbbb7eb570c795596f" is_pre_election: true
I20260808 04:44:10.496682 7174 raft_consensus.cc:2454] T 2490250c91f24f4f93f918ec4cdb353d P dca320bf8ae5490a9f58a770f772d5b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ef3c397d9d845acb36b862871b62914 in term 0.
I20260808 04:44:10.496752 6930 raft_consensus.cc:2454] T 2490250c91f24f4f93f918ec4cdb353d P fa47523fa59f46cbbb7eb570c795596f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ef3c397d9d845acb36b862871b62914 in term 0.
I20260808 04:44:10.497213 7298 leader_election.cc:302] T 2490250c91f24f4f93f918ec4cdb353d P 9ef3c397d9d845acb36b862871b62914 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ef3c397d9d845acb36b862871b62914, dca320bf8ae5490a9f58a770f772d5b8; no voters:
I20260808 04:44:10.497485 7550 raft_consensus.cc:2781] T 2490250c91f24f4f93f918ec4cdb353d P 9ef3c397d9d845acb36b862871b62914 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:44:10.497566 7550 raft_consensus.cc:482] T 2490250c91f24f4f93f918ec4cdb353d P 9ef3c397d9d845acb36b862871b62914 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:44:10.497597 7550 raft_consensus.cc:3037] T 2490250c91f24f4f93f918ec4cdb353d P 9ef3c397d9d845acb36b862871b62914 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:10.498647 7550 raft_consensus.cc:504] T 2490250c91f24f4f93f918ec4cdb353d P 9ef3c397d9d845acb36b862871b62914 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca320bf8ae5490a9f58a770f772d5b8" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 35927 } } peers { permanent_uuid: "fa47523fa59f46cbbb7eb570c795596f" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 43457 } } peers { permanent_uuid: "9ef3c397d9d845acb36b862871b62914" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36819 } }
I20260808 04:44:10.498991 7550 leader_election.cc:288] T 2490250c91f24f4f93f918ec4cdb353d P 9ef3c397d9d845acb36b862871b62914 [CANDIDATE]: Term 1 election: Requested vote from peers dca320bf8ae5490a9f58a770f772d5b8 (127.12.148.66:35927), fa47523fa59f46cbbb7eb570c795596f (127.12.148.65:43457)
I20260808 04:44:10.499365 7174 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2490250c91f24f4f93f918ec4cdb353d" candidate_uuid: "9ef3c397d9d845acb36b862871b62914" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dca320bf8ae5490a9f58a770f772d5b8"
I20260808 04:44:10.499388 6930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2490250c91f24f4f93f918ec4cdb353d" candidate_uuid: "9ef3c397d9d845acb36b862871b62914" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa47523fa59f46cbbb7eb570c795596f"
I20260808 04:44:10.499500 7174 raft_consensus.cc:3037] T 2490250c91f24f4f93f918ec4cdb353d P dca320bf8ae5490a9f58a770f772d5b8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:10.499500 6930 raft_consensus.cc:3037] T 2490250c91f24f4f93f918ec4cdb353d P fa47523fa59f46cbbb7eb570c795596f [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:10.500512 7174 raft_consensus.cc:2454] T 2490250c91f24f4f93f918ec4cdb353d P dca320bf8ae5490a9f58a770f772d5b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ef3c397d9d845acb36b862871b62914 in term 1.
I20260808 04:44:10.500545 6930 raft_consensus.cc:2454] T 2490250c91f24f4f93f918ec4cdb353d P fa47523fa59f46cbbb7eb570c795596f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ef3c397d9d845acb36b862871b62914 in term 1.
I20260808 04:44:10.500820 7298 leader_election.cc:302] T 2490250c91f24f4f93f918ec4cdb353d P 9ef3c397d9d845acb36b862871b62914 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ef3c397d9d845acb36b862871b62914, dca320bf8ae5490a9f58a770f772d5b8; no voters:
I20260808 04:44:10.501001 7550 raft_consensus.cc:2781] T 2490250c91f24f4f93f918ec4cdb353d P 9ef3c397d9d845acb36b862871b62914 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:10.501251 7550 raft_consensus.cc:686] T 2490250c91f24f4f93f918ec4cdb353d P 9ef3c397d9d845acb36b862871b62914 [term 1 LEADER]: Becoming Leader. State: Replica: 9ef3c397d9d845acb36b862871b62914, State: Running, Role: LEADER
I20260808 04:44:10.501617 7550 consensus_queue.cc:237] T 2490250c91f24f4f93f918ec4cdb353d P 9ef3c397d9d845acb36b862871b62914 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca320bf8ae5490a9f58a770f772d5b8" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 35927 } } peers { permanent_uuid: "fa47523fa59f46cbbb7eb570c795596f" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 43457 } } peers { permanent_uuid: "9ef3c397d9d845acb36b862871b62914" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36819 } }
I20260808 04:44:10.504851 6660 catalog_manager.cc:5495] T 2490250c91f24f4f93f918ec4cdb353d P 9ef3c397d9d845acb36b862871b62914 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ef3c397d9d845acb36b862871b62914 (127.12.148.67). New cstate: current_term: 1 leader_uuid: "9ef3c397d9d845acb36b862871b62914" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca320bf8ae5490a9f58a770f772d5b8" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 35927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa47523fa59f46cbbb7eb570c795596f" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 43457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ef3c397d9d845acb36b862871b62914" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 36819 } health_report { overall_health: HEALTHY } } }
I20260808 04:44:10.517100 7528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:10.513643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46596 (local address 127.12.148.67:36819)
0808 04:44:10.513801 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:10.513804 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:10.513817 (+ 13us) server_negotiation.cc:407] Connection header received
0808 04:44:10.513915 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:10.513917 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:10.513974 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:10.514060 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:44:10.514297 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:10.514790 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:10.515674 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:10.515887 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:10.515976 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:10.516283 (+ 307us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:44:10.516692 (+ 409us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:44:10.516798 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:10.516884 (+ 86us) server_negotiation.cc:299] Negotiation successful
0808 04:44:10.516945 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260808 04:44:10.523624 7174 raft_consensus.cc:1261] T 2490250c91f24f4f93f918ec4cdb353d P dca320bf8ae5490a9f58a770f772d5b8 [term 1 FOLLOWER]: Refusing update from remote peer 9ef3c397d9d845acb36b862871b62914: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:44:10.523624 6930 raft_consensus.cc:1261] T 2490250c91f24f4f93f918ec4cdb353d P fa47523fa59f46cbbb7eb570c795596f [term 1 FOLLOWER]: Refusing update from remote peer 9ef3c397d9d845acb36b862871b62914: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:44:10.524471 7552 consensus_queue.cc:1035] T 2490250c91f24f4f93f918ec4cdb353d P 9ef3c397d9d845acb36b862871b62914 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa47523fa59f46cbbb7eb570c795596f" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 43457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:44:10.524670 7550 consensus_queue.cc:1035] T 2490250c91f24f4f93f918ec4cdb353d P 9ef3c397d9d845acb36b862871b62914 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dca320bf8ae5490a9f58a770f772d5b8" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 35927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:44:10.533677 7558 mvcc.cc:205] Tried to move back new op lower bound from 7316128770136465408 to 7316128770057478144. Current Snapshot: MvccSnapshot[applied={T|T < 7316128770136465408}]
I20260808 04:44:10.542385 6660 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52364:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:44:10.542559 6660 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52364:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:44:10.544749 6660 catalog_manager.cc:5782] T 00000000000000000000000000000000 P da0033eb75684bffa860d6114228e6a1: Sending DeleteTablet for 3 replicas of tablet 2490250c91f24f4f93f918ec4cdb353d
I20260808 04:44:10.545517 6889 tablet_service.cc:1514] Processing DeleteTablet for tablet 2490250c91f24f4f93f918ec4cdb353d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:44:10 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:59248
I20260808 04:44:10.545606 7137 tablet_service.cc:1514] Processing DeleteTablet for tablet 2490250c91f24f4f93f918ec4cdb353d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:44:10 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:34604
I20260808 04:44:10.545729 7389 tablet_service.cc:1514] Processing DeleteTablet for tablet 2490250c91f24f4f93f918ec4cdb353d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:44:10 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:46590
I20260808 04:44:10.546028 7580 tablet_replica.cc:330] T 2490250c91f24f4f93f918ec4cdb353d P fa47523fa59f46cbbb7eb570c795596f: stopping tablet replica
I20260808 04:44:10.546365 7580 raft_consensus.cc:2229] T 2490250c91f24f4f93f918ec4cdb353d P fa47523fa59f46cbbb7eb570c795596f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:44:10.546404 7581 tablet_replica.cc:330] T 2490250c91f24f4f93f918ec4cdb353d P dca320bf8ae5490a9f58a770f772d5b8: stopping tablet replica
I20260808 04:44:10.546662 7581 raft_consensus.cc:2229] T 2490250c91f24f4f93f918ec4cdb353d P dca320bf8ae5490a9f58a770f772d5b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:44:10.546779 7580 raft_consensus.cc:2258] T 2490250c91f24f4f93f918ec4cdb353d P fa47523fa59f46cbbb7eb570c795596f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:44:10.546782 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 6785
I20260808 04:44:10.560232 7582 tablet_replica.cc:330] T 2490250c91f24f4f93f918ec4cdb353d P 9ef3c397d9d845acb36b862871b62914: stopping tablet replica
I20260808 04:44:10.560559 7582 raft_consensus.cc:2229] T 2490250c91f24f4f93f918ec4cdb353d P 9ef3c397d9d845acb36b862871b62914 [term 1 LEADER]: Raft consensus shutting down.
I20260808 04:44:10.560984 7581 raft_consensus.cc:2258] T 2490250c91f24f4f93f918ec4cdb353d P dca320bf8ae5490a9f58a770f772d5b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:44:10.562068 7582 raft_consensus.cc:2258] T 2490250c91f24f4f93f918ec4cdb353d P 9ef3c397d9d845acb36b862871b62914 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:44:10.562728 7581 ts_tablet_manager.cc:1905] T 2490250c91f24f4f93f918ec4cdb353d P dca320bf8ae5490a9f58a770f772d5b8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:44:10.563525 7582 ts_tablet_manager.cc:1905] T 2490250c91f24f4f93f918ec4cdb353d P 9ef3c397d9d845acb36b862871b62914: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:44:10.565554 7581 ts_tablet_manager.cc:1918] T 2490250c91f24f4f93f918ec4cdb353d P dca320bf8ae5490a9f58a770f772d5b8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:44:10.565711 7581 log.cc:1196] T 2490250c91f24f4f93f918ec4cdb353d P dca320bf8ae5490a9f58a770f772d5b8: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-1/wal/wals/2490250c91f24f4f93f918ec4cdb353d
I20260808 04:44:10.566112 7581 ts_tablet_manager.cc:1939] T 2490250c91f24f4f93f918ec4cdb353d P dca320bf8ae5490a9f58a770f772d5b8: Deleting consensus metadata
I20260808 04:44:10.566313 7582 ts_tablet_manager.cc:1918] T 2490250c91f24f4f93f918ec4cdb353d P 9ef3c397d9d845acb36b862871b62914: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:44:10.566483 7582 log.cc:1196] T 2490250c91f24f4f93f918ec4cdb353d P 9ef3c397d9d845acb36b862871b62914: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786164004017495-12881-0/minicluster-data/ts-2/wal/wals/2490250c91f24f4f93f918ec4cdb353d
I20260808 04:44:10.566866 7582 ts_tablet_manager.cc:1939] T 2490250c91f24f4f93f918ec4cdb353d P 9ef3c397d9d845acb36b862871b62914: Deleting consensus metadata
W20260808 04:44:10.567313 6644 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.148.65:43457 (error 108)
I20260808 04:44:10.567559 6645 catalog_manager.cc:4841] TS dca320bf8ae5490a9f58a770f772d5b8 (127.12.148.66:35927): tablet 2490250c91f24f4f93f918ec4cdb353d (table test-table [id=917327c6994a40519f9f5081a63cec2b]) successfully deleted
I20260808 04:44:10.568414 7523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:10.568092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:43457 (local address 127.0.0.1:59258)
0808 04:44:10.568243 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:10.568323 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.65:43457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260808 04:44:10.568414 6645 catalog_manager.cc:4841] TS 9ef3c397d9d845acb36b862871b62914 (127.12.148.67:36819): tablet 2490250c91f24f4f93f918ec4cdb353d (table test-table [id=917327c6994a40519f9f5081a63cec2b]) successfully deleted
I20260808 04:44:10.568513 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 7033
W20260808 04:44:10.568671 6644 catalog_manager.cc:4584] TS fa47523fa59f46cbbb7eb570c795596f (127.12.148.65:43457): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2490250c91f24f4f93f918ec4cdb353d: Network error: Client connection negotiation failed: client connection to 127.12.148.65:43457: connect: Connection refused (error 111)
I20260808 04:44:10.589438 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 7266
I20260808 04:44:10.604487 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 6617
2026-08-08T04:44:10Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2604 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-08T04:44:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:10Z Disabled control of system clock
I20260808 04:44:10.643280 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:41283
--webserver_interface=127.12.148.126
--webserver_port=0
--builtin_ntp_servers=127.12.148.84:39045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:41283
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 04:44:10.755514 7590 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:10.755800 7590 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:10.755853 7590 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:10.759850 7590 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:10.759914 7590 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:10.759943 7590 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:10.759963 7590 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:10.759984 7590 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:10.764722 7590 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:39045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:41283
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:41283
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7590
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:10.765880 7590 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:10.767293 7590 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:10.775905 7600 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:10.775907 7597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:10.775906 7596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:10.776048 7590 server_base.cc:1034] running on GCE node
I20260808 04:44:10.776867 7590 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:10.778110 7590 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:10.779280 7590 hybrid_clock.cc:648] HybridClock initialized: now 1786164250779258 us; error 41 us; skew 500 ppm
I20260808 04:44:10.781114 7590 webserver.cc:460] Webserver started at http://127.12.148.126:41845/ using document root <none> and password file <none>
I20260808 04:44:10.781718 7590 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:10.781795 7590 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:10.782014 7590 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:10.784040 7590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "37306d6c15b74730914f013948c16668"
format_stamp: "Formatted at 2026-08-08 04:44:10 on dist-test-slave-t7g5"
server_key: "0ab5a1933839ee81585e0c0b835c924c"
server_key_iv: "593b14cb3d02661d2161a04830fed47b"
server_key_version: "encryptionkey@0"
I20260808 04:44:10.784590 7590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "37306d6c15b74730914f013948c16668"
format_stamp: "Formatted at 2026-08-08 04:44:10 on dist-test-slave-t7g5"
server_key: "0ab5a1933839ee81585e0c0b835c924c"
server_key_iv: "593b14cb3d02661d2161a04830fed47b"
server_key_version: "encryptionkey@0"
I20260808 04:44:10.788189 7590 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 04:44:10.790613 7609 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:10.791843 7590 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:44:10.791967 7590 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "37306d6c15b74730914f013948c16668"
format_stamp: "Formatted at 2026-08-08 04:44:10 on dist-test-slave-t7g5"
server_key: "0ab5a1933839ee81585e0c0b835c924c"
server_key_iv: "593b14cb3d02661d2161a04830fed47b"
server_key_version: "encryptionkey@0"
I20260808 04:44:10.792064 7590 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:10.801419 7590 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:10.802106 7590 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:10.802284 7590 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:10.808976 7590 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:41283
I20260808 04:44:10.809018 7678 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:41283 every 8 connection(s)
I20260808 04:44:10.809978 7590 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:10.813102 7680 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:10.818745 7680 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37306d6c15b74730914f013948c16668: Bootstrap starting.
I20260808 04:44:10.819104 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 7590
I20260808 04:44:10.819247 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:44:10.819556 12881 external_mini_cluster.cc:1428] Setting key 209f8bb91213c4ab72742621a976b866
I20260808 04:44:10.821553 7680 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 37306d6c15b74730914f013948c16668: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:10.822340 7680 log.cc:824] T 00000000000000000000000000000000 P 37306d6c15b74730914f013948c16668: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:10.824206 7680 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37306d6c15b74730914f013948c16668: No bootstrap required, opened a new log
I20260808 04:44:10.827828 7680 raft_consensus.cc:348] T 00000000000000000000000000000000 P 37306d6c15b74730914f013948c16668 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37306d6c15b74730914f013948c16668" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41283 } }
I20260808 04:44:10.828132 7680 raft_consensus.cc:374] T 00000000000000000000000000000000 P 37306d6c15b74730914f013948c16668 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:10.828207 7680 raft_consensus.cc:729] T 00000000000000000000000000000000 P 37306d6c15b74730914f013948c16668 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37306d6c15b74730914f013948c16668, State: Initialized, Role: FOLLOWER
I20260808 04:44:10.828672 7680 consensus_queue.cc:260] T 00000000000000000000000000000000 P 37306d6c15b74730914f013948c16668 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37306d6c15b74730914f013948c16668" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41283 } }
I20260808 04:44:10.828804 7680 raft_consensus.cc:388] T 00000000000000000000000000000000 P 37306d6c15b74730914f013948c16668 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:10.828866 7680 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37306d6c15b74730914f013948c16668 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:10.828974 7680 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 37306d6c15b74730914f013948c16668 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:10.829033 7684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:10.821006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43164 (local address 127.12.148.126:41283)
0808 04:44:10.821732 (+ 726us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:10.821750 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:10.821787 (+ 37us) server_negotiation.cc:407] Connection header received
0808 04:44:10.822439 (+ 652us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:10.822464 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:10.822870 (+ 406us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:10.823181 (+ 311us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:10.823624 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:10.824640 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:10.825548 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:10.826091 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:10.826245 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:10.827195 (+ 950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:10.827201 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:10.827215 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:10.827616 (+ 401us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:10.827675 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:10.827695 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:10.827781 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:10.827941 (+ 160us) server_negotiation.cc:299] Negotiation successful
0808 04:44:10.828205 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":141,"threads_started":1}
I20260808 04:44:10.829947 7680 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37306d6c15b74730914f013948c16668 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37306d6c15b74730914f013948c16668" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41283 } }
I20260808 04:44:10.830310 7680 leader_election.cc:302] T 00000000000000000000000000000000 P 37306d6c15b74730914f013948c16668 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 37306d6c15b74730914f013948c16668; no voters:
I20260808 04:44:10.830658 7680 leader_election.cc:288] T 00000000000000000000000000000000 P 37306d6c15b74730914f013948c16668 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:10.830762 7687 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 37306d6c15b74730914f013948c16668 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:10.831012 7687 raft_consensus.cc:686] T 00000000000000000000000000000000 P 37306d6c15b74730914f013948c16668 [term 1 LEADER]: Becoming Leader. State: Replica: 37306d6c15b74730914f013948c16668, State: Running, Role: LEADER
I20260808 04:44:10.831604 7687 consensus_queue.cc:237] T 00000000000000000000000000000000 P 37306d6c15b74730914f013948c16668 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37306d6c15b74730914f013948c16668" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41283 } }
I20260808 04:44:10.831931 7680 sys_catalog.cc:564] T 00000000000000000000000000000000 P 37306d6c15b74730914f013948c16668 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:10.833103 7693 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37306d6c15b74730914f013948c16668 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 37306d6c15b74730914f013948c16668. Latest consensus state: current_term: 1 leader_uuid: "37306d6c15b74730914f013948c16668" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37306d6c15b74730914f013948c16668" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41283 } } }
I20260808 04:44:10.833209 7693 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37306d6c15b74730914f013948c16668 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:10.833562 7705 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:10.833526 7689 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37306d6c15b74730914f013948c16668 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "37306d6c15b74730914f013948c16668" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37306d6c15b74730914f013948c16668" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41283 } } }
I20260808 04:44:10.833680 7689 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37306d6c15b74730914f013948c16668 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:10.836632 7705 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:10.841822 7705 catalog_manager.cc:1347] Generated new cluster ID: c41f261b5f7943379ff83234389f6701
I20260808 04:44:10.841898 7705 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:10.881400 7705 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:10.882778 7705 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:10.891151 7705 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 37306d6c15b74730914f013948c16668: Generated new TSK 0
I20260808 04:44:10.891892 7705 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:44:10.895159 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.65:0
--local_ip_for_outbound_sockets=127.12.148.65
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:41283
--builtin_ntp_servers=127.12.148.84:39045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 04:44:11.024572 7723 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:11.024871 7723 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:11.024926 7723 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:11.028960 7723 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:11.029032 7723 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:11.029109 7723 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.65
I20260808 04:44:11.034608 7723 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:39045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:41283
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7723
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.65
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:11.035830 7723 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:11.037304 7723 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:11.047116 7737 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:11.047124 7731 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:11.047124 7733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:11.047406 7723 server_base.cc:1034] running on GCE node
I20260808 04:44:11.047894 7723 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:11.048537 7723 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:11.049702 7723 hybrid_clock.cc:648] HybridClock initialized: now 1786164251049672 us; error 42 us; skew 500 ppm
I20260808 04:44:11.051450 7723 webserver.cc:460] Webserver started at http://127.12.148.65:36719/ using document root <none> and password file <none>
I20260808 04:44:11.052023 7723 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:11.052093 7723 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:11.052285 7723 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:11.054461 7723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-0/data/instance:
uuid: "f4e05cbd18e04fdd969371f888d318ee"
format_stamp: "Formatted at 2026-08-08 04:44:11 on dist-test-slave-t7g5"
server_key: "0761b9e1f60295b2e6bac381e09ea89c"
server_key_iv: "43e7c23efb6166c82d8bec8897df0667"
server_key_version: "encryptionkey@0"
I20260808 04:44:11.055027 7723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance:
uuid: "f4e05cbd18e04fdd969371f888d318ee"
format_stamp: "Formatted at 2026-08-08 04:44:11 on dist-test-slave-t7g5"
server_key: "0761b9e1f60295b2e6bac381e09ea89c"
server_key_iv: "43e7c23efb6166c82d8bec8897df0667"
server_key_version: "encryptionkey@0"
I20260808 04:44:11.058673 7723 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 04:44:11.061025 7746 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:11.062235 7723 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:44:11.062341 7723 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-0/wal
uuid: "f4e05cbd18e04fdd969371f888d318ee"
format_stamp: "Formatted at 2026-08-08 04:44:11 on dist-test-slave-t7g5"
server_key: "0761b9e1f60295b2e6bac381e09ea89c"
server_key_iv: "43e7c23efb6166c82d8bec8897df0667"
server_key_version: "encryptionkey@0"
I20260808 04:44:11.062438 7723 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:11.076642 7723 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:11.077255 7723 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:11.077420 7723 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:11.078016 7723 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:44:11.078917 7723 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:44:11.078974 7723 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:11.079028 7723 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:44:11.079059 7723 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:11.087378 7723 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.65:44241
I20260808 04:44:11.087416 7938 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.65:44241 every 8 connection(s)
I20260808 04:44:11.088238 7723 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
I20260808 04:44:11.093593 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 7723
I20260808 04:44:11.093791 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance
I20260808 04:44:11.094089 12881 external_mini_cluster.cc:1428] Setting key 2d4b93cbdc28bf98cc90e9abcab482b6
I20260808 04:44:11.096118 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.66:0
--local_ip_for_outbound_sockets=127.12.148.66
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:41283
--builtin_ntp_servers=127.12.148.84:39045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 04:44:11.097497 7684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:11.090003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:38809 (local address 127.12.148.126:41283)
0808 04:44:11.090181 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:11.090186 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:11.091229 (+ 1043us) server_negotiation.cc:407] Connection header received
0808 04:44:11.092542 (+ 1313us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:11.092545 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:11.092592 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:11.092665 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:11.093588 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:11.094248 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:11.095582 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:11.095803 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:11.095891 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:11.097034 (+ 1143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:11.097038 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:11.097041 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:11.097053 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:11.097073 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:11.097081 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:11.097138 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:11.097295 (+ 157us) server_negotiation.cc:299] Negotiation successful
0808 04:44:11.097355 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 04:44:11.098397 7942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:11.090419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41283 (local address 127.12.148.65:38809)
0808 04:44:11.091077 (+ 658us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:11.091118 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:11.092346 (+ 1228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:11.092831 (+ 485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:11.092838 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:11.092921 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:11.093418 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:11.093443 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:11.094374 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:11.094377 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:11.095444 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:11.095470 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:11.095949 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:11.095953 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:11.096140 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:11.096780 (+ 640us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:44:11.096782 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:11.096821 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:44:11.096886 (+ 65us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:11.097154 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:11.097164 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:11.097170 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 04:44:11.097284 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 04:44:11.097575 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":111,"threads_started":1}
I20260808 04:44:11.099596 7939 heartbeater.cc:347] Connected to a master server at 127.12.148.126:41283
I20260808 04:44:11.099839 7939 heartbeater.cc:464] Registering TS with master...
I20260808 04:44:11.100351 7939 heartbeater.cc:511] Master 127.12.148.126:41283 requested a full tablet report, sending...
I20260808 04:44:11.101824 7635 ts_manager.cc:194] Registered new tserver with Master: f4e05cbd18e04fdd969371f888d318ee (127.12.148.65:44241)
I20260808 04:44:11.102936 7635 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.148.65:38809
W20260808 04:44:11.211397 7943 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:11.211714 7943 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:11.211760 7943 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:11.216038 7943 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:11.216126 7943 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:11.216212 7943 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.66
I20260808 04:44:11.221414 7943 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:39045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:41283
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7943
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.66
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:11.222676 7943 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:11.224224 7943 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:11.234040 7949 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:11.234041 7948 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:11.234043 7951 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:11.234239 7943 server_base.cc:1034] running on GCE node
I20260808 04:44:11.234740 7943 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:11.235389 7943 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:11.236595 7943 hybrid_clock.cc:648] HybridClock initialized: now 1786164251236571 us; error 35 us; skew 500 ppm
I20260808 04:44:11.238463 7943 webserver.cc:460] Webserver started at http://127.12.148.66:38945/ using document root <none> and password file <none>
I20260808 04:44:11.239030 7943 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:11.239102 7943 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:11.239301 7943 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:11.241304 7943 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-1/data/instance:
uuid: "247f359779a9488cb91017189ed44c47"
format_stamp: "Formatted at 2026-08-08 04:44:11 on dist-test-slave-t7g5"
server_key: "8efaf6e371ce70ee9067207aaa49c6e7"
server_key_iv: "5ebf3b0a7aeaebcd0a6c55cf53b6e8f4"
server_key_version: "encryptionkey@0"
I20260808 04:44:11.241950 7943 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance:
uuid: "247f359779a9488cb91017189ed44c47"
format_stamp: "Formatted at 2026-08-08 04:44:11 on dist-test-slave-t7g5"
server_key: "8efaf6e371ce70ee9067207aaa49c6e7"
server_key_iv: "5ebf3b0a7aeaebcd0a6c55cf53b6e8f4"
server_key_version: "encryptionkey@0"
I20260808 04:44:11.245743 7943 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260808 04:44:11.248080 7962 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:11.249301 7943 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:44:11.249432 7943 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-1/wal
uuid: "247f359779a9488cb91017189ed44c47"
format_stamp: "Formatted at 2026-08-08 04:44:11 on dist-test-slave-t7g5"
server_key: "8efaf6e371ce70ee9067207aaa49c6e7"
server_key_iv: "5ebf3b0a7aeaebcd0a6c55cf53b6e8f4"
server_key_version: "encryptionkey@0"
I20260808 04:44:11.249536 7943 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:11.258365 7943 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:11.258989 7943 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:11.259164 7943 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:11.259724 7943 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:44:11.260702 7943 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:44:11.260753 7943 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:11.260807 7943 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:44:11.260838 7943 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:11.269721 7943 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.66:40675
I20260808 04:44:11.269764 8171 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.66:40675 every 8 connection(s)
I20260808 04:44:11.270614 7943 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
I20260808 04:44:11.274380 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 7943
I20260808 04:44:11.274533 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance
I20260808 04:44:11.274860 12881 external_mini_cluster.cc:1428] Setting key a4d0dcc95be45ac4ba4d0a508063eccd
I20260808 04:44:11.276990 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.67:0
--local_ip_for_outbound_sockets=127.12.148.67
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:41283
--builtin_ntp_servers=127.12.148.84:39045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 04:44:11.280141 7684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:11.272423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:40835 (local address 127.12.148.126:41283)
0808 04:44:11.272557 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:11.272561 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:11.273551 (+ 990us) server_negotiation.cc:407] Connection header received
0808 04:44:11.275203 (+ 1652us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:11.275206 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:11.275264 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:11.275353 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:11.276494 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:11.277043 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:11.278283 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:11.278498 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:11.278585 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:11.279663 (+ 1078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:11.279667 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:11.279670 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:11.279683 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:11.279703 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:11.279710 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:11.279768 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:11.279932 (+ 164us) server_negotiation.cc:299] Negotiation successful
0808 04:44:11.279996 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 04:44:11.280978 8178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:11.272738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41283 (local address 127.12.148.66:40835)
0808 04:44:11.273377 (+ 639us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:11.273425 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:11.274955 (+ 1530us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:11.275547 (+ 592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:11.275556 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:11.275664 (+ 108us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:11.276324 (+ 660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:11.276342 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:11.277195 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:11.277198 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:11.278154 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:11.278164 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:11.278650 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:11.278654 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:11.278813 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:11.279401 (+ 588us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:44:11.279403 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:11.279445 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:44:11.279509 (+ 64us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:11.279787 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:11.279797 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:11.279803 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 04:44:11.279913 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 04:44:11.280193 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":113,"threads_started":1}
I20260808 04:44:11.282096 8173 heartbeater.cc:347] Connected to a master server at 127.12.148.126:41283
I20260808 04:44:11.282366 8173 heartbeater.cc:464] Registering TS with master...
I20260808 04:44:11.282999 8173 heartbeater.cc:511] Master 127.12.148.126:41283 requested a full tablet report, sending...
I20260808 04:44:11.284195 7635 ts_manager.cc:194] Registered new tserver with Master: 247f359779a9488cb91017189ed44c47 (127.12.148.66:40675)
I20260808 04:44:11.284749 7635 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.148.66:40835
W20260808 04:44:11.395640 8179 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:11.395931 8179 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:11.395975 8179 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:11.400058 8179 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:11.400120 8179 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:11.400177 8179 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.67
I20260808 04:44:11.404950 8179 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:39045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:41283
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8179
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.67
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:11.406075 8179 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:11.407433 8179 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:11.417510 8188 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:11.417517 8189 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:11.417555 8179 server_base.cc:1034] running on GCE node
W20260808 04:44:11.417517 8191 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:11.418140 8179 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:11.418776 8179 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:11.419946 8179 hybrid_clock.cc:648] HybridClock initialized: now 1786164251419927 us; error 27 us; skew 500 ppm
I20260808 04:44:11.421732 8179 webserver.cc:460] Webserver started at http://127.12.148.67:35925/ using document root <none> and password file <none>
I20260808 04:44:11.422276 8179 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:11.422336 8179 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:11.422518 8179 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:11.424556 8179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-2/data/instance:
uuid: "420ce4d3da564316850d13255983fa2f"
format_stamp: "Formatted at 2026-08-08 04:44:11 on dist-test-slave-t7g5"
server_key: "562d08e3c62ec6c85edb140460f89333"
server_key_iv: "8241bf425ca46bb8d581087b08562c0d"
server_key_version: "encryptionkey@0"
I20260808 04:44:11.425073 8179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance:
uuid: "420ce4d3da564316850d13255983fa2f"
format_stamp: "Formatted at 2026-08-08 04:44:11 on dist-test-slave-t7g5"
server_key: "562d08e3c62ec6c85edb140460f89333"
server_key_iv: "8241bf425ca46bb8d581087b08562c0d"
server_key_version: "encryptionkey@0"
I20260808 04:44:11.428930 8179 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 04:44:11.431277 8199 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:11.432480 8179 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 04:44:11.432619 8179 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-2/wal
uuid: "420ce4d3da564316850d13255983fa2f"
format_stamp: "Formatted at 2026-08-08 04:44:11 on dist-test-slave-t7g5"
server_key: "562d08e3c62ec6c85edb140460f89333"
server_key_iv: "8241bf425ca46bb8d581087b08562c0d"
server_key_version: "encryptionkey@0"
I20260808 04:44:11.432719 8179 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:11.456012 8179 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:11.456687 8179 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:11.456868 8179 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:11.457456 8179 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:44:11.458534 8179 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:44:11.458671 8179 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:11.458771 8179 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:44:11.458804 8179 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:11.467280 8179 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.67:37133
I20260808 04:44:11.467339 8425 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.67:37133 every 8 connection(s)
I20260808 04:44:11.468248 8179 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
I20260808 04:44:11.475255 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 8179
I20260808 04:44:11.475355 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance
I20260808 04:44:11.475664 12881 external_mini_cluster.cc:1428] Setting key 7c0722c9ec04ece274f13e2e4ad2b919
I20260808 04:44:11.477492 7684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:11.470150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:32827 (local address 127.12.148.126:41283)
0808 04:44:11.470314 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:11.470319 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:11.471388 (+ 1069us) server_negotiation.cc:407] Connection header received
0808 04:44:11.472725 (+ 1337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:11.472728 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:11.472776 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:11.472848 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:11.473754 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:11.474272 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:11.475429 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:11.475762 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:11.475871 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:11.477003 (+ 1132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:11.477007 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:11.477009 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:11.477020 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:11.477042 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:11.477053 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:11.477124 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:11.477274 (+ 150us) server_negotiation.cc:299] Negotiation successful
0808 04:44:11.477335 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 04:44:11.478343 8432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:11.470562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41283 (local address 127.12.148.67:32827)
0808 04:44:11.471246 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:11.471288 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:11.472532 (+ 1244us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:11.473012 (+ 480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:11.473019 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:11.473103 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:11.473596 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:11.473608 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:11.474377 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:11.474379 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:11.475287 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:11.475297 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:11.475903 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:11.475906 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:11.476073 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:11.476711 (+ 638us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:44:11.476712 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:11.476753 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:44:11.476833 (+ 80us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:11.477140 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:11.477149 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:11.477153 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 04:44:11.477259 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 04:44:11.477487 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":122,"threads_started":1}
I20260808 04:44:11.479360 8427 heartbeater.cc:347] Connected to a master server at 127.12.148.126:41283
I20260808 04:44:11.479588 8427 heartbeater.cc:464] Registering TS with master...
I20260808 04:44:11.480074 8427 heartbeater.cc:511] Master 127.12.148.126:41283 requested a full tablet report, sending...
I20260808 04:44:11.481081 7635 ts_manager.cc:194] Registered new tserver with Master: 420ce4d3da564316850d13255983fa2f (127.12.148.67:37133)
I20260808 04:44:11.481786 7635 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.148.67:32827
I20260808 04:44:11.489562 12881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 04:44:11.495261 7684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:11.491523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43168 (local address 127.12.148.126:41283)
0808 04:44:11.491637 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:11.491642 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:11.491831 (+ 189us) server_negotiation.cc:407] Connection header received
0808 04:44:11.491950 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:11.491954 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:11.491997 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:11.492061 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:11.492348 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:11.492858 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:11.493691 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:11.493904 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:11.494001 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:11.494714 (+ 713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:11.494717 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:11.494719 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:11.494731 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:11.494752 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:11.494845 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:11.494938 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:11.495055 (+ 117us) server_negotiation.cc:299] Negotiation successful
0808 04:44:11.495118 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 04:44:11.498261 7635 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43168:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:44:11.501320 7635 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:44:11.516746 8471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:11.510950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38980 (local address 127.12.148.66:40675)
0808 04:44:11.511402 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:11.511415 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:11.511742 (+ 327us) server_negotiation.cc:407] Connection header received
0808 04:44:11.511839 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:11.511845 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:11.512093 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:11.512278 (+ 185us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:11.512854 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:11.513997 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:11.515289 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:11.516046 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:11.516147 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:11.516360 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:11.516494 (+ 134us) server_negotiation.cc:299] Negotiation successful
0808 04:44:11.516596 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":120,"threads_started":1}
I20260808 04:44:11.516741 8469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:11.510784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:40675 (local address 127.0.0.1:38980)
0808 04:44:11.511355 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:11.511413 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:11.511565 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:11.512484 (+ 919us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:11.512491 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:11.512516 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:11.512682 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:11.512691 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:11.514104 (+ 1413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:11.514107 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:11.515143 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:11.515155 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:11.516166 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:11.516169 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:11.516280 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:11.516329 (+ 49us) client_negotiation.cc:769] Sending connection context
0808 04:44:11.516443 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 04:44:11.516577 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":95,"threads_started":1}
I20260808 04:44:11.517391 8468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:11.510918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.67:37133 (local address 127.0.0.1:50376)
0808 04:44:11.511687 (+ 769us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:11.511702 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:11.511897 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:11.512987 (+ 1090us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:11.512990 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:11.513010 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:11.513120 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:11.513127 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:11.514335 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:11.514339 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:11.515505 (+ 1166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:11.515518 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:11.516949 (+ 1431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:11.516953 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:11.517051 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:11.517077 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 04:44:11.517160 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 04:44:11.517236 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":664,"thread_start_us":151,"threads_started":1}
I20260808 04:44:11.517506 8472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:11.511815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50376 (local address 127.12.148.67:37133)
0808 04:44:11.512336 (+ 521us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:11.512351 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:11.512378 (+ 27us) server_negotiation.cc:407] Connection header received
0808 04:44:11.512462 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:11.512467 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:11.512676 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:11.512835 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:11.513285 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:11.514208 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:11.515677 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:11.516542 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:11.516629 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:11.516833 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:11.517228 (+ 395us) server_negotiation.cc:299] Negotiation successful
0808 04:44:11.517353 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":118,"threads_started":1}
I20260808 04:44:11.518754 8474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:11.512225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:44241 (local address 127.0.0.1:52038)
0808 04:44:11.513049 (+ 824us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:11.513061 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:11.513138 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:11.513647 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:11.513672 (+ 25us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:11.513692 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:11.513776 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:11.513781 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:11.515122 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:11.515126 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:11.516241 (+ 1115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:11.516254 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:11.517548 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:11.517552 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:11.518416 (+ 864us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:11.518446 (+ 30us) client_negotiation.cc:769] Sending connection context
0808 04:44:11.518533 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 04:44:11.518608 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":765,"thread_start_us":114,"threads_started":1}
I20260808 04:44:11.519254 8475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:11.512658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52038 (local address 127.12.148.65:44241)
0808 04:44:11.513159 (+ 501us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:11.513172 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:11.513198 (+ 26us) server_negotiation.cc:407] Connection header received
0808 04:44:11.513291 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:11.513297 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:11.513484 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:11.513645 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:11.513899 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:11.514975 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:11.516405 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:11.517170 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:11.517282 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:11.517475 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:11.518953 (+ 1478us) server_negotiation.cc:299] Negotiation successful
0808 04:44:11.519068 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":107,"threads_started":1}
I20260808 04:44:11.520419 8300 tablet_service.cc:1467] Processing CreateTablet for tablet ae258b0a11ac4778b4aa478f29eb54f0 (DEFAULT_TABLE table=test-table [id=631ad7d587f94a32980221a2b73215f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:44:11.520427 8046 tablet_service.cc:1467] Processing CreateTablet for tablet ae258b0a11ac4778b4aa478f29eb54f0 (DEFAULT_TABLE table=test-table [id=631ad7d587f94a32980221a2b73215f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:44:11.521435 8300 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae258b0a11ac4778b4aa478f29eb54f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:11.521529 8046 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae258b0a11ac4778b4aa478f29eb54f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:11.522447 7834 tablet_service.cc:1467] Processing CreateTablet for tablet ae258b0a11ac4778b4aa478f29eb54f0 (DEFAULT_TABLE table=test-table [id=631ad7d587f94a32980221a2b73215f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:44:11.523541 7834 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae258b0a11ac4778b4aa478f29eb54f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:11.528347 8478 tablet_bootstrap.cc:492] T ae258b0a11ac4778b4aa478f29eb54f0 P 420ce4d3da564316850d13255983fa2f: Bootstrap starting.
I20260808 04:44:11.529093 8481 tablet_bootstrap.cc:492] T ae258b0a11ac4778b4aa478f29eb54f0 P 247f359779a9488cb91017189ed44c47: Bootstrap starting.
I20260808 04:44:11.530764 8478 tablet_bootstrap.cc:654] T ae258b0a11ac4778b4aa478f29eb54f0 P 420ce4d3da564316850d13255983fa2f: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:11.530864 8482 tablet_bootstrap.cc:492] T ae258b0a11ac4778b4aa478f29eb54f0 P f4e05cbd18e04fdd969371f888d318ee: Bootstrap starting.
I20260808 04:44:11.531344 8481 tablet_bootstrap.cc:654] T ae258b0a11ac4778b4aa478f29eb54f0 P 247f359779a9488cb91017189ed44c47: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:11.531770 8478 log.cc:824] T ae258b0a11ac4778b4aa478f29eb54f0 P 420ce4d3da564316850d13255983fa2f: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:11.532294 8481 log.cc:824] T ae258b0a11ac4778b4aa478f29eb54f0 P 247f359779a9488cb91017189ed44c47: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:11.533186 8482 tablet_bootstrap.cc:654] T ae258b0a11ac4778b4aa478f29eb54f0 P f4e05cbd18e04fdd969371f888d318ee: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:11.534180 8478 tablet_bootstrap.cc:492] T ae258b0a11ac4778b4aa478f29eb54f0 P 420ce4d3da564316850d13255983fa2f: No bootstrap required, opened a new log
I20260808 04:44:11.534237 8482 log.cc:824] T ae258b0a11ac4778b4aa478f29eb54f0 P f4e05cbd18e04fdd969371f888d318ee: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:11.534422 8478 ts_tablet_manager.cc:1397] T ae258b0a11ac4778b4aa478f29eb54f0 P 420ce4d3da564316850d13255983fa2f: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 04:44:11.534914 8481 tablet_bootstrap.cc:492] T ae258b0a11ac4778b4aa478f29eb54f0 P 247f359779a9488cb91017189ed44c47: No bootstrap required, opened a new log
I20260808 04:44:11.535107 8481 ts_tablet_manager.cc:1397] T ae258b0a11ac4778b4aa478f29eb54f0 P 247f359779a9488cb91017189ed44c47: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 04:44:11.536433 8482 tablet_bootstrap.cc:492] T ae258b0a11ac4778b4aa478f29eb54f0 P f4e05cbd18e04fdd969371f888d318ee: No bootstrap required, opened a new log
I20260808 04:44:11.536617 8482 ts_tablet_manager.cc:1397] T ae258b0a11ac4778b4aa478f29eb54f0 P f4e05cbd18e04fdd969371f888d318ee: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 04:44:11.538291 8478 raft_consensus.cc:348] T ae258b0a11ac4778b4aa478f29eb54f0 P 420ce4d3da564316850d13255983fa2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247f359779a9488cb91017189ed44c47" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40675 } } peers { permanent_uuid: "420ce4d3da564316850d13255983fa2f" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37133 } } peers { permanent_uuid: "f4e05cbd18e04fdd969371f888d318ee" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 44241 } }
I20260808 04:44:11.538528 8478 raft_consensus.cc:374] T ae258b0a11ac4778b4aa478f29eb54f0 P 420ce4d3da564316850d13255983fa2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:11.538618 8478 raft_consensus.cc:729] T ae258b0a11ac4778b4aa478f29eb54f0 P 420ce4d3da564316850d13255983fa2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420ce4d3da564316850d13255983fa2f, State: Initialized, Role: FOLLOWER
I20260808 04:44:11.539075 8478 consensus_queue.cc:260] T ae258b0a11ac4778b4aa478f29eb54f0 P 420ce4d3da564316850d13255983fa2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247f359779a9488cb91017189ed44c47" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40675 } } peers { permanent_uuid: "420ce4d3da564316850d13255983fa2f" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37133 } } peers { permanent_uuid: "f4e05cbd18e04fdd969371f888d318ee" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 44241 } }
I20260808 04:44:11.539176 8481 raft_consensus.cc:348] T ae258b0a11ac4778b4aa478f29eb54f0 P 247f359779a9488cb91017189ed44c47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247f359779a9488cb91017189ed44c47" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40675 } } peers { permanent_uuid: "420ce4d3da564316850d13255983fa2f" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37133 } } peers { permanent_uuid: "f4e05cbd18e04fdd969371f888d318ee" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 44241 } }
I20260808 04:44:11.539501 8481 raft_consensus.cc:374] T ae258b0a11ac4778b4aa478f29eb54f0 P 247f359779a9488cb91017189ed44c47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:11.539593 8481 raft_consensus.cc:729] T ae258b0a11ac4778b4aa478f29eb54f0 P 247f359779a9488cb91017189ed44c47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 247f359779a9488cb91017189ed44c47, State: Initialized, Role: FOLLOWER
I20260808 04:44:11.539776 8427 heartbeater.cc:503] Master 127.12.148.126:41283 was elected leader, sending a full tablet report...
I20260808 04:44:11.540117 8478 ts_tablet_manager.cc:1428] T ae258b0a11ac4778b4aa478f29eb54f0 P 420ce4d3da564316850d13255983fa2f: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 04:44:11.540108 8481 consensus_queue.cc:260] T ae258b0a11ac4778b4aa478f29eb54f0 P 247f359779a9488cb91017189ed44c47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247f359779a9488cb91017189ed44c47" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40675 } } peers { permanent_uuid: "420ce4d3da564316850d13255983fa2f" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37133 } } peers { permanent_uuid: "f4e05cbd18e04fdd969371f888d318ee" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 44241 } }
I20260808 04:44:11.541172 8481 ts_tablet_manager.cc:1428] T ae258b0a11ac4778b4aa478f29eb54f0 P 247f359779a9488cb91017189ed44c47: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 04:44:11.541512 8173 heartbeater.cc:503] Master 127.12.148.126:41283 was elected leader, sending a full tablet report...
I20260808 04:44:11.541497 8482 raft_consensus.cc:348] T ae258b0a11ac4778b4aa478f29eb54f0 P f4e05cbd18e04fdd969371f888d318ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247f359779a9488cb91017189ed44c47" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40675 } } peers { permanent_uuid: "420ce4d3da564316850d13255983fa2f" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37133 } } peers { permanent_uuid: "f4e05cbd18e04fdd969371f888d318ee" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 44241 } }
I20260808 04:44:11.541800 8482 raft_consensus.cc:374] T ae258b0a11ac4778b4aa478f29eb54f0 P f4e05cbd18e04fdd969371f888d318ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:11.541857 8482 raft_consensus.cc:729] T ae258b0a11ac4778b4aa478f29eb54f0 P f4e05cbd18e04fdd969371f888d318ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4e05cbd18e04fdd969371f888d318ee, State: Initialized, Role: FOLLOWER
I20260808 04:44:11.542289 8482 consensus_queue.cc:260] T ae258b0a11ac4778b4aa478f29eb54f0 P f4e05cbd18e04fdd969371f888d318ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247f359779a9488cb91017189ed44c47" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40675 } } peers { permanent_uuid: "420ce4d3da564316850d13255983fa2f" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37133 } } peers { permanent_uuid: "f4e05cbd18e04fdd969371f888d318ee" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 44241 } }
I20260808 04:44:11.542979 7939 heartbeater.cc:503] Master 127.12.148.126:41283 was elected leader, sending a full tablet report...
I20260808 04:44:11.543262 8482 ts_tablet_manager.cc:1428] T ae258b0a11ac4778b4aa478f29eb54f0 P f4e05cbd18e04fdd969371f888d318ee: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
W20260808 04:44:11.589344 7941 tablet.cc:2369] T ae258b0a11ac4778b4aa478f29eb54f0 P f4e05cbd18e04fdd969371f888d318ee: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:44:11.645460 8490 raft_consensus.cc:482] T ae258b0a11ac4778b4aa478f29eb54f0 P 247f359779a9488cb91017189ed44c47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:44:11.645690 8490 raft_consensus.cc:504] T ae258b0a11ac4778b4aa478f29eb54f0 P 247f359779a9488cb91017189ed44c47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247f359779a9488cb91017189ed44c47" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40675 } } peers { permanent_uuid: "420ce4d3da564316850d13255983fa2f" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37133 } } peers { permanent_uuid: "f4e05cbd18e04fdd969371f888d318ee" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 44241 } }
I20260808 04:44:11.646813 8490 leader_election.cc:288] T ae258b0a11ac4778b4aa478f29eb54f0 P 247f359779a9488cb91017189ed44c47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420ce4d3da564316850d13255983fa2f (127.12.148.67:37133), f4e05cbd18e04fdd969371f888d318ee (127.12.148.65:44241)
I20260808 04:44:11.650602 8472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:11.647142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:57817 (local address 127.12.148.67:37133)
0808 04:44:11.647303 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:11.647307 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:11.647326 (+ 19us) server_negotiation.cc:407] Connection header received
0808 04:44:11.647469 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:11.647472 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:11.647533 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:11.647608 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:11.647938 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:11.648514 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:11.649583 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:11.650033 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:11.650143 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:11.650195 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:11.650405 (+ 210us) server_negotiation.cc:299] Negotiation successful
0808 04:44:11.650478 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 04:44:11.650615 8475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:11.647194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:54401 (local address 127.12.148.65:44241)
0808 04:44:11.647301 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:11.647305 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:11.647572 (+ 267us) server_negotiation.cc:407] Connection header received
0808 04:44:11.647689 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:11.647692 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:11.647743 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:11.647837 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:11.648138 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:11.648637 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:11.649639 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:11.650057 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:11.650166 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:11.650213 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:11.650425 (+ 212us) server_negotiation.cc:299] Negotiation successful
0808 04:44:11.650494 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 04:44:11.650616 8178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:11.647048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.67:37133 (local address 127.12.148.66:57817)
0808 04:44:11.647254 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:11.647269 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:11.647363 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:11.647630 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:11.647633 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:11.647650 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:11.647780 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:11.647788 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:11.648630 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:11.648634 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:11.649459 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:11.649469 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:11.650157 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:11.650161 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:11.650258 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:11.650313 (+ 55us) client_negotiation.cc:769] Sending connection context
0808 04:44:11.650373 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 04:44:11.650463 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"mutex_wait_us":22}
I20260808 04:44:11.650630 8494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:11.647074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:44241 (local address 127.12.148.66:54401)
0808 04:44:11.647466 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:11.647480 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:11.647588 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:11.647872 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:11.647875 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:11.647897 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:11.648016 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:11.648023 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:11.648744 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:11.648747 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:11.649515 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:11.649525 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:11.650183 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:11.650186 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:11.650291 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:11.650326 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 04:44:11.650394 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 04:44:11.650462 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":332,"mutex_wait_us":16,"thread_start_us":114,"threads_started":1}
I20260808 04:44:11.651247 8331 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae258b0a11ac4778b4aa478f29eb54f0" candidate_uuid: "247f359779a9488cb91017189ed44c47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420ce4d3da564316850d13255983fa2f" is_pre_election: true
I20260808 04:44:11.651412 7863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae258b0a11ac4778b4aa478f29eb54f0" candidate_uuid: "247f359779a9488cb91017189ed44c47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4e05cbd18e04fdd969371f888d318ee" is_pre_election: true
I20260808 04:44:11.651532 8331 raft_consensus.cc:2454] T ae258b0a11ac4778b4aa478f29eb54f0 P 420ce4d3da564316850d13255983fa2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 247f359779a9488cb91017189ed44c47 in term 0.
I20260808 04:44:11.651692 7863 raft_consensus.cc:2454] T ae258b0a11ac4778b4aa478f29eb54f0 P f4e05cbd18e04fdd969371f888d318ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 247f359779a9488cb91017189ed44c47 in term 0.
I20260808 04:44:11.652009 7963 leader_election.cc:302] T ae258b0a11ac4778b4aa478f29eb54f0 P 247f359779a9488cb91017189ed44c47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 247f359779a9488cb91017189ed44c47, 420ce4d3da564316850d13255983fa2f; no voters:
I20260808 04:44:11.652312 8490 raft_consensus.cc:2781] T ae258b0a11ac4778b4aa478f29eb54f0 P 247f359779a9488cb91017189ed44c47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:44:11.652393 8490 raft_consensus.cc:482] T ae258b0a11ac4778b4aa478f29eb54f0 P 247f359779a9488cb91017189ed44c47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:44:11.652442 8490 raft_consensus.cc:3037] T ae258b0a11ac4778b4aa478f29eb54f0 P 247f359779a9488cb91017189ed44c47 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:11.653487 8490 raft_consensus.cc:504] T ae258b0a11ac4778b4aa478f29eb54f0 P 247f359779a9488cb91017189ed44c47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247f359779a9488cb91017189ed44c47" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40675 } } peers { permanent_uuid: "420ce4d3da564316850d13255983fa2f" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37133 } } peers { permanent_uuid: "f4e05cbd18e04fdd969371f888d318ee" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 44241 } }
I20260808 04:44:11.653826 8490 leader_election.cc:288] T ae258b0a11ac4778b4aa478f29eb54f0 P 247f359779a9488cb91017189ed44c47 [CANDIDATE]: Term 1 election: Requested vote from peers 420ce4d3da564316850d13255983fa2f (127.12.148.67:37133), f4e05cbd18e04fdd969371f888d318ee (127.12.148.65:44241)
I20260808 04:44:11.654152 8331 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae258b0a11ac4778b4aa478f29eb54f0" candidate_uuid: "247f359779a9488cb91017189ed44c47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420ce4d3da564316850d13255983fa2f"
I20260808 04:44:11.654170 7863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae258b0a11ac4778b4aa478f29eb54f0" candidate_uuid: "247f359779a9488cb91017189ed44c47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4e05cbd18e04fdd969371f888d318ee"
I20260808 04:44:11.654270 7863 raft_consensus.cc:3037] T ae258b0a11ac4778b4aa478f29eb54f0 P f4e05cbd18e04fdd969371f888d318ee [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:11.654259 8331 raft_consensus.cc:3037] T ae258b0a11ac4778b4aa478f29eb54f0 P 420ce4d3da564316850d13255983fa2f [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:11.655215 7863 raft_consensus.cc:2454] T ae258b0a11ac4778b4aa478f29eb54f0 P f4e05cbd18e04fdd969371f888d318ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 247f359779a9488cb91017189ed44c47 in term 1.
I20260808 04:44:11.655306 8331 raft_consensus.cc:2454] T ae258b0a11ac4778b4aa478f29eb54f0 P 420ce4d3da564316850d13255983fa2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 247f359779a9488cb91017189ed44c47 in term 1.
I20260808 04:44:11.655539 7973 leader_election.cc:302] T ae258b0a11ac4778b4aa478f29eb54f0 P 247f359779a9488cb91017189ed44c47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 247f359779a9488cb91017189ed44c47, f4e05cbd18e04fdd969371f888d318ee; no voters:
I20260808 04:44:11.655710 8490 raft_consensus.cc:2781] T ae258b0a11ac4778b4aa478f29eb54f0 P 247f359779a9488cb91017189ed44c47 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:11.655928 8490 raft_consensus.cc:686] T ae258b0a11ac4778b4aa478f29eb54f0 P 247f359779a9488cb91017189ed44c47 [term 1 LEADER]: Becoming Leader. State: Replica: 247f359779a9488cb91017189ed44c47, State: Running, Role: LEADER
I20260808 04:44:11.656229 8490 consensus_queue.cc:237] T ae258b0a11ac4778b4aa478f29eb54f0 P 247f359779a9488cb91017189ed44c47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247f359779a9488cb91017189ed44c47" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40675 } } peers { permanent_uuid: "420ce4d3da564316850d13255983fa2f" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37133 } } peers { permanent_uuid: "f4e05cbd18e04fdd969371f888d318ee" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 44241 } }
I20260808 04:44:11.659457 7635 catalog_manager.cc:5495] T ae258b0a11ac4778b4aa478f29eb54f0 P 247f359779a9488cb91017189ed44c47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 247f359779a9488cb91017189ed44c47 (127.12.148.66). New cstate: current_term: 1 leader_uuid: "247f359779a9488cb91017189ed44c47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "247f359779a9488cb91017189ed44c47" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 40675 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "420ce4d3da564316850d13255983fa2f" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4e05cbd18e04fdd969371f888d318ee" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 44241 } health_report { overall_health: UNKNOWN } } }
I20260808 04:44:11.706421 8471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:11.703144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38990 (local address 127.12.148.66:40675)
0808 04:44:11.703268 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:11.703272 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:11.703285 (+ 13us) server_negotiation.cc:407] Connection header received
0808 04:44:11.703363 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:11.703365 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:11.703423 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:11.703511 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:44:11.703706 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:11.704212 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:11.705021 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:11.705229 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:11.705301 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:11.705560 (+ 259us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:44:11.706059 (+ 499us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:44:11.706159 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:11.706227 (+ 68us) server_negotiation.cc:299] Negotiation successful
0808 04:44:11.706280 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 04:44:11.712708 8331 raft_consensus.cc:1261] T ae258b0a11ac4778b4aa478f29eb54f0 P 420ce4d3da564316850d13255983fa2f [term 1 FOLLOWER]: Refusing update from remote peer 247f359779a9488cb91017189ed44c47: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:44:11.712708 7863 raft_consensus.cc:1261] T ae258b0a11ac4778b4aa478f29eb54f0 P f4e05cbd18e04fdd969371f888d318ee [term 1 FOLLOWER]: Refusing update from remote peer 247f359779a9488cb91017189ed44c47: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:44:11.713483 8499 consensus_queue.cc:1035] T ae258b0a11ac4778b4aa478f29eb54f0 P 247f359779a9488cb91017189ed44c47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420ce4d3da564316850d13255983fa2f" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 37133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:44:11.713696 8490 consensus_queue.cc:1035] T ae258b0a11ac4778b4aa478f29eb54f0 P 247f359779a9488cb91017189ed44c47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4e05cbd18e04fdd969371f888d318ee" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 44241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 04:44:11.719220 8428 tablet.cc:2369] T ae258b0a11ac4778b4aa478f29eb54f0 P 420ce4d3da564316850d13255983fa2f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:44:11.723464 8506 mvcc.cc:205] Tried to move back new op lower bound from 7316128775007444992 to 7316128774786473984. Current Snapshot: MvccSnapshot[applied={T|T < 7316128775007444992}]
I20260808 04:44:11.724633 8505 mvcc.cc:205] Tried to move back new op lower bound from 7316128775007444992 to 7316128774786473984. Current Snapshot: MvccSnapshot[applied={T|T < 7316128775007444992}]
I20260808 04:44:11.731513 7635 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:43168:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:44:11.731686 7635 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:43168:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:44:11.734439 7635 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 37306d6c15b74730914f013948c16668: Sending DeleteTablet for 3 replicas of tablet ae258b0a11ac4778b4aa478f29eb54f0
I20260808 04:44:11.735338 8300 tablet_service.cc:1514] Processing DeleteTablet for tablet ae258b0a11ac4778b4aa478f29eb54f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:44:11 UTC) from {username='slave'} at 127.0.0.1:50376
I20260808 04:44:11.735351 7834 tablet_service.cc:1514] Processing DeleteTablet for tablet ae258b0a11ac4778b4aa478f29eb54f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:44:11 UTC) from {username='slave'} at 127.0.0.1:52038
I20260808 04:44:11.735966 8524 tablet_replica.cc:330] T ae258b0a11ac4778b4aa478f29eb54f0 P f4e05cbd18e04fdd969371f888d318ee: stopping tablet replica
I20260808 04:44:11.735984 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 7723
I20260808 04:44:11.736303 8524 raft_consensus.cc:2229] T ae258b0a11ac4778b4aa478f29eb54f0 P f4e05cbd18e04fdd969371f888d318ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:44:11.736282 8046 tablet_service.cc:1514] Processing DeleteTablet for tablet ae258b0a11ac4778b4aa478f29eb54f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:44:11 UTC) from {username='slave'} at 127.0.0.1:38980
I20260808 04:44:11.746302 8523 tablet_replica.cc:330] T ae258b0a11ac4778b4aa478f29eb54f0 P 420ce4d3da564316850d13255983fa2f: stopping tablet replica
I20260808 04:44:11.746665 8528 tablet_replica.cc:330] T ae258b0a11ac4778b4aa478f29eb54f0 P 247f359779a9488cb91017189ed44c47: stopping tablet replica
I20260808 04:44:11.746721 8523 raft_consensus.cc:2229] T ae258b0a11ac4778b4aa478f29eb54f0 P 420ce4d3da564316850d13255983fa2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:44:11.747073 8528 raft_consensus.cc:2229] T ae258b0a11ac4778b4aa478f29eb54f0 P 247f359779a9488cb91017189ed44c47 [term 1 LEADER]: Raft consensus shutting down.
I20260808 04:44:11.747135 8523 raft_consensus.cc:2258] T ae258b0a11ac4778b4aa478f29eb54f0 P 420ce4d3da564316850d13255983fa2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:44:11.747665 8528 raft_consensus.cc:2258] T ae258b0a11ac4778b4aa478f29eb54f0 P 247f359779a9488cb91017189ed44c47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:44:11.749037 8528 ts_tablet_manager.cc:1905] T ae258b0a11ac4778b4aa478f29eb54f0 P 247f359779a9488cb91017189ed44c47: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:44:11.749037 8523 ts_tablet_manager.cc:1905] T ae258b0a11ac4778b4aa478f29eb54f0 P 420ce4d3da564316850d13255983fa2f: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260808 04:44:11.750250 7615 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.148.65:44241 (error 108)
I20260808 04:44:11.751121 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 7943
I20260808 04:44:11.751876 8523 ts_tablet_manager.cc:1918] T ae258b0a11ac4778b4aa478f29eb54f0 P 420ce4d3da564316850d13255983fa2f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:44:11.751964 8523 log.cc:1196] T ae258b0a11ac4778b4aa478f29eb54f0 P 420ce4d3da564316850d13255983fa2f: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786164004017495-12881-0/minicluster-data/ts-2/wal/wals/ae258b0a11ac4778b4aa478f29eb54f0
I20260808 04:44:11.752193 8523 ts_tablet_manager.cc:1939] T ae258b0a11ac4778b4aa478f29eb54f0 P 420ce4d3da564316850d13255983fa2f: Deleting consensus metadata
I20260808 04:44:11.754323 8474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:11.754024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:44241 (local address 127.0.0.1:52054)
0808 04:44:11.754171 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:11.754245 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.65:44241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260808 04:44:11.754570 7615 catalog_manager.cc:4584] TS f4e05cbd18e04fdd969371f888d318ee (127.12.148.65:44241): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ae258b0a11ac4778b4aa478f29eb54f0: Network error: Client connection negotiation failed: client connection to 127.12.148.65:44241: connect: Connection refused (error 111)
I20260808 04:44:11.755015 7610 catalog_manager.cc:4841] TS 420ce4d3da564316850d13255983fa2f (127.12.148.67:37133): tablet ae258b0a11ac4778b4aa478f29eb54f0 (table test-table [id=631ad7d587f94a32980221a2b73215f3]) successfully deleted
I20260808 04:44:11.759824 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 8179
I20260808 04:44:11.771957 8474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:11.759926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:40675 (local address 127.0.0.1:38998)
0808 04:44:11.771782 (+ 11856us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:11.771858 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.66:40675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":11736}
I20260808 04:44:11.776619 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 7590
2026-08-08T04:44:11Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1168 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:11 dist-test-slave-t7g5 krb5kdc[8533](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:11 dist-test-slave-t7g5 krb5kdc[8533](info): set up 2 sockets
Aug 08 04:44:11 dist-test-slave-t7g5 krb5kdc[8533](info): commencing operation
krb5kdc: starting...
W20260808 04:44:12.930140 12881 mini_kdc.cc:121] Time spent starting KDC: real 1.128s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Aug 08 04:44:13 dist-test-slave-t7g5 krb5kdc[8533](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164253, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.148.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
I20260808 04:44:13.058109 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:46183
--webserver_interface=127.12.148.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:38111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:46183
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:13.171273 8558 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:13.171562 8558 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:13.171603 8558 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:13.175725 8558 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:13.175794 8558 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:13.175812 8558 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:13.175829 8558 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:13.175859 8558 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:13.181123 8558 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:38111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:46183
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:46183
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8558
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:13.182247 8558 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:13.183295 8558 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:13.192028 8569 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:13.192028 8565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:13.192051 8566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:13.192378 8558 server_base.cc:1034] running on GCE node
I20260808 04:44:13.192958 8558 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:13.194079 8558 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:13.195250 8558 hybrid_clock.cc:648] HybridClock initialized: now 1786164253195232 us; error 26 us; skew 500 ppm
Aug 08 04:44:13 dist-test-slave-t7g5 krb5kdc[8533](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164253, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:13.200632 8558 init.cc:377] Logged in from keytab as kudu/127.12.148.126@KRBTEST.COM (short username kudu)
I20260808 04:44:13.201509 8558 webserver.cc:460] Webserver started at http://127.12.148.126:46861/ using document root <none> and password file <none>
I20260808 04:44:13.202095 8558 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:13.202168 8558 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:13.202361 8558 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:13.204389 8558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "ef1c44e6a2dd4932909590f2633fa17e"
format_stamp: "Formatted at 2026-08-08 04:44:13 on dist-test-slave-t7g5"
server_key: "1050b9fc1c261a76d9cca435f0fb9802"
server_key_iv: "471142a2310b19951837f74e742bc766"
server_key_version: "encryptionkey@0"
I20260808 04:44:13.204932 8558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "ef1c44e6a2dd4932909590f2633fa17e"
format_stamp: "Formatted at 2026-08-08 04:44:13 on dist-test-slave-t7g5"
server_key: "1050b9fc1c261a76d9cca435f0fb9802"
server_key_iv: "471142a2310b19951837f74e742bc766"
server_key_version: "encryptionkey@0"
I20260808 04:44:13.208578 8558 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 04:44:13.211017 8582 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:13.212196 8558 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 04:44:13.212327 8558 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "ef1c44e6a2dd4932909590f2633fa17e"
format_stamp: "Formatted at 2026-08-08 04:44:13 on dist-test-slave-t7g5"
server_key: "1050b9fc1c261a76d9cca435f0fb9802"
server_key_iv: "471142a2310b19951837f74e742bc766"
server_key_version: "encryptionkey@0"
I20260808 04:44:13.212445 8558 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:13.232235 8558 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:13.235524 8558 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:13.235711 8558 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:13.242522 8558 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:46183
I20260808 04:44:13.242565 8686 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:46183 every 8 connection(s)
I20260808 04:44:13.243477 8558 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:13.245065 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 8558
I20260808 04:44:13.245204 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:44:13.245546 12881 external_mini_cluster.cc:1428] Setting key 3a7a93d6360c305cf3e68e1fdad1b228
I20260808 04:44:13.246587 8687 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:13.252064 8687 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef1c44e6a2dd4932909590f2633fa17e: Bootstrap starting.
Aug 08 04:44:13 dist-test-slave-t7g5 krb5kdc[8533](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164253, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:44:13.254384 8687 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ef1c44e6a2dd4932909590f2633fa17e: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:13.255066 8687 log.cc:824] T 00000000000000000000000000000000 P ef1c44e6a2dd4932909590f2633fa17e: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:13.256837 8687 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef1c44e6a2dd4932909590f2633fa17e: No bootstrap required, opened a new log
I20260808 04:44:13.259243 8690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:13.246973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54684 (local address 127.12.148.126:46183)
0808 04:44:13.247401 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:13.247416 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:13.247458 (+ 42us) server_negotiation.cc:407] Connection header received
0808 04:44:13.248076 (+ 618us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:13.248091 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:13.248400 (+ 309us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:13.248704 (+ 304us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:13.249522 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:13.250541 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:13.251402 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:13.251867 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:13.252012 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:13.254598 (+ 2586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:13.254603 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:13.254615 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:13.254641 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:13.256207 (+ 1566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:13.256635 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:13.256640 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:13.256644 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:13.256754 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:13.257038 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:13.257041 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:13.257043 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:13.257545 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:13.257774 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:13.257997 (+ 223us) server_negotiation.cc:299] Negotiation successful
0808 04:44:13.258284 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":148,"threads_started":1}
I20260808 04:44:13.261089 8687 raft_consensus.cc:348] T 00000000000000000000000000000000 P ef1c44e6a2dd4932909590f2633fa17e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef1c44e6a2dd4932909590f2633fa17e" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 46183 } }
I20260808 04:44:13.261354 8687 raft_consensus.cc:374] T 00000000000000000000000000000000 P ef1c44e6a2dd4932909590f2633fa17e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:13.261415 8687 raft_consensus.cc:729] T 00000000000000000000000000000000 P ef1c44e6a2dd4932909590f2633fa17e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1c44e6a2dd4932909590f2633fa17e, State: Initialized, Role: FOLLOWER
I20260808 04:44:13.261845 8687 consensus_queue.cc:260] T 00000000000000000000000000000000 P ef1c44e6a2dd4932909590f2633fa17e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef1c44e6a2dd4932909590f2633fa17e" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 46183 } }
I20260808 04:44:13.261981 8687 raft_consensus.cc:388] T 00000000000000000000000000000000 P ef1c44e6a2dd4932909590f2633fa17e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:13.262028 8687 raft_consensus.cc:482] T 00000000000000000000000000000000 P ef1c44e6a2dd4932909590f2633fa17e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:13.262099 8687 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ef1c44e6a2dd4932909590f2633fa17e [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:13.262871 8687 raft_consensus.cc:504] T 00000000000000000000000000000000 P ef1c44e6a2dd4932909590f2633fa17e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef1c44e6a2dd4932909590f2633fa17e" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 46183 } }
I20260808 04:44:13.263160 8687 leader_election.cc:302] T 00000000000000000000000000000000 P ef1c44e6a2dd4932909590f2633fa17e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ef1c44e6a2dd4932909590f2633fa17e; no voters:
I20260808 04:44:13.263393 8687 leader_election.cc:288] T 00000000000000000000000000000000 P ef1c44e6a2dd4932909590f2633fa17e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:13.263509 8693 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ef1c44e6a2dd4932909590f2633fa17e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:13.263720 8693 raft_consensus.cc:686] T 00000000000000000000000000000000 P ef1c44e6a2dd4932909590f2633fa17e [term 1 LEADER]: Becoming Leader. State: Replica: ef1c44e6a2dd4932909590f2633fa17e, State: Running, Role: LEADER
I20260808 04:44:13.264022 8693 consensus_queue.cc:237] T 00000000000000000000000000000000 P ef1c44e6a2dd4932909590f2633fa17e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef1c44e6a2dd4932909590f2633fa17e" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 46183 } }
I20260808 04:44:13.264544 8687 sys_catalog.cc:564] T 00000000000000000000000000000000 P ef1c44e6a2dd4932909590f2633fa17e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:13.265473 8694 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef1c44e6a2dd4932909590f2633fa17e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ef1c44e6a2dd4932909590f2633fa17e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef1c44e6a2dd4932909590f2633fa17e" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 46183 } } }
I20260808 04:44:13.265617 8694 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef1c44e6a2dd4932909590f2633fa17e [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:13.265813 8696 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef1c44e6a2dd4932909590f2633fa17e [sys.catalog]: SysCatalogTable state changed. Reason: New leader ef1c44e6a2dd4932909590f2633fa17e. Latest consensus state: current_term: 1 leader_uuid: "ef1c44e6a2dd4932909590f2633fa17e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef1c44e6a2dd4932909590f2633fa17e" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 46183 } } }
I20260808 04:44:13.265908 8696 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef1c44e6a2dd4932909590f2633fa17e [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:13.266085 8705 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:13.269084 8705 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:13.274263 8705 catalog_manager.cc:1347] Generated new cluster ID: b1a41241a02f4ef6aa21620b78328379
I20260808 04:44:13.274331 8705 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:13.282001 8705 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:13.283278 8705 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:13.293382 8705 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ef1c44e6a2dd4932909590f2633fa17e: Generated new TSK 0
I20260808 04:44:13.294171 8705 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.148.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab.
Entry for principal kudu/127.12.148.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab.
I20260808 04:44:13.331103 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.65:0
--local_ip_for_outbound_sockets=127.12.148.65
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:46183
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:38111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:13.445452 8725 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:13.445762 8725 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:13.445834 8725 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:13.449818 8725 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:13.449882 8725 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:13.449967 8725 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.65
I20260808 04:44:13.455157 8725 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:38111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:46183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8725
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.65
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:13.456200 8725 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:13.457237 8725 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:13.466812 8743 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:13.466830 8741 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:13.466833 8746 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:13.467020 8725 server_base.cc:1034] running on GCE node
I20260808 04:44:13.467476 8725 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:13.468137 8725 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:13.469307 8725 hybrid_clock.cc:648] HybridClock initialized: now 1786164253469290 us; error 33 us; skew 500 ppm
Aug 08 04:44:13 dist-test-slave-t7g5 krb5kdc[8533](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164253, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:13.472047 8725 init.cc:377] Logged in from keytab as kudu/127.12.148.65@KRBTEST.COM (short username kudu)
I20260808 04:44:13.472923 8725 webserver.cc:460] Webserver started at http://127.12.148.65:44383/ using document root <none> and password file <none>
I20260808 04:44:13.473466 8725 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:13.473543 8725 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:13.473798 8725 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:13.475908 8725 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-0/data/instance:
uuid: "5ff41aaee7844cbebdd8b6a2ae4bc4b9"
format_stamp: "Formatted at 2026-08-08 04:44:13 on dist-test-slave-t7g5"
server_key: "c6cfd90db80f490bd0db2f25ba4ddd00"
server_key_iv: "cf4ad82130c3b4f81e27789982419b3d"
server_key_version: "encryptionkey@0"
I20260808 04:44:13.476578 8725 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance:
uuid: "5ff41aaee7844cbebdd8b6a2ae4bc4b9"
format_stamp: "Formatted at 2026-08-08 04:44:13 on dist-test-slave-t7g5"
server_key: "c6cfd90db80f490bd0db2f25ba4ddd00"
server_key_iv: "cf4ad82130c3b4f81e27789982419b3d"
server_key_version: "encryptionkey@0"
I20260808 04:44:13.480305 8725 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260808 04:44:13.482728 8760 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:13.483997 8725 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:44:13.484110 8725 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-0/wal
uuid: "5ff41aaee7844cbebdd8b6a2ae4bc4b9"
format_stamp: "Formatted at 2026-08-08 04:44:13 on dist-test-slave-t7g5"
server_key: "c6cfd90db80f490bd0db2f25ba4ddd00"
server_key_iv: "cf4ad82130c3b4f81e27789982419b3d"
server_key_version: "encryptionkey@0"
I20260808 04:44:13.484208 8725 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:13.523926 8725 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:13.527304 8725 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:13.527504 8725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:13.528137 8725 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:44:13.529011 8725 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:44:13.529063 8725 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:13.529120 8725 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:44:13.529150 8725 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:13.537808 8725 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.65:40187
I20260808 04:44:13.537840 8947 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.65:40187 every 8 connection(s)
I20260808 04:44:13.538717 8725 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
Aug 08 04:44:13 dist-test-slave-t7g5 krb5kdc[8533](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164253, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:44:13.549010 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 8725
I20260808 04:44:13.549129 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance
I20260808 04:44:13.549417 12881 external_mini_cluster.cc:1428] Setting key ece5f32792256321faf1050f9067f72a
I20260808 04:44:13.552371 8690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:13.540565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:60471 (local address 127.12.148.126:46183)
0808 04:44:13.540703 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:13.540706 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:13.541550 (+ 844us) server_negotiation.cc:407] Connection header received
0808 04:44:13.542855 (+ 1305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:13.542858 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:13.542936 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:13.543040 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:13.544203 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:13.544732 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:13.546008 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:13.546253 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:13.546336 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:13.548691 (+ 2355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:13.548694 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:13.548696 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:13.548720 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:13.550231 (+ 1511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:13.550814 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:13.550817 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:13.550819 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:13.550901 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:13.551265 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:13.551269 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:13.551270 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:13.551507 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:13.551604 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:13.552081 (+ 477us) server_negotiation.cc:299] Negotiation successful
0808 04:44:13.552212 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 04:44:13.553191 8953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:13.540933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46183 (local address 127.12.148.65:60471)
0808 04:44:13.541393 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:13.541436 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:13.542653 (+ 1217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:13.543199 (+ 546us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:13.543206 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:13.543578 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:13.544078 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:13.544093 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:13.544827 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:13.544829 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:13.545897 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:13.545907 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:13.546383 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:13.546385 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:13.546522 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:13.547057 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:13.547073 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:13.548522 (+ 1449us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:13.550345 (+ 1823us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:13.550351 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:13.550367 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:13.550712 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:13.551010 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:13.551014 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:13.551015 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:13.551172 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:13.551599 (+ 427us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:13.551604 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:13.551853 (+ 249us) client_negotiation.cc:769] Sending connection context
0808 04:44:13.552012 (+ 159us) client_negotiation.cc:240] Negotiation successful
0808 04:44:13.552285 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":101,"threads_started":1}
I20260808 04:44:13.554427 8950 heartbeater.cc:347] Connected to a master server at 127.12.148.126:46183
I20260808 04:44:13.554677 8950 heartbeater.cc:464] Registering TS with master...
I20260808 04:44:13.555181 8950 heartbeater.cc:511] Master 127.12.148.126:46183 requested a full tablet report, sending...
I20260808 04:44:13.556860 8615 ts_manager.cc:194] Registered new tserver with Master: 5ff41aaee7844cbebdd8b6a2ae4bc4b9 (127.12.148.65:40187)
I20260808 04:44:13.558522 8615 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.65@KRBTEST.COM'} at 127.12.148.65:60471
WARNING: no policy specified for kudu/127.12.148.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab.
Entry for principal kudu/127.12.148.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab.
I20260808 04:44:13.580358 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.66:0
--local_ip_for_outbound_sockets=127.12.148.66
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:46183
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:38111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:13.694912 8961 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:13.695180 8961 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:13.695225 8961 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:13.699157 8961 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:13.699216 8961 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:13.699275 8961 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.66
I20260808 04:44:13.704416 8961 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:38111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:46183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8961
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.66
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:13.705399 8961 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:13.706406 8961 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:13.716095 8976 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:13.716087 8972 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:13.716241 8961 server_base.cc:1034] running on GCE node
W20260808 04:44:13.716167 8973 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:13.716750 8961 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:13.717427 8961 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:13.718575 8961 hybrid_clock.cc:648] HybridClock initialized: now 1786164253718544 us; error 43 us; skew 500 ppm
Aug 08 04:44:13 dist-test-slave-t7g5 krb5kdc[8533](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164253, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:13.721256 8961 init.cc:377] Logged in from keytab as kudu/127.12.148.66@KRBTEST.COM (short username kudu)
I20260808 04:44:13.722162 8961 webserver.cc:460] Webserver started at http://127.12.148.66:39115/ using document root <none> and password file <none>
I20260808 04:44:13.722666 8961 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:13.722728 8961 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:13.722914 8961 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:13.724923 8961 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-1/data/instance:
uuid: "d8d4b70655774f63968b6f9608b956af"
format_stamp: "Formatted at 2026-08-08 04:44:13 on dist-test-slave-t7g5"
server_key: "46bccb49c3ce721e3a9dcb2c9ddababe"
server_key_iv: "20ee298494ee613b2e1611b5e49327f4"
server_key_version: "encryptionkey@0"
I20260808 04:44:13.725437 8961 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance:
uuid: "d8d4b70655774f63968b6f9608b956af"
format_stamp: "Formatted at 2026-08-08 04:44:13 on dist-test-slave-t7g5"
server_key: "46bccb49c3ce721e3a9dcb2c9ddababe"
server_key_iv: "20ee298494ee613b2e1611b5e49327f4"
server_key_version: "encryptionkey@0"
I20260808 04:44:13.729060 8961 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 04:44:13.731393 8991 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:13.732577 8961 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:44:13.732678 8961 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-1/wal
uuid: "d8d4b70655774f63968b6f9608b956af"
format_stamp: "Formatted at 2026-08-08 04:44:13 on dist-test-slave-t7g5"
server_key: "46bccb49c3ce721e3a9dcb2c9ddababe"
server_key_iv: "20ee298494ee613b2e1611b5e49327f4"
server_key_version: "encryptionkey@0"
I20260808 04:44:13.732795 8961 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:13.754813 8961 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:13.757726 8961 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:13.757921 8961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:13.758502 8961 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:44:13.759341 8961 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:44:13.759392 8961 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:13.759438 8961 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:44:13.759469 8961 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:13.768143 8961 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.66:45557
I20260808 04:44:13.768172 9189 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.66:45557 every 8 connection(s)
I20260808 04:44:13.769024 8961 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
I20260808 04:44:13.777837 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 8961
I20260808 04:44:13.777942 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance
I20260808 04:44:13.778204 12881 external_mini_cluster.cc:1428] Setting key 6c96e163e9e4583410b7e106b7f09094
Aug 08 04:44:13 dist-test-slave-t7g5 krb5kdc[8533](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164253, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:44:13.783020 8690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:13.770782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:56101 (local address 127.12.148.126:46183)
0808 04:44:13.770945 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:13.770950 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:13.771799 (+ 849us) server_negotiation.cc:407] Connection header received
0808 04:44:13.773057 (+ 1258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:13.773060 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:13.773106 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:13.773179 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:13.774402 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:13.774937 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:13.776094 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:13.776322 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:13.776424 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:13.778852 (+ 2428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:13.778856 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:13.778858 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:13.778886 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:13.780652 (+ 1766us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:13.781255 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:13.781258 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:13.781260 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:13.781370 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:13.781703 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:13.781707 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:13.781709 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:13.781957 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:13.782080 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:13.782772 (+ 692us) server_negotiation.cc:299] Negotiation successful
0808 04:44:13.782891 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 04:44:13.784034 9196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:13.771191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46183 (local address 127.12.148.66:56101)
0808 04:44:13.771636 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:13.771684 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:13.772852 (+ 1168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:13.773328 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:13.773335 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:13.773707 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:13.774263 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:13.774279 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:13.775032 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:13.775034 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:13.775972 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:13.775982 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:13.776450 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:13.776453 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:13.776592 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:13.777135 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:13.777151 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:13.778703 (+ 1552us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:13.780828 (+ 2125us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:13.780833 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:13.780846 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:13.781137 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:13.781460 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:13.781462 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:13.781463 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:13.781596 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:13.782101 (+ 505us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:13.782108 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:13.782459 (+ 351us) client_negotiation.cc:769] Sending connection context
0808 04:44:13.782680 (+ 221us) client_negotiation.cc:240] Negotiation successful
0808 04:44:13.783050 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":98,"threads_started":1}
I20260808 04:44:13.785197 9192 heartbeater.cc:347] Connected to a master server at 127.12.148.126:46183
I20260808 04:44:13.785497 9192 heartbeater.cc:464] Registering TS with master...
I20260808 04:44:13.786186 9192 heartbeater.cc:511] Master 127.12.148.126:46183 requested a full tablet report, sending...
I20260808 04:44:13.787448 8615 ts_manager.cc:194] Registered new tserver with Master: d8d4b70655774f63968b6f9608b956af (127.12.148.66:45557)
I20260808 04:44:13.788064 8615 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.66@KRBTEST.COM'} at 127.12.148.66:56101
WARNING: no policy specified for kudu/127.12.148.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab.
Entry for principal kudu/127.12.148.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab.
I20260808 04:44:13.809073 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.67:0
--local_ip_for_outbound_sockets=127.12.148.67
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:46183
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:38111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:13.922169 9199 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:13.922463 9199 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:13.922510 9199 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:13.926553 9199 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:13.926608 9199 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:13.926663 9199 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.67
I20260808 04:44:13.931823 9199 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:38111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:46183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9199
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.67
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:13.932770 9199 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:13.933729 9199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:13.943387 9210 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:13.943602 9199 server_base.cc:1034] running on GCE node
W20260808 04:44:13.943403 9211 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:13.943383 9213 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:13.944126 9199 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:13.944700 9199 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:13.945854 9199 hybrid_clock.cc:648] HybridClock initialized: now 1786164253945839 us; error 25 us; skew 500 ppm
Aug 08 04:44:13 dist-test-slave-t7g5 krb5kdc[8533](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164253, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:13.948451 9199 init.cc:377] Logged in from keytab as kudu/127.12.148.67@KRBTEST.COM (short username kudu)
I20260808 04:44:13.949251 9199 webserver.cc:460] Webserver started at http://127.12.148.67:37257/ using document root <none> and password file <none>
I20260808 04:44:13.949811 9199 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:13.949879 9199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:13.950084 9199 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:13.952051 9199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-2/data/instance:
uuid: "e3a83d70e18443ba9a29f1ac40ba3870"
format_stamp: "Formatted at 2026-08-08 04:44:13 on dist-test-slave-t7g5"
server_key: "baed57fc7a15780102833d0ac668e9d9"
server_key_iv: "c207f2b36b8608741042ccaa033312e7"
server_key_version: "encryptionkey@0"
I20260808 04:44:13.952586 9199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance:
uuid: "e3a83d70e18443ba9a29f1ac40ba3870"
format_stamp: "Formatted at 2026-08-08 04:44:13 on dist-test-slave-t7g5"
server_key: "baed57fc7a15780102833d0ac668e9d9"
server_key_iv: "c207f2b36b8608741042ccaa033312e7"
server_key_version: "encryptionkey@0"
I20260808 04:44:13.956581 9199 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260808 04:44:13.958904 9228 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:13.960053 9199 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 04:44:13.960162 9199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-2/wal
uuid: "e3a83d70e18443ba9a29f1ac40ba3870"
format_stamp: "Formatted at 2026-08-08 04:44:13 on dist-test-slave-t7g5"
server_key: "baed57fc7a15780102833d0ac668e9d9"
server_key_iv: "c207f2b36b8608741042ccaa033312e7"
server_key_version: "encryptionkey@0"
I20260808 04:44:13.960256 9199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:13.976090 9199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:13.979339 9199 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:13.979538 9199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:13.980145 9199 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:44:13.980975 9199 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:44:13.981024 9199 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:13.981079 9199 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:44:13.981109 9199 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:13.989959 9199 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.67:43575
I20260808 04:44:13.989988 9435 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.67:43575 every 8 connection(s)
I20260808 04:44:13.990861 9199 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
I20260808 04:44:13.996590 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 9199
I20260808 04:44:13.996703 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance
I20260808 04:44:13.996979 12881 external_mini_cluster.cc:1428] Setting key 90c77dd6503f522b28a91720ec42c3f3
Aug 08 04:44:13 dist-test-slave-t7g5 krb5kdc[8533](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164253, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:44:14.004441 8690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:13.992659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:56555 (local address 127.12.148.126:46183)
0808 04:44:13.992784 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:13.992787 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:13.993628 (+ 841us) server_negotiation.cc:407] Connection header received
0808 04:44:13.994992 (+ 1364us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:13.994996 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:13.995056 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:13.995132 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:13.996342 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:13.996936 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:13.998248 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:13.998472 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:13.998562 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:14.000951 (+ 2389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:14.000954 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:14.000956 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:14.000980 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:14.002313 (+ 1333us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:14.002875 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:14.002879 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:14.002880 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:14.002972 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:14.003321 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:14.003324 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:14.003326 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:14.003521 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:14.003610 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:14.004137 (+ 527us) server_negotiation.cc:299] Negotiation successful
0808 04:44:14.004271 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 04:44:14.005267 9446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:13.993013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:46183 (local address 127.12.148.67:56555)
0808 04:44:13.993475 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:13.993518 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:13.994757 (+ 1239us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:13.995321 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:13.995328 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:13.995711 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:13.996189 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:13.996202 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:13.997059 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:13.997063 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:13.998131 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:13.998141 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:13.998614 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:13.998618 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:13.998780 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:13.999331 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:13.999348 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:14.000772 (+ 1424us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:14.002435 (+ 1663us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:14.002442 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:14.002458 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:14.002777 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:14.003064 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:14.003068 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:14.003070 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:14.003227 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:14.003630 (+ 403us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:14.003637 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:14.003896 (+ 259us) client_negotiation.cc:769] Sending connection context
0808 04:44:14.004070 (+ 174us) client_negotiation.cc:240] Negotiation successful
0808 04:44:14.004410 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":117,"threads_started":1}
I20260808 04:44:14.006529 9436 heartbeater.cc:347] Connected to a master server at 127.12.148.126:46183
I20260808 04:44:14.006771 9436 heartbeater.cc:464] Registering TS with master...
I20260808 04:44:14.007272 9436 heartbeater.cc:511] Master 127.12.148.126:46183 requested a full tablet report, sending...
I20260808 04:44:14.008378 8615 ts_manager.cc:194] Registered new tserver with Master: e3a83d70e18443ba9a29f1ac40ba3870 (127.12.148.67:43575)
I20260808 04:44:14.009009 8615 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.67@KRBTEST.COM'} at 127.12.148.67:56555
I20260808 04:44:14.011114 12881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 04:44:14.020257 8690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:14.013080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44586 (local address 127.12.148.126:46183)
0808 04:44:14.013210 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:14.013213 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:14.013393 (+ 180us) server_negotiation.cc:407] Connection header received
0808 04:44:14.013479 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:14.013481 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:14.013517 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:14.013581 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:14.014295 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:14.014802 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:14.015632 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:14.015901 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:14.015978 (+ 77us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:14.017447 (+ 1469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:14.017450 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:14.017452 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:14.017476 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:14.018691 (+ 1215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:14.019142 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:14.019145 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:14.019146 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:14.019220 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:14.019468 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:14.019471 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:14.019472 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:14.019670 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:14.019784 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:14.020005 (+ 221us) server_negotiation.cc:299] Negotiation successful
0808 04:44:14.020097 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 04:44:14.023083 8615 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44586:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:44:14.026118 8615 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:44:14.040524 9480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:14.035238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36760 (local address 127.12.148.67:43575)
0808 04:44:14.035685 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:14.035698 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:14.035719 (+ 21us) server_negotiation.cc:407] Connection header received
0808 04:44:14.035792 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:14.035798 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:14.036056 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:14.036215 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:14.036544 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:14.037840 (+ 1296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:14.039254 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:14.039878 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:14.039985 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:14.040140 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:14.040288 (+ 148us) server_negotiation.cc:299] Negotiation successful
0808 04:44:14.040379 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":357,"thread_start_us":129,"threads_started":1}
I20260808 04:44:14.040522 9471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:14.034486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.67:43575 (local address 127.0.0.1:36760)
0808 04:44:14.035231 (+ 745us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:14.035285 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:14.035432 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:14.036228 (+ 796us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:14.036234 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:14.036257 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:14.036409 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:14.036417 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:14.037982 (+ 1565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:14.037986 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:14.039145 (+ 1159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:14.039153 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:14.039992 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:14.039996 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:14.040102 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:14.040139 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 04:44:14.040247 (+ 108us) client_negotiation.cc:240] Negotiation successful
0808 04:44:14.040370 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":615,"mutex_wait_us":34,"spinlock_wait_cycles":5376,"thread_start_us":102,"threads_started":1}
I20260808 04:44:14.040717 9475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:14.034787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:40187 (local address 127.0.0.1:51262)
0808 04:44:14.035652 (+ 865us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:14.035663 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:14.035735 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:14.036416 (+ 681us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:14.036419 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:14.036446 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:14.036542 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:14.036549 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:14.037602 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:14.037606 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:14.038995 (+ 1389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:14.039007 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:14.040320 (+ 1313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:14.040323 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:14.040461 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:14.040480 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 04:44:14.040536 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 04:44:14.040593 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":810,"mutex_wait_us":75,"spinlock_wait_cycles":9472,"thread_start_us":89,"threads_started":1}
I20260808 04:44:14.040920 9468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:14.034399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:45557 (local address 127.0.0.1:34720)
0808 04:44:14.035232 (+ 833us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:14.035285 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:14.035432 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:14.036436 (+ 1004us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:14.036439 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:14.036452 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:14.036557 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:14.036562 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:14.038038 (+ 1476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:14.038042 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:14.039141 (+ 1099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:14.039153 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:14.040211 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:14.040215 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:14.040313 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:14.040394 (+ 81us) client_negotiation.cc:769] Sending connection context
0808 04:44:14.040455 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 04:44:14.040527 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":663,"mutex_wait_us":62,"spinlock_wait_cycles":4352,"thread_start_us":106,"threads_started":1}
I20260808 04:44:14.041419 9476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:14.035015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51262 (local address 127.12.148.65:40187)
0808 04:44:14.035748 (+ 733us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:14.035765 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:14.035789 (+ 24us) server_negotiation.cc:407] Connection header received
0808 04:44:14.035924 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:14.035929 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:14.036229 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:14.036415 (+ 186us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:14.036672 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:14.037473 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:14.039129 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:14.039985 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:14.040091 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:14.040240 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:14.041141 (+ 901us) server_negotiation.cc:299] Negotiation successful
0808 04:44:14.041241 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":631,"thread_start_us":70,"threads_started":1}
I20260808 04:44:14.041451 9474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:14.034517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34720 (local address 127.12.148.66:45557)
0808 04:44:14.036022 (+ 1505us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:14.036034 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:14.036054 (+ 20us) server_negotiation.cc:407] Connection header received
0808 04:44:14.036127 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:14.036132 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:14.036297 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:14.036610 (+ 313us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:14.036755 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:14.037928 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:14.039281 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:14.040084 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:14.041059 (+ 975us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:14.041203 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:14.041247 (+ 44us) server_negotiation.cc:299] Negotiation successful
0808 04:44:14.041328 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1397,"thread_start_us":109,"threads_started":1}
I20260808 04:44:14.043570 9316 tablet_service.cc:1467] Processing CreateTablet for tablet 347cb617967e4140bcbb59cab9c14604 (DEFAULT_TABLE table=test-table [id=74740ade7c2e4aff98abafffa2b6a199]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:44:14.044571 9316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 347cb617967e4140bcbb59cab9c14604. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:14.044730 8838 tablet_service.cc:1467] Processing CreateTablet for tablet 347cb617967e4140bcbb59cab9c14604 (DEFAULT_TABLE table=test-table [id=74740ade7c2e4aff98abafffa2b6a199]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:44:14.044730 9079 tablet_service.cc:1467] Processing CreateTablet for tablet 347cb617967e4140bcbb59cab9c14604 (DEFAULT_TABLE table=test-table [id=74740ade7c2e4aff98abafffa2b6a199]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:44:14.045796 9079 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 347cb617967e4140bcbb59cab9c14604. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:14.045796 8838 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 347cb617967e4140bcbb59cab9c14604. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:14.052639 9483 tablet_bootstrap.cc:492] T 347cb617967e4140bcbb59cab9c14604 P 5ff41aaee7844cbebdd8b6a2ae4bc4b9: Bootstrap starting.
I20260808 04:44:14.053231 9481 tablet_bootstrap.cc:492] T 347cb617967e4140bcbb59cab9c14604 P e3a83d70e18443ba9a29f1ac40ba3870: Bootstrap starting.
I20260808 04:44:14.054016 9482 tablet_bootstrap.cc:492] T 347cb617967e4140bcbb59cab9c14604 P d8d4b70655774f63968b6f9608b956af: Bootstrap starting.
I20260808 04:44:14.054889 9483 tablet_bootstrap.cc:654] T 347cb617967e4140bcbb59cab9c14604 P 5ff41aaee7844cbebdd8b6a2ae4bc4b9: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:14.055119 9481 tablet_bootstrap.cc:654] T 347cb617967e4140bcbb59cab9c14604 P e3a83d70e18443ba9a29f1ac40ba3870: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:14.055783 9483 log.cc:824] T 347cb617967e4140bcbb59cab9c14604 P 5ff41aaee7844cbebdd8b6a2ae4bc4b9: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:14.056064 9482 tablet_bootstrap.cc:654] T 347cb617967e4140bcbb59cab9c14604 P d8d4b70655774f63968b6f9608b956af: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:14.056281 9481 log.cc:824] T 347cb617967e4140bcbb59cab9c14604 P e3a83d70e18443ba9a29f1ac40ba3870: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:14.057255 9482 log.cc:824] T 347cb617967e4140bcbb59cab9c14604 P d8d4b70655774f63968b6f9608b956af: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:14.057854 9483 tablet_bootstrap.cc:492] T 347cb617967e4140bcbb59cab9c14604 P 5ff41aaee7844cbebdd8b6a2ae4bc4b9: No bootstrap required, opened a new log
I20260808 04:44:14.058048 9483 ts_tablet_manager.cc:1397] T 347cb617967e4140bcbb59cab9c14604 P 5ff41aaee7844cbebdd8b6a2ae4bc4b9: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 04:44:14.058151 9481 tablet_bootstrap.cc:492] T 347cb617967e4140bcbb59cab9c14604 P e3a83d70e18443ba9a29f1ac40ba3870: No bootstrap required, opened a new log
I20260808 04:44:14.058331 9481 ts_tablet_manager.cc:1397] T 347cb617967e4140bcbb59cab9c14604 P e3a83d70e18443ba9a29f1ac40ba3870: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 04:44:14.059155 9482 tablet_bootstrap.cc:492] T 347cb617967e4140bcbb59cab9c14604 P d8d4b70655774f63968b6f9608b956af: No bootstrap required, opened a new log
I20260808 04:44:14.059336 9482 ts_tablet_manager.cc:1397] T 347cb617967e4140bcbb59cab9c14604 P d8d4b70655774f63968b6f9608b956af: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 04:44:14.061152 9481 raft_consensus.cc:348] T 347cb617967e4140bcbb59cab9c14604 P e3a83d70e18443ba9a29f1ac40ba3870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8d4b70655774f63968b6f9608b956af" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 45557 } } peers { permanent_uuid: "e3a83d70e18443ba9a29f1ac40ba3870" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 43575 } } peers { permanent_uuid: "5ff41aaee7844cbebdd8b6a2ae4bc4b9" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40187 } }
I20260808 04:44:14.061374 9481 raft_consensus.cc:374] T 347cb617967e4140bcbb59cab9c14604 P e3a83d70e18443ba9a29f1ac40ba3870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:14.061429 9481 raft_consensus.cc:729] T 347cb617967e4140bcbb59cab9c14604 P e3a83d70e18443ba9a29f1ac40ba3870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3a83d70e18443ba9a29f1ac40ba3870, State: Initialized, Role: FOLLOWER
I20260808 04:44:14.061877 9481 consensus_queue.cc:260] T 347cb617967e4140bcbb59cab9c14604 P e3a83d70e18443ba9a29f1ac40ba3870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8d4b70655774f63968b6f9608b956af" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 45557 } } peers { permanent_uuid: "e3a83d70e18443ba9a29f1ac40ba3870" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 43575 } } peers { permanent_uuid: "5ff41aaee7844cbebdd8b6a2ae4bc4b9" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40187 } }
I20260808 04:44:14.062505 9436 heartbeater.cc:503] Master 127.12.148.126:46183 was elected leader, sending a full tablet report...
I20260808 04:44:14.062381 9483 raft_consensus.cc:348] T 347cb617967e4140bcbb59cab9c14604 P 5ff41aaee7844cbebdd8b6a2ae4bc4b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8d4b70655774f63968b6f9608b956af" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 45557 } } peers { permanent_uuid: "e3a83d70e18443ba9a29f1ac40ba3870" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 43575 } } peers { permanent_uuid: "5ff41aaee7844cbebdd8b6a2ae4bc4b9" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40187 } }
I20260808 04:44:14.062630 9483 raft_consensus.cc:374] T 347cb617967e4140bcbb59cab9c14604 P 5ff41aaee7844cbebdd8b6a2ae4bc4b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:14.062695 9483 raft_consensus.cc:729] T 347cb617967e4140bcbb59cab9c14604 P 5ff41aaee7844cbebdd8b6a2ae4bc4b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ff41aaee7844cbebdd8b6a2ae4bc4b9, State: Initialized, Role: FOLLOWER
I20260808 04:44:14.063032 9482 raft_consensus.cc:348] T 347cb617967e4140bcbb59cab9c14604 P d8d4b70655774f63968b6f9608b956af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8d4b70655774f63968b6f9608b956af" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 45557 } } peers { permanent_uuid: "e3a83d70e18443ba9a29f1ac40ba3870" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 43575 } } peers { permanent_uuid: "5ff41aaee7844cbebdd8b6a2ae4bc4b9" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40187 } }
I20260808 04:44:14.063256 9482 raft_consensus.cc:374] T 347cb617967e4140bcbb59cab9c14604 P d8d4b70655774f63968b6f9608b956af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:14.063135 9483 consensus_queue.cc:260] T 347cb617967e4140bcbb59cab9c14604 P 5ff41aaee7844cbebdd8b6a2ae4bc4b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8d4b70655774f63968b6f9608b956af" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 45557 } } peers { permanent_uuid: "e3a83d70e18443ba9a29f1ac40ba3870" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 43575 } } peers { permanent_uuid: "5ff41aaee7844cbebdd8b6a2ae4bc4b9" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40187 } }
I20260808 04:44:14.063299 9482 raft_consensus.cc:729] T 347cb617967e4140bcbb59cab9c14604 P d8d4b70655774f63968b6f9608b956af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8d4b70655774f63968b6f9608b956af, State: Initialized, Role: FOLLOWER
I20260808 04:44:14.064018 9481 ts_tablet_manager.cc:1428] T 347cb617967e4140bcbb59cab9c14604 P e3a83d70e18443ba9a29f1ac40ba3870: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260808 04:44:14.064159 9483 ts_tablet_manager.cc:1428] T 347cb617967e4140bcbb59cab9c14604 P 5ff41aaee7844cbebdd8b6a2ae4bc4b9: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 04:44:14.064491 8950 heartbeater.cc:503] Master 127.12.148.126:46183 was elected leader, sending a full tablet report...
I20260808 04:44:14.064818 9482 consensus_queue.cc:260] T 347cb617967e4140bcbb59cab9c14604 P d8d4b70655774f63968b6f9608b956af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8d4b70655774f63968b6f9608b956af" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 45557 } } peers { permanent_uuid: "e3a83d70e18443ba9a29f1ac40ba3870" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 43575 } } peers { permanent_uuid: "5ff41aaee7844cbebdd8b6a2ae4bc4b9" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40187 } }
I20260808 04:44:14.065560 9192 heartbeater.cc:503] Master 127.12.148.126:46183 was elected leader, sending a full tablet report...
I20260808 04:44:14.065788 9482 ts_tablet_manager.cc:1428] T 347cb617967e4140bcbb59cab9c14604 P d8d4b70655774f63968b6f9608b956af: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260808 04:44:14.077070 9488 raft_consensus.cc:482] T 347cb617967e4140bcbb59cab9c14604 P e3a83d70e18443ba9a29f1ac40ba3870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:44:14.077239 9488 raft_consensus.cc:504] T 347cb617967e4140bcbb59cab9c14604 P e3a83d70e18443ba9a29f1ac40ba3870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8d4b70655774f63968b6f9608b956af" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 45557 } } peers { permanent_uuid: "e3a83d70e18443ba9a29f1ac40ba3870" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 43575 } } peers { permanent_uuid: "5ff41aaee7844cbebdd8b6a2ae4bc4b9" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40187 } }
I20260808 04:44:14.078397 9488 leader_election.cc:288] T 347cb617967e4140bcbb59cab9c14604 P e3a83d70e18443ba9a29f1ac40ba3870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8d4b70655774f63968b6f9608b956af (127.12.148.66:45557), 5ff41aaee7844cbebdd8b6a2ae4bc4b9 (127.12.148.65:40187)
I20260808 04:44:14.082058 9446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:14.078578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:45557 (local address 127.12.148.67:47947)
0808 04:44:14.078696 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:14.078713 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:14.078798 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:14.079102 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:14.079106 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:14.079126 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:14.079248 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:14.079254 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:14.080048 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:14.080051 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:14.080895 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:14.080905 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:14.081582 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:14.081586 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:14.081714 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:14.081772 (+ 58us) client_negotiation.cc:769] Sending connection context
0808 04:44:14.081843 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 04:44:14.081916 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":22}
I20260808 04:44:14.082089 9474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:14.078743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:47947 (local address 127.12.148.66:45557)
0808 04:44:14.078857 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:14.078862 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:14.078878 (+ 16us) server_negotiation.cc:407] Connection header received
0808 04:44:14.078939 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:14.078942 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:14.078991 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:14.079079 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:14.079351 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:14.079935 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:14.081042 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:14.081463 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:14.081555 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:14.081596 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:14.081875 (+ 279us) server_negotiation.cc:299] Negotiation successful
0808 04:44:14.081966 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 04:44:14.082155 9476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:14.078787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:42505 (local address 127.12.148.65:40187)
0808 04:44:14.078904 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:14.078908 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:14.079085 (+ 177us) server_negotiation.cc:407] Connection header received
0808 04:44:14.079198 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:14.079201 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:14.079248 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:14.079326 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:14.079584 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:14.080145 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:14.081154 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:14.081549 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:14.081706 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:14.081758 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:14.081982 (+ 224us) server_negotiation.cc:299] Negotiation successful
0808 04:44:14.082055 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 04:44:14.082515 9495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:14.078622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:40187 (local address 127.12.148.67:42505)
0808 04:44:14.079005 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:14.079018 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:14.079107 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:14.079344 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:14.079346 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:14.079363 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:14.079487 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:14.079493 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:14.080248 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:14.080251 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:14.081033 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:14.081043 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:14.081708 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:14.081712 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:14.081837 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:14.081862 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 04:44:14.082276 (+ 414us) client_negotiation.cc:240] Negotiation successful
0808 04:44:14.082356 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"mutex_wait_us":3,"thread_start_us":114,"threads_started":1}
I20260808 04:44:14.082734 9109 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "347cb617967e4140bcbb59cab9c14604" candidate_uuid: "e3a83d70e18443ba9a29f1ac40ba3870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8d4b70655774f63968b6f9608b956af" is_pre_election: true
I20260808 04:44:14.083099 9109 raft_consensus.cc:2454] T 347cb617967e4140bcbb59cab9c14604 P d8d4b70655774f63968b6f9608b956af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a83d70e18443ba9a29f1ac40ba3870 in term 0.
I20260808 04:44:14.083112 8868 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "347cb617967e4140bcbb59cab9c14604" candidate_uuid: "e3a83d70e18443ba9a29f1ac40ba3870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ff41aaee7844cbebdd8b6a2ae4bc4b9" is_pre_election: true
I20260808 04:44:14.083384 8868 raft_consensus.cc:2454] T 347cb617967e4140bcbb59cab9c14604 P 5ff41aaee7844cbebdd8b6a2ae4bc4b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a83d70e18443ba9a29f1ac40ba3870 in term 0.
I20260808 04:44:14.083645 9238 leader_election.cc:302] T 347cb617967e4140bcbb59cab9c14604 P e3a83d70e18443ba9a29f1ac40ba3870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d8d4b70655774f63968b6f9608b956af, e3a83d70e18443ba9a29f1ac40ba3870; no voters:
I20260808 04:44:14.083941 9488 raft_consensus.cc:2781] T 347cb617967e4140bcbb59cab9c14604 P e3a83d70e18443ba9a29f1ac40ba3870 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:44:14.084024 9488 raft_consensus.cc:482] T 347cb617967e4140bcbb59cab9c14604 P e3a83d70e18443ba9a29f1ac40ba3870 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:44:14.084077 9488 raft_consensus.cc:3037] T 347cb617967e4140bcbb59cab9c14604 P e3a83d70e18443ba9a29f1ac40ba3870 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:14.085093 9488 raft_consensus.cc:504] T 347cb617967e4140bcbb59cab9c14604 P e3a83d70e18443ba9a29f1ac40ba3870 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8d4b70655774f63968b6f9608b956af" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 45557 } } peers { permanent_uuid: "e3a83d70e18443ba9a29f1ac40ba3870" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 43575 } } peers { permanent_uuid: "5ff41aaee7844cbebdd8b6a2ae4bc4b9" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40187 } }
I20260808 04:44:14.085414 9488 leader_election.cc:288] T 347cb617967e4140bcbb59cab9c14604 P e3a83d70e18443ba9a29f1ac40ba3870 [CANDIDATE]: Term 1 election: Requested vote from peers d8d4b70655774f63968b6f9608b956af (127.12.148.66:45557), 5ff41aaee7844cbebdd8b6a2ae4bc4b9 (127.12.148.65:40187)
I20260808 04:44:14.085779 9109 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "347cb617967e4140bcbb59cab9c14604" candidate_uuid: "e3a83d70e18443ba9a29f1ac40ba3870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8d4b70655774f63968b6f9608b956af"
I20260808 04:44:14.085784 8868 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "347cb617967e4140bcbb59cab9c14604" candidate_uuid: "e3a83d70e18443ba9a29f1ac40ba3870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ff41aaee7844cbebdd8b6a2ae4bc4b9"
I20260808 04:44:14.085906 8868 raft_consensus.cc:3037] T 347cb617967e4140bcbb59cab9c14604 P 5ff41aaee7844cbebdd8b6a2ae4bc4b9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:14.085906 9109 raft_consensus.cc:3037] T 347cb617967e4140bcbb59cab9c14604 P d8d4b70655774f63968b6f9608b956af [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:14.087184 9109 raft_consensus.cc:2454] T 347cb617967e4140bcbb59cab9c14604 P d8d4b70655774f63968b6f9608b956af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a83d70e18443ba9a29f1ac40ba3870 in term 1.
I20260808 04:44:14.087186 8868 raft_consensus.cc:2454] T 347cb617967e4140bcbb59cab9c14604 P 5ff41aaee7844cbebdd8b6a2ae4bc4b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a83d70e18443ba9a29f1ac40ba3870 in term 1.
I20260808 04:44:14.087497 9238 leader_election.cc:302] T 347cb617967e4140bcbb59cab9c14604 P e3a83d70e18443ba9a29f1ac40ba3870 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d8d4b70655774f63968b6f9608b956af, e3a83d70e18443ba9a29f1ac40ba3870; no voters:
I20260808 04:44:14.087661 9488 raft_consensus.cc:2781] T 347cb617967e4140bcbb59cab9c14604 P e3a83d70e18443ba9a29f1ac40ba3870 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:14.087905 9488 raft_consensus.cc:686] T 347cb617967e4140bcbb59cab9c14604 P e3a83d70e18443ba9a29f1ac40ba3870 [term 1 LEADER]: Becoming Leader. State: Replica: e3a83d70e18443ba9a29f1ac40ba3870, State: Running, Role: LEADER
I20260808 04:44:14.088266 9488 consensus_queue.cc:237] T 347cb617967e4140bcbb59cab9c14604 P e3a83d70e18443ba9a29f1ac40ba3870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8d4b70655774f63968b6f9608b956af" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 45557 } } peers { permanent_uuid: "e3a83d70e18443ba9a29f1ac40ba3870" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 43575 } } peers { permanent_uuid: "5ff41aaee7844cbebdd8b6a2ae4bc4b9" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40187 } }
I20260808 04:44:14.091405 8615 catalog_manager.cc:5495] T 347cb617967e4140bcbb59cab9c14604 P e3a83d70e18443ba9a29f1ac40ba3870 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3a83d70e18443ba9a29f1ac40ba3870 (127.12.148.67). New cstate: current_term: 1 leader_uuid: "e3a83d70e18443ba9a29f1ac40ba3870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8d4b70655774f63968b6f9608b956af" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 45557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a83d70e18443ba9a29f1ac40ba3870" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 43575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ff41aaee7844cbebdd8b6a2ae4bc4b9" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40187 } health_report { overall_health: UNKNOWN } } }
I20260808 04:44:14.103225 9480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:14.099858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36764 (local address 127.12.148.67:43575)
0808 04:44:14.099966 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:14.099971 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:14.099983 (+ 12us) server_negotiation.cc:407] Connection header received
0808 04:44:14.100080 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:14.100082 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:14.100132 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:14.100212 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:44:14.100395 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:14.100889 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:14.101716 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:14.101928 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:14.102003 (+ 75us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:14.102330 (+ 327us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:44:14.102759 (+ 429us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:44:14.102900 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:14.103042 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 04:44:14.103082 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 04:44:14.108986 8868 raft_consensus.cc:1261] T 347cb617967e4140bcbb59cab9c14604 P 5ff41aaee7844cbebdd8b6a2ae4bc4b9 [term 1 FOLLOWER]: Refusing update from remote peer e3a83d70e18443ba9a29f1ac40ba3870: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:44:14.109006 9109 raft_consensus.cc:1261] T 347cb617967e4140bcbb59cab9c14604 P d8d4b70655774f63968b6f9608b956af [term 1 FOLLOWER]: Refusing update from remote peer e3a83d70e18443ba9a29f1ac40ba3870: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:44:14.109705 9488 consensus_queue.cc:1035] T 347cb617967e4140bcbb59cab9c14604 P e3a83d70e18443ba9a29f1ac40ba3870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8d4b70655774f63968b6f9608b956af" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 45557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:44:14.109899 9498 consensus_queue.cc:1035] T 347cb617967e4140bcbb59cab9c14604 P e3a83d70e18443ba9a29f1ac40ba3870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ff41aaee7844cbebdd8b6a2ae4bc4b9" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 40187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:44:14.118641 9506 mvcc.cc:205] Tried to move back new op lower bound from 7316128784822874112 to 7316128784748335104. Current Snapshot: MvccSnapshot[applied={T|T < 7316128784822874112}]
I20260808 04:44:14.117381 9509 mvcc.cc:205] Tried to move back new op lower bound from 7316128784822874112 to 7316128784748335104. Current Snapshot: MvccSnapshot[applied={T|T < 7316128784822874112}]
I20260808 04:44:14.125818 8615 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44586:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:44:14.125980 8615 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44586:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:44:14.128301 8615 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ef1c44e6a2dd4932909590f2633fa17e: Sending DeleteTablet for 3 replicas of tablet 347cb617967e4140bcbb59cab9c14604
I20260808 04:44:14.129101 9079 tablet_service.cc:1514] Processing DeleteTablet for tablet 347cb617967e4140bcbb59cab9c14604 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:44:14 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:34720
I20260808 04:44:14.129102 9316 tablet_service.cc:1514] Processing DeleteTablet for tablet 347cb617967e4140bcbb59cab9c14604 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:44:14 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:36760
I20260808 04:44:14.129631 9520 tablet_replica.cc:330] T 347cb617967e4140bcbb59cab9c14604 P d8d4b70655774f63968b6f9608b956af: stopping tablet replica
I20260808 04:44:14.129630 8838 tablet_service.cc:1514] Processing DeleteTablet for tablet 347cb617967e4140bcbb59cab9c14604 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:44:14 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:51262
I20260808 04:44:14.129837 9521 tablet_replica.cc:330] T 347cb617967e4140bcbb59cab9c14604 P e3a83d70e18443ba9a29f1ac40ba3870: stopping tablet replica
I20260808 04:44:14.129993 9520 raft_consensus.cc:2229] T 347cb617967e4140bcbb59cab9c14604 P d8d4b70655774f63968b6f9608b956af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:44:14.130159 9521 raft_consensus.cc:2229] T 347cb617967e4140bcbb59cab9c14604 P e3a83d70e18443ba9a29f1ac40ba3870 [term 1 LEADER]: Raft consensus shutting down.
I20260808 04:44:14.130326 9520 raft_consensus.cc:2258] T 347cb617967e4140bcbb59cab9c14604 P d8d4b70655774f63968b6f9608b956af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:44:14.130560 9521 raft_consensus.cc:2258] T 347cb617967e4140bcbb59cab9c14604 P e3a83d70e18443ba9a29f1ac40ba3870 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:44:14.131155 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 8725
I20260808 04:44:14.133244 9520 ts_tablet_manager.cc:1905] T 347cb617967e4140bcbb59cab9c14604 P d8d4b70655774f63968b6f9608b956af: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:44:14.136099 9520 ts_tablet_manager.cc:1918] T 347cb617967e4140bcbb59cab9c14604 P d8d4b70655774f63968b6f9608b956af: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:44:14.136200 9520 log.cc:1196] T 347cb617967e4140bcbb59cab9c14604 P d8d4b70655774f63968b6f9608b956af: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-1/wal/wals/347cb617967e4140bcbb59cab9c14604
I20260808 04:44:14.136516 9520 ts_tablet_manager.cc:1939] T 347cb617967e4140bcbb59cab9c14604 P d8d4b70655774f63968b6f9608b956af: Deleting consensus metadata
I20260808 04:44:14.138047 8585 catalog_manager.cc:4841] TS d8d4b70655774f63968b6f9608b956af (127.12.148.66:45557): tablet 347cb617967e4140bcbb59cab9c14604 (table test-table [id=74740ade7c2e4aff98abafffa2b6a199]) successfully deleted
I20260808 04:44:14.144943 9521 ts_tablet_manager.cc:1905] T 347cb617967e4140bcbb59cab9c14604 P e3a83d70e18443ba9a29f1ac40ba3870: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:44:14.147768 9521 ts_tablet_manager.cc:1918] T 347cb617967e4140bcbb59cab9c14604 P e3a83d70e18443ba9a29f1ac40ba3870: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:44:14.147878 9521 log.cc:1196] T 347cb617967e4140bcbb59cab9c14604 P e3a83d70e18443ba9a29f1ac40ba3870: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786164004017495-12881-0/minicluster-data/ts-2/wal/wals/347cb617967e4140bcbb59cab9c14604
I20260808 04:44:14.148183 9521 ts_tablet_manager.cc:1939] T 347cb617967e4140bcbb59cab9c14604 P e3a83d70e18443ba9a29f1ac40ba3870: Deleting consensus metadata
I20260808 04:44:14.149435 8588 catalog_manager.cc:4841] TS e3a83d70e18443ba9a29f1ac40ba3870 (127.12.148.67:43575): tablet 347cb617967e4140bcbb59cab9c14604 (table test-table [id=74740ade7c2e4aff98abafffa2b6a199]) successfully deleted
W20260808 04:44:14.150103 8586 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.148.65:40187 (error 108)
I20260808 04:44:14.150314 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 8961
I20260808 04:44:14.155200 9468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:14.154731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:40187 (local address 127.0.0.1:51272)
0808 04:44:14.154993 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:14.155091 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.65:40187: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142}
W20260808 04:44:14.155437 8586 catalog_manager.cc:4584] TS 5ff41aaee7844cbebdd8b6a2ae4bc4b9 (127.12.148.65:40187): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 347cb617967e4140bcbb59cab9c14604: Network error: Client connection negotiation failed: client connection to 127.12.148.65:40187: connect: Connection refused (error 111)
I20260808 04:44:14.186236 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 9199
I20260808 04:44:14.199813 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 8558
2026-08-08T04:44:14Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2428 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-08T04:44:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:14Z Disabled control of system clock
I20260808 04:44:14.239308 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:45935
--webserver_interface=127.12.148.126
--webserver_port=0
--builtin_ntp_servers=127.12.148.84:46319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:45935
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 04:44:14.352422 9530 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:14.352672 9530 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:14.352705 9530 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:14.356726 9530 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:14.356787 9530 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:14.356801 9530 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:14.356837 9530 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:14.356871 9530 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:14.361452 9530 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:46319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:45935
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:45935
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9530
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:14.362442 9530 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:14.363811 9530 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:14.372684 9540 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:14.372678 9544 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:14.372876 9541 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:14.373368 9530 server_base.cc:1034] running on GCE node
I20260808 04:44:14.374150 9530 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:14.375499 9530 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:14.376667 9530 hybrid_clock.cc:648] HybridClock initialized: now 1786164254376634 us; error 67 us; skew 500 ppm
I20260808 04:44:14.378836 9530 webserver.cc:460] Webserver started at http://127.12.148.126:37983/ using document root <none> and password file <none>
I20260808 04:44:14.379544 9530 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:14.379633 9530 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:14.379875 9530 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:14.381968 9530 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "28a5a25120c54baab58700fb5c213c71"
format_stamp: "Formatted at 2026-08-08 04:44:14 on dist-test-slave-t7g5"
server_key: "6c68affcc66cbcd877d40847fc0729a8"
server_key_iv: "5e921ecbe7b70b3ea6f06b52066fc665"
server_key_version: "encryptionkey@0"
I20260808 04:44:14.382488 9530 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "28a5a25120c54baab58700fb5c213c71"
format_stamp: "Formatted at 2026-08-08 04:44:14 on dist-test-slave-t7g5"
server_key: "6c68affcc66cbcd877d40847fc0729a8"
server_key_iv: "5e921ecbe7b70b3ea6f06b52066fc665"
server_key_version: "encryptionkey@0"
I20260808 04:44:14.386287 9530 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 04:44:14.389237 9557 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:14.390584 9530 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:44:14.390699 9530 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "28a5a25120c54baab58700fb5c213c71"
format_stamp: "Formatted at 2026-08-08 04:44:14 on dist-test-slave-t7g5"
server_key: "6c68affcc66cbcd877d40847fc0729a8"
server_key_iv: "5e921ecbe7b70b3ea6f06b52066fc665"
server_key_version: "encryptionkey@0"
I20260808 04:44:14.390822 9530 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:14.407537 9530 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:14.408293 9530 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:14.408489 9530 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:14.415773 9530 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:45935
I20260808 04:44:14.415802 9639 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:45935 every 8 connection(s)
I20260808 04:44:14.416769 9530 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:14.419981 9643 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:14.425194 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 9530
I20260808 04:44:14.425304 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:44:14.425537 9643 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 28a5a25120c54baab58700fb5c213c71: Bootstrap starting.
I20260808 04:44:14.425580 12881 external_mini_cluster.cc:1428] Setting key 464285d6ec4696f25dfe226dd62d0382
I20260808 04:44:14.428110 9643 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 28a5a25120c54baab58700fb5c213c71: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:14.428848 9643 log.cc:824] T 00000000000000000000000000000000 P 28a5a25120c54baab58700fb5c213c71: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:14.430881 9643 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 28a5a25120c54baab58700fb5c213c71: No bootstrap required, opened a new log
I20260808 04:44:14.434368 9643 raft_consensus.cc:348] T 00000000000000000000000000000000 P 28a5a25120c54baab58700fb5c213c71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28a5a25120c54baab58700fb5c213c71" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45935 } }
I20260808 04:44:14.434595 9643 raft_consensus.cc:374] T 00000000000000000000000000000000 P 28a5a25120c54baab58700fb5c213c71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:14.434653 9643 raft_consensus.cc:729] T 00000000000000000000000000000000 P 28a5a25120c54baab58700fb5c213c71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28a5a25120c54baab58700fb5c213c71, State: Initialized, Role: FOLLOWER
I20260808 04:44:14.434774 9652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:14.426948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59912 (local address 127.12.148.126:45935)
0808 04:44:14.427617 (+ 669us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:14.427632 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:14.427668 (+ 36us) server_negotiation.cc:407] Connection header received
0808 04:44:14.428321 (+ 653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:14.428340 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:14.428781 (+ 441us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:14.429149 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:14.429623 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:14.430633 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:14.431576 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:14.432050 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:14.432198 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:14.433009 (+ 811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:14.433014 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:14.433028 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:14.433408 (+ 380us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:14.433475 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:14.433496 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:14.433582 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:14.433748 (+ 166us) server_negotiation.cc:299] Negotiation successful
0808 04:44:14.434004 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":134,"threads_started":1}
I20260808 04:44:14.435110 9643 consensus_queue.cc:260] T 00000000000000000000000000000000 P 28a5a25120c54baab58700fb5c213c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28a5a25120c54baab58700fb5c213c71" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45935 } }
I20260808 04:44:14.435247 9643 raft_consensus.cc:388] T 00000000000000000000000000000000 P 28a5a25120c54baab58700fb5c213c71 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:14.435315 9643 raft_consensus.cc:482] T 00000000000000000000000000000000 P 28a5a25120c54baab58700fb5c213c71 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:14.435416 9643 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 28a5a25120c54baab58700fb5c213c71 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:14.436314 9643 raft_consensus.cc:504] T 00000000000000000000000000000000 P 28a5a25120c54baab58700fb5c213c71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28a5a25120c54baab58700fb5c213c71" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45935 } }
I20260808 04:44:14.436643 9643 leader_election.cc:302] T 00000000000000000000000000000000 P 28a5a25120c54baab58700fb5c213c71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 28a5a25120c54baab58700fb5c213c71; no voters:
I20260808 04:44:14.436964 9643 leader_election.cc:288] T 00000000000000000000000000000000 P 28a5a25120c54baab58700fb5c213c71 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:14.437052 9654 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 28a5a25120c54baab58700fb5c213c71 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:14.437229 9654 raft_consensus.cc:686] T 00000000000000000000000000000000 P 28a5a25120c54baab58700fb5c213c71 [term 1 LEADER]: Becoming Leader. State: Replica: 28a5a25120c54baab58700fb5c213c71, State: Running, Role: LEADER
I20260808 04:44:14.437533 9654 consensus_queue.cc:237] T 00000000000000000000000000000000 P 28a5a25120c54baab58700fb5c213c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28a5a25120c54baab58700fb5c213c71" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45935 } }
I20260808 04:44:14.438248 9643 sys_catalog.cc:564] T 00000000000000000000000000000000 P 28a5a25120c54baab58700fb5c213c71 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:14.439219 9656 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28a5a25120c54baab58700fb5c213c71 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "28a5a25120c54baab58700fb5c213c71" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28a5a25120c54baab58700fb5c213c71" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45935 } } }
I20260808 04:44:14.439342 9656 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28a5a25120c54baab58700fb5c213c71 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:14.439734 9674 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:14.439750 9657 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28a5a25120c54baab58700fb5c213c71 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 28a5a25120c54baab58700fb5c213c71. Latest consensus state: current_term: 1 leader_uuid: "28a5a25120c54baab58700fb5c213c71" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28a5a25120c54baab58700fb5c213c71" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 45935 } } }
I20260808 04:44:14.440447 9657 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28a5a25120c54baab58700fb5c213c71 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:14.442874 9674 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:14.448428 9674 catalog_manager.cc:1347] Generated new cluster ID: 978e3ff0a3fa4ad28ec83e82caef79e8
I20260808 04:44:14.448501 9674 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:14.473392 9674 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:14.474632 9674 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:14.478806 9674 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 28a5a25120c54baab58700fb5c213c71: Generated new TSK 0
I20260808 04:44:14.479631 9674 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:44:14.484459 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.65:0
--local_ip_for_outbound_sockets=127.12.148.65
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:45935
--builtin_ntp_servers=127.12.148.84:46319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 04:44:14.598273 9693 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:14.598562 9693 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:14.598606 9693 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:14.602736 9693 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:14.602798 9693 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:14.602854 9693 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.65
I20260808 04:44:14.607657 9693 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:46319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:45935
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9693
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.65
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:14.608747 9693 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:14.610260 9693 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:14.620203 9703 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:14.620167 9702 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:14.620360 9693 server_base.cc:1034] running on GCE node
W20260808 04:44:14.620193 9708 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:14.620980 9693 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:14.621701 9693 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:14.622876 9693 hybrid_clock.cc:648] HybridClock initialized: now 1786164254622842 us; error 49 us; skew 500 ppm
I20260808 04:44:14.624763 9693 webserver.cc:460] Webserver started at http://127.12.148.65:42157/ using document root <none> and password file <none>
I20260808 04:44:14.625350 9693 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:14.625415 9693 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:14.625640 9693 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:14.627985 9693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-0/data/instance:
uuid: "ef91a77512a5482281c1c9c7e217b3fb"
format_stamp: "Formatted at 2026-08-08 04:44:14 on dist-test-slave-t7g5"
server_key: "afcf0f69c53c826a9dd2414632f4e3d0"
server_key_iv: "e0e4abc5c0e03619fdc61cdedc3d2846"
server_key_version: "encryptionkey@0"
I20260808 04:44:14.628584 9693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance:
uuid: "ef91a77512a5482281c1c9c7e217b3fb"
format_stamp: "Formatted at 2026-08-08 04:44:14 on dist-test-slave-t7g5"
server_key: "afcf0f69c53c826a9dd2414632f4e3d0"
server_key_iv: "e0e4abc5c0e03619fdc61cdedc3d2846"
server_key_version: "encryptionkey@0"
I20260808 04:44:14.632464 9693 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260808 04:44:14.634927 9718 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:14.636133 9693 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 04:44:14.636245 9693 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-0/wal
uuid: "ef91a77512a5482281c1c9c7e217b3fb"
format_stamp: "Formatted at 2026-08-08 04:44:14 on dist-test-slave-t7g5"
server_key: "afcf0f69c53c826a9dd2414632f4e3d0"
server_key_iv: "e0e4abc5c0e03619fdc61cdedc3d2846"
server_key_version: "encryptionkey@0"
I20260808 04:44:14.636351 9693 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:14.656396 9693 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:14.657169 9693 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:14.657380 9693 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:14.658074 9693 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:44:14.659097 9693 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:44:14.659154 9693 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:14.659215 9693 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:44:14.659250 9693 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:14.668682 9693 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.65:34605
I20260808 04:44:14.668705 9932 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.65:34605 every 8 connection(s)
I20260808 04:44:14.669684 9693 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
I20260808 04:44:14.671857 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 9693
I20260808 04:44:14.672006 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance
I20260808 04:44:14.672401 12881 external_mini_cluster.cc:1428] Setting key 85e52543ef16a840b7f86b6c18dec9fa
I20260808 04:44:14.674602 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.66:0
--local_ip_for_outbound_sockets=127.12.148.66
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:45935
--builtin_ntp_servers=127.12.148.84:46319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 04:44:14.680446 9652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:14.671602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:44087 (local address 127.12.148.126:45935)
0808 04:44:14.671743 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:14.671746 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:14.673260 (+ 1514us) server_negotiation.cc:407] Connection header received
0808 04:44:14.674725 (+ 1465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:14.674730 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:14.674822 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:14.674941 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:14.676086 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:14.676775 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:14.678357 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:14.678596 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:14.678686 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:14.680001 (+ 1315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:14.680005 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:14.680007 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:14.680019 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:14.680038 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:14.680046 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:14.680106 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:14.680282 (+ 176us) server_negotiation.cc:299] Negotiation successful
0808 04:44:14.680331 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 04:44:14.681838 9939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:14.672117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:45935 (local address 127.12.148.65:44087)
0808 04:44:14.672903 (+ 786us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:14.672961 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:14.674421 (+ 1460us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:14.675144 (+ 723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:14.675154 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:14.675271 (+ 117us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:14.675921 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:14.675937 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:14.676912 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:14.676916 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:14.678228 (+ 1312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:14.678240 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:14.678762 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:14.678766 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:14.678955 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:14.679650 (+ 695us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:44:14.679653 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:14.679724 (+ 71us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:44:14.679835 (+ 111us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:14.680132 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:14.680142 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:14.680148 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 04:44:14.680280 (+ 132us) client_negotiation.cc:240] Negotiation successful
0808 04:44:14.680718 (+ 438us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":160,"threads_started":1}
I20260808 04:44:14.683115 9934 heartbeater.cc:347] Connected to a master server at 127.12.148.126:45935
I20260808 04:44:14.683339 9934 heartbeater.cc:464] Registering TS with master...
I20260808 04:44:14.683841 9934 heartbeater.cc:511] Master 127.12.148.126:45935 requested a full tablet report, sending...
I20260808 04:44:14.685352 9582 ts_manager.cc:194] Registered new tserver with Master: ef91a77512a5482281c1c9c7e217b3fb (127.12.148.65:34605)
I20260808 04:44:14.686539 9582 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.148.65:44087
W20260808 04:44:14.788715 9940 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:14.789009 9940 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:14.789067 9940 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:14.793095 9940 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:14.793167 9940 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:14.793241 9940 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.66
I20260808 04:44:14.798238 9940 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:46319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:45935
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9940
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.66
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:14.799371 9940 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:14.800807 9940 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:14.810662 9953 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:14.810700 9957 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:14.810710 9954 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:14.810899 9940 server_base.cc:1034] running on GCE node
I20260808 04:44:14.811452 9940 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:14.812096 9940 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:14.813284 9940 hybrid_clock.cc:648] HybridClock initialized: now 1786164254813258 us; error 34 us; skew 500 ppm
I20260808 04:44:14.815164 9940 webserver.cc:460] Webserver started at http://127.12.148.66:34977/ using document root <none> and password file <none>
I20260808 04:44:14.815750 9940 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:14.815821 9940 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:14.816164 9940 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:14.818486 9940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-1/data/instance:
uuid: "e1424b7eed8241dc830423a1d1c64d00"
format_stamp: "Formatted at 2026-08-08 04:44:14 on dist-test-slave-t7g5"
server_key: "c792978d05cedc3ad897d9dd99abc657"
server_key_iv: "3389cf403a239ad01bf885f7f48ebc32"
server_key_version: "encryptionkey@0"
I20260808 04:44:14.819016 9940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance:
uuid: "e1424b7eed8241dc830423a1d1c64d00"
format_stamp: "Formatted at 2026-08-08 04:44:14 on dist-test-slave-t7g5"
server_key: "c792978d05cedc3ad897d9dd99abc657"
server_key_iv: "3389cf403a239ad01bf885f7f48ebc32"
server_key_version: "encryptionkey@0"
I20260808 04:44:14.822692 9940 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 04:44:14.825220 9966 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:14.826490 9940 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:44:14.826601 9940 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-1/wal
uuid: "e1424b7eed8241dc830423a1d1c64d00"
format_stamp: "Formatted at 2026-08-08 04:44:14 on dist-test-slave-t7g5"
server_key: "c792978d05cedc3ad897d9dd99abc657"
server_key_iv: "3389cf403a239ad01bf885f7f48ebc32"
server_key_version: "encryptionkey@0"
I20260808 04:44:14.826709 9940 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:14.838129 9940 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:14.838785 9940 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:14.838999 9940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:14.839624 9940 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:44:14.840670 9940 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:44:14.840720 9940 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:14.840765 9940 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:44:14.840794 9940 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:14.849308 9940 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.66:44855
I20260808 04:44:14.849334 10166 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.66:44855 every 8 connection(s)
I20260808 04:44:14.850274 9940 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
I20260808 04:44:14.852138 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 9940
I20260808 04:44:14.852272 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance
I20260808 04:44:14.852598 12881 external_mini_cluster.cc:1428] Setting key edb8bda72fe4f610f2bdf3f7b381ec7d
I20260808 04:44:14.854960 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.67:0
--local_ip_for_outbound_sockets=127.12.148.67
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:45935
--builtin_ntp_servers=127.12.148.84:46319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 04:44:14.860719 9652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:14.853926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:34933 (local address 127.12.148.126:45935)
0808 04:44:14.854075 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:14.854079 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:14.854094 (+ 15us) server_negotiation.cc:407] Connection header received
0808 04:44:14.855419 (+ 1325us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:14.855421 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:14.855486 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:14.855546 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:14.856707 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:14.857481 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:14.858675 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:14.859003 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:14.859118 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:14.860222 (+ 1104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:14.860225 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:14.860226 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:14.860240 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:14.860260 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:14.860268 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:14.860325 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:14.860549 (+ 224us) server_negotiation.cc:299] Negotiation successful
0808 04:44:14.860602 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 04:44:14.861933 10172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:14.852744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:45935 (local address 127.12.148.66:34933)
0808 04:44:14.853548 (+ 804us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:14.853603 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:14.855184 (+ 1581us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:14.855763 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:14.855772 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:14.855893 (+ 121us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:14.856558 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:14.856577 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:14.857601 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:14.857604 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:14.858535 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:14.858545 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:14.859147 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:14.859150 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:14.859287 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:14.859908 (+ 621us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:44:14.859910 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:14.859969 (+ 59us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:44:14.860059 (+ 90us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:14.860362 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:14.860371 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:14.860378 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 04:44:14.860527 (+ 149us) client_negotiation.cc:240] Negotiation successful
0808 04:44:14.860838 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":154,"threads_started":1}
I20260808 04:44:14.863121 10167 heartbeater.cc:347] Connected to a master server at 127.12.148.126:45935
I20260808 04:44:14.863402 10167 heartbeater.cc:464] Registering TS with master...
I20260808 04:44:14.864099 10167 heartbeater.cc:511] Master 127.12.148.126:45935 requested a full tablet report, sending...
I20260808 04:44:14.865267 9582 ts_manager.cc:194] Registered new tserver with Master: e1424b7eed8241dc830423a1d1c64d00 (127.12.148.66:44855)
I20260808 04:44:14.866132 9582 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.148.66:34933
W20260808 04:44:14.970826 10173 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:14.971114 10173 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:14.971153 10173 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:14.975071 10173 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:14.975123 10173 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:14.975176 10173 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.67
I20260808 04:44:14.980021 10173 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:46319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:45935
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10173
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.67
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:14.981046 10173 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:14.982475 10173 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:14.991837 10181 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:14.991828 10183 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:14.991828 10187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:14.992029 10173 server_base.cc:1034] running on GCE node
I20260808 04:44:14.992515 10173 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:14.993155 10173 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:14.994311 10173 hybrid_clock.cc:648] HybridClock initialized: now 1786164254994292 us; error 31 us; skew 500 ppm
I20260808 04:44:14.996107 10173 webserver.cc:460] Webserver started at http://127.12.148.67:38297/ using document root <none> and password file <none>
I20260808 04:44:14.996681 10173 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:14.996757 10173 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:14.996965 10173 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:14.999085 10173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-2/data/instance:
uuid: "7282f870bd6b401abbe43d9712f99513"
format_stamp: "Formatted at 2026-08-08 04:44:14 on dist-test-slave-t7g5"
server_key: "d5222817cedc1e6e23c7fbf2909abd5c"
server_key_iv: "36d73104369d27b5f7070f697da756ab"
server_key_version: "encryptionkey@0"
I20260808 04:44:14.999642 10173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance:
uuid: "7282f870bd6b401abbe43d9712f99513"
format_stamp: "Formatted at 2026-08-08 04:44:14 on dist-test-slave-t7g5"
server_key: "d5222817cedc1e6e23c7fbf2909abd5c"
server_key_iv: "36d73104369d27b5f7070f697da756ab"
server_key_version: "encryptionkey@0"
I20260808 04:44:15.003307 10173 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.005s
I20260808 04:44:15.005748 10196 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:15.007030 10173 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.002s
I20260808 04:44:15.007136 10173 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-2/wal
uuid: "7282f870bd6b401abbe43d9712f99513"
format_stamp: "Formatted at 2026-08-08 04:44:14 on dist-test-slave-t7g5"
server_key: "d5222817cedc1e6e23c7fbf2909abd5c"
server_key_iv: "36d73104369d27b5f7070f697da756ab"
server_key_version: "encryptionkey@0"
I20260808 04:44:15.007251 10173 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:15.016040 10173 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:15.016690 10173 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:15.016863 10173 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:15.017444 10173 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:44:15.018442 10173 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:44:15.018492 10173 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:15.018536 10173 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:44:15.018565 10173 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:15.027074 10173 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.67:42765
I20260808 04:44:15.027100 10388 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.67:42765 every 8 connection(s)
I20260808 04:44:15.028015 10173 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
I20260808 04:44:15.032248 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 10173
I20260808 04:44:15.032358 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance
I20260808 04:44:15.032619 12881 external_mini_cluster.cc:1428] Setting key ff08023de4f6344409edd1d8bab09776
I20260808 04:44:15.037580 9652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:15.029874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:47583 (local address 127.12.148.126:45935)
0808 04:44:15.030040 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:15.030044 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:15.031293 (+ 1249us) server_negotiation.cc:407] Connection header received
0808 04:44:15.032739 (+ 1446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:15.032743 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:15.032800 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:15.032894 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:15.034091 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:15.034655 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:15.035865 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:15.036119 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:15.036200 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:15.037186 (+ 986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:15.037189 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:15.037191 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:15.037203 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:15.037223 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:15.037231 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:15.037283 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:15.037397 (+ 114us) server_negotiation.cc:299] Negotiation successful
0808 04:44:15.037462 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 04:44:15.038550 10394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:15.030369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:45935 (local address 127.12.148.67:47583)
0808 04:44:15.031141 (+ 772us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:15.031185 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:15.032518 (+ 1333us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:15.033103 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:15.033113 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:15.033210 (+ 97us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:15.033950 (+ 740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:15.033973 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:15.034791 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:15.034795 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:15.035745 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:15.035755 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:15.036250 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:15.036252 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:15.036399 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:15.036936 (+ 537us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:44:15.036938 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:15.036985 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:44:15.037054 (+ 69us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:15.037294 (+ 240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:15.037299 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:15.037303 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 04:44:15.037391 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 04:44:15.037628 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":109,"threads_started":1}
I20260808 04:44:15.039667 10391 heartbeater.cc:347] Connected to a master server at 127.12.148.126:45935
I20260808 04:44:15.039907 10391 heartbeater.cc:464] Registering TS with master...
I20260808 04:44:15.040519 10391 heartbeater.cc:511] Master 127.12.148.126:45935 requested a full tablet report, sending...
I20260808 04:44:15.041533 9582 ts_manager.cc:194] Registered new tserver with Master: 7282f870bd6b401abbe43d9712f99513 (127.12.148.67:42765)
I20260808 04:44:15.042124 9582 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.148.67:47583
I20260808 04:44:15.046526 12881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 04:44:15.052313 9652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:15.048614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59926 (local address 127.12.148.126:45935)
0808 04:44:15.048738 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:15.048743 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:15.048888 (+ 145us) server_negotiation.cc:407] Connection header received
0808 04:44:15.048970 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:15.048972 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:15.049015 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:15.049070 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:15.049303 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:15.049815 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:15.050847 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:15.051065 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:15.051152 (+ 87us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:15.051918 (+ 766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:15.051921 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:15.051923 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:15.051934 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:15.051954 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:15.051962 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:15.052065 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:15.052159 (+ 94us) server_negotiation.cc:299] Negotiation successful
0808 04:44:15.052194 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 04:44:15.055294 9582 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59926:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:44:15.058322 9582 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:44:15.072623 10420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:15.066895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.67:42765 (local address 127.0.0.1:35324)
0808 04:44:15.067304 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:15.067317 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:15.067445 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:15.068705 (+ 1260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:15.068707 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:15.068724 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:15.068807 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:15.068813 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:15.069781 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:15.069784 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:15.071270 (+ 1486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:15.071281 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:15.072075 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:15.072079 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:15.072194 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:15.072233 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 04:44:15.072340 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 04:44:15.072462 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":348,"mutex_wait_us":134,"thread_start_us":96,"threads_started":1}
I20260808 04:44:15.072659 10421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:15.067281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:44855 (local address 127.0.0.1:55584)
0808 04:44:15.067738 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:15.067752 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:15.067837 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:15.068461 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:15.068464 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:15.068483 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:15.068578 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:15.068585 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:15.070073 (+ 1488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:15.070077 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:15.071329 (+ 1252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:15.071337 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:15.072350 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:15.072354 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:15.072432 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:15.072452 (+ 20us) client_negotiation.cc:769] Sending connection context
0808 04:44:15.072506 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 04:44:15.072563 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":398,"mutex_wait_us":88,"thread_start_us":89,"threads_started":1}
I20260808 04:44:15.072969 10413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:15.066578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:34605 (local address 127.0.0.1:56982)
0808 04:44:15.066976 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:15.067028 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:15.067621 (+ 593us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:15.068406 (+ 785us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:15.068412 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:15.068434 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:15.068567 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:15.068575 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:15.070108 (+ 1533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:15.070111 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:15.071257 (+ 1146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:15.071267 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:15.072564 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:15.072568 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:15.072654 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:15.072676 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 04:44:15.072750 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 04:44:15.072824 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"mutex_wait_us":22,"thread_start_us":79,"threads_started":1}
I20260808 04:44:15.073248 10422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:15.067324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35324 (local address 127.12.148.67:42765)
0808 04:44:15.068304 (+ 980us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:15.068321 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:15.068345 (+ 24us) server_negotiation.cc:407] Connection header received
0808 04:44:15.068415 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:15.068419 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:15.068598 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:15.068733 (+ 135us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:15.068894 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:15.069633 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:15.071412 (+ 1779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:15.071958 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:15.072057 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:15.072277 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:15.072982 (+ 705us) server_negotiation.cc:299] Negotiation successful
0808 04:44:15.073080 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":857,"thread_start_us":98,"threads_started":1}
I20260808 04:44:15.073359 10423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:15.067695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55584 (local address 127.12.148.66:44855)
0808 04:44:15.068064 (+ 369us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:15.068073 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:15.068093 (+ 20us) server_negotiation.cc:407] Connection header received
0808 04:44:15.068169 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:15.068174 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:15.068332 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:15.068474 (+ 142us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:15.068701 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:15.069961 (+ 1260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:15.071459 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:15.072201 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:15.072343 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:15.072504 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:15.072558 (+ 54us) server_negotiation.cc:299] Negotiation successful
0808 04:44:15.072671 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":279,"thread_start_us":106,"threads_started":1}
I20260808 04:44:15.073407 10414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:15.066703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56982 (local address 127.12.148.65:34605)
0808 04:44:15.067384 (+ 681us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:15.067397 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:15.067426 (+ 29us) server_negotiation.cc:407] Connection header received
0808 04:44:15.067812 (+ 386us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:15.067818 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:15.068046 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:15.068220 (+ 174us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:15.068701 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:15.069955 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:15.071382 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:15.072201 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:15.072308 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:15.072498 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:15.073157 (+ 659us) server_negotiation.cc:299] Negotiation successful
0808 04:44:15.073266 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":569,"thread_start_us":165,"threads_started":1}
I20260808 04:44:15.075947 10269 tablet_service.cc:1467] Processing CreateTablet for tablet 2e0c4faa33c04814a011cb4ca0924ed1 (DEFAULT_TABLE table=test-table [id=6106b8c638444d6386bae591d3ce639f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:44:15.075949 10056 tablet_service.cc:1467] Processing CreateTablet for tablet 2e0c4faa33c04814a011cb4ca0924ed1 (DEFAULT_TABLE table=test-table [id=6106b8c638444d6386bae591d3ce639f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:44:15.076953 10269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e0c4faa33c04814a011cb4ca0924ed1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:15.076957 10056 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e0c4faa33c04814a011cb4ca0924ed1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:15.078534 9802 tablet_service.cc:1467] Processing CreateTablet for tablet 2e0c4faa33c04814a011cb4ca0924ed1 (DEFAULT_TABLE table=test-table [id=6106b8c638444d6386bae591d3ce639f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:44:15.079574 9802 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e0c4faa33c04814a011cb4ca0924ed1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:15.083436 10425 tablet_bootstrap.cc:492] T 2e0c4faa33c04814a011cb4ca0924ed1 P 7282f870bd6b401abbe43d9712f99513: Bootstrap starting.
I20260808 04:44:15.084378 10426 tablet_bootstrap.cc:492] T 2e0c4faa33c04814a011cb4ca0924ed1 P e1424b7eed8241dc830423a1d1c64d00: Bootstrap starting.
I20260808 04:44:15.086102 10425 tablet_bootstrap.cc:654] T 2e0c4faa33c04814a011cb4ca0924ed1 P 7282f870bd6b401abbe43d9712f99513: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:15.086193 10427 tablet_bootstrap.cc:492] T 2e0c4faa33c04814a011cb4ca0924ed1 P ef91a77512a5482281c1c9c7e217b3fb: Bootstrap starting.
I20260808 04:44:15.086760 10426 tablet_bootstrap.cc:654] T 2e0c4faa33c04814a011cb4ca0924ed1 P e1424b7eed8241dc830423a1d1c64d00: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:15.087153 10425 log.cc:824] T 2e0c4faa33c04814a011cb4ca0924ed1 P 7282f870bd6b401abbe43d9712f99513: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:15.087569 10426 log.cc:824] T 2e0c4faa33c04814a011cb4ca0924ed1 P e1424b7eed8241dc830423a1d1c64d00: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:15.088080 10427 tablet_bootstrap.cc:654] T 2e0c4faa33c04814a011cb4ca0924ed1 P ef91a77512a5482281c1c9c7e217b3fb: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:15.088861 10427 log.cc:824] T 2e0c4faa33c04814a011cb4ca0924ed1 P ef91a77512a5482281c1c9c7e217b3fb: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:15.089186 10425 tablet_bootstrap.cc:492] T 2e0c4faa33c04814a011cb4ca0924ed1 P 7282f870bd6b401abbe43d9712f99513: No bootstrap required, opened a new log
I20260808 04:44:15.089381 10425 ts_tablet_manager.cc:1397] T 2e0c4faa33c04814a011cb4ca0924ed1 P 7282f870bd6b401abbe43d9712f99513: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 04:44:15.091099 10427 tablet_bootstrap.cc:492] T 2e0c4faa33c04814a011cb4ca0924ed1 P ef91a77512a5482281c1c9c7e217b3fb: No bootstrap required, opened a new log
I20260808 04:44:15.091293 10427 ts_tablet_manager.cc:1397] T 2e0c4faa33c04814a011cb4ca0924ed1 P ef91a77512a5482281c1c9c7e217b3fb: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260808 04:44:15.091722 10426 tablet_bootstrap.cc:492] T 2e0c4faa33c04814a011cb4ca0924ed1 P e1424b7eed8241dc830423a1d1c64d00: No bootstrap required, opened a new log
I20260808 04:44:15.091904 10426 ts_tablet_manager.cc:1397] T 2e0c4faa33c04814a011cb4ca0924ed1 P e1424b7eed8241dc830423a1d1c64d00: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20260808 04:44:15.093557 10425 raft_consensus.cc:348] T 2e0c4faa33c04814a011cb4ca0924ed1 P 7282f870bd6b401abbe43d9712f99513 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef91a77512a5482281c1c9c7e217b3fb" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 34605 } } peers { permanent_uuid: "e1424b7eed8241dc830423a1d1c64d00" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 44855 } } peers { permanent_uuid: "7282f870bd6b401abbe43d9712f99513" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 42765 } }
I20260808 04:44:15.093871 10425 raft_consensus.cc:374] T 2e0c4faa33c04814a011cb4ca0924ed1 P 7282f870bd6b401abbe43d9712f99513 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:15.093933 10425 raft_consensus.cc:729] T 2e0c4faa33c04814a011cb4ca0924ed1 P 7282f870bd6b401abbe43d9712f99513 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7282f870bd6b401abbe43d9712f99513, State: Initialized, Role: FOLLOWER
I20260808 04:44:15.094389 10425 consensus_queue.cc:260] T 2e0c4faa33c04814a011cb4ca0924ed1 P 7282f870bd6b401abbe43d9712f99513 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef91a77512a5482281c1c9c7e217b3fb" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 34605 } } peers { permanent_uuid: "e1424b7eed8241dc830423a1d1c64d00" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 44855 } } peers { permanent_uuid: "7282f870bd6b401abbe43d9712f99513" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 42765 } }
I20260808 04:44:15.094365 10427 raft_consensus.cc:348] T 2e0c4faa33c04814a011cb4ca0924ed1 P ef91a77512a5482281c1c9c7e217b3fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef91a77512a5482281c1c9c7e217b3fb" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 34605 } } peers { permanent_uuid: "e1424b7eed8241dc830423a1d1c64d00" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 44855 } } peers { permanent_uuid: "7282f870bd6b401abbe43d9712f99513" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 42765 } }
I20260808 04:44:15.094581 10427 raft_consensus.cc:374] T 2e0c4faa33c04814a011cb4ca0924ed1 P ef91a77512a5482281c1c9c7e217b3fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:15.094632 10427 raft_consensus.cc:729] T 2e0c4faa33c04814a011cb4ca0924ed1 P ef91a77512a5482281c1c9c7e217b3fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef91a77512a5482281c1c9c7e217b3fb, State: Initialized, Role: FOLLOWER
I20260808 04:44:15.095034 10427 consensus_queue.cc:260] T 2e0c4faa33c04814a011cb4ca0924ed1 P ef91a77512a5482281c1c9c7e217b3fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef91a77512a5482281c1c9c7e217b3fb" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 34605 } } peers { permanent_uuid: "e1424b7eed8241dc830423a1d1c64d00" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 44855 } } peers { permanent_uuid: "7282f870bd6b401abbe43d9712f99513" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 42765 } }
I20260808 04:44:15.095557 10425 ts_tablet_manager.cc:1428] T 2e0c4faa33c04814a011cb4ca0924ed1 P 7282f870bd6b401abbe43d9712f99513: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260808 04:44:15.095923 10391 heartbeater.cc:503] Master 127.12.148.126:45935 was elected leader, sending a full tablet report...
I20260808 04:44:15.095930 10426 raft_consensus.cc:348] T 2e0c4faa33c04814a011cb4ca0924ed1 P e1424b7eed8241dc830423a1d1c64d00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef91a77512a5482281c1c9c7e217b3fb" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 34605 } } peers { permanent_uuid: "e1424b7eed8241dc830423a1d1c64d00" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 44855 } } peers { permanent_uuid: "7282f870bd6b401abbe43d9712f99513" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 42765 } }
I20260808 04:44:15.096263 10426 raft_consensus.cc:374] T 2e0c4faa33c04814a011cb4ca0924ed1 P e1424b7eed8241dc830423a1d1c64d00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:15.096316 10426 raft_consensus.cc:729] T 2e0c4faa33c04814a011cb4ca0924ed1 P e1424b7eed8241dc830423a1d1c64d00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1424b7eed8241dc830423a1d1c64d00, State: Initialized, Role: FOLLOWER
I20260808 04:44:15.096366 9934 heartbeater.cc:503] Master 127.12.148.126:45935 was elected leader, sending a full tablet report...
I20260808 04:44:15.096642 10426 consensus_queue.cc:260] T 2e0c4faa33c04814a011cb4ca0924ed1 P e1424b7eed8241dc830423a1d1c64d00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef91a77512a5482281c1c9c7e217b3fb" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 34605 } } peers { permanent_uuid: "e1424b7eed8241dc830423a1d1c64d00" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 44855 } } peers { permanent_uuid: "7282f870bd6b401abbe43d9712f99513" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 42765 } }
I20260808 04:44:15.097121 10427 ts_tablet_manager.cc:1428] T 2e0c4faa33c04814a011cb4ca0924ed1 P ef91a77512a5482281c1c9c7e217b3fb: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 04:44:15.097496 10426 ts_tablet_manager.cc:1428] T 2e0c4faa33c04814a011cb4ca0924ed1 P e1424b7eed8241dc830423a1d1c64d00: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260808 04:44:15.097815 10167 heartbeater.cc:503] Master 127.12.148.126:45935 was elected leader, sending a full tablet report...
W20260808 04:44:15.101277 10169 tablet.cc:2369] T 2e0c4faa33c04814a011cb4ca0924ed1 P e1424b7eed8241dc830423a1d1c64d00: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:44:15.139573 10454 raft_consensus.cc:482] T 2e0c4faa33c04814a011cb4ca0924ed1 P e1424b7eed8241dc830423a1d1c64d00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:44:15.139835 10454 raft_consensus.cc:504] T 2e0c4faa33c04814a011cb4ca0924ed1 P e1424b7eed8241dc830423a1d1c64d00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef91a77512a5482281c1c9c7e217b3fb" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 34605 } } peers { permanent_uuid: "e1424b7eed8241dc830423a1d1c64d00" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 44855 } } peers { permanent_uuid: "7282f870bd6b401abbe43d9712f99513" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 42765 } }
I20260808 04:44:15.141052 10454 leader_election.cc:288] T 2e0c4faa33c04814a011cb4ca0924ed1 P e1424b7eed8241dc830423a1d1c64d00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef91a77512a5482281c1c9c7e217b3fb (127.12.148.65:34605), 7282f870bd6b401abbe43d9712f99513 (127.12.148.67:42765)
I20260808 04:44:15.145226 10172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:15.141273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:34605 (local address 127.12.148.66:52769)
0808 04:44:15.141515 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:15.141531 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:15.141687 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:15.141974 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:15.141977 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:15.141991 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:15.142112 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:15.142118 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:15.143106 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:15.143110 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:15.144172 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:15.144182 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:15.144802 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:15.144806 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:15.144902 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:15.144925 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 04:44:15.144993 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 04:44:15.145063 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"mutex_wait_us":24}
I20260808 04:44:15.145226 10414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:15.141371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:52769 (local address 127.12.148.65:34605)
0808 04:44:15.141488 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:15.141492 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:15.141627 (+ 135us) server_negotiation.cc:407] Connection header received
0808 04:44:15.141807 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:15.141810 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:15.141861 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:15.141950 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:15.142230 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:15.142988 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:15.144296 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:15.144685 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:15.144797 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:15.144851 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:15.145027 (+ 176us) server_negotiation.cc:299] Negotiation successful
0808 04:44:15.145105 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 04:44:15.145263 10422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:15.141450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:56491 (local address 127.12.148.67:42765)
0808 04:44:15.141611 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:15.141615 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:15.141934 (+ 319us) server_negotiation.cc:407] Connection header received
0808 04:44:15.142035 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:15.142039 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:15.142083 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:15.142145 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:15.142393 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:15.143098 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:15.144340 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:15.144737 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:15.144845 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:15.144894 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:15.145075 (+ 181us) server_negotiation.cc:299] Negotiation successful
0808 04:44:15.145144 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 04:44:15.145645 10455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:15.141370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.67:42765 (local address 127.12.148.66:56491)
0808 04:44:15.141841 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:15.141853 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:15.141949 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:15.142180 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:15.142183 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:15.142202 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:15.142296 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:15.142300 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:15.143190 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:15.143194 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:15.144219 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:15.144230 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:15.144855 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:15.144859 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:15.144961 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:15.144979 (+ 18us) client_negotiation.cc:769] Sending connection context
0808 04:44:15.145044 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 04:44:15.145114 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":405,"mutex_wait_us":22,"thread_start_us":160,"threads_started":1}
I20260808 04:44:15.145983 9835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e0c4faa33c04814a011cb4ca0924ed1" candidate_uuid: "e1424b7eed8241dc830423a1d1c64d00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef91a77512a5482281c1c9c7e217b3fb" is_pre_election: true
I20260808 04:44:15.146358 9835 raft_consensus.cc:2454] T 2e0c4faa33c04814a011cb4ca0924ed1 P ef91a77512a5482281c1c9c7e217b3fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1424b7eed8241dc830423a1d1c64d00 in term 0.
I20260808 04:44:15.146351 10305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e0c4faa33c04814a011cb4ca0924ed1" candidate_uuid: "e1424b7eed8241dc830423a1d1c64d00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7282f870bd6b401abbe43d9712f99513" is_pre_election: true
I20260808 04:44:15.146667 10305 raft_consensus.cc:2454] T 2e0c4faa33c04814a011cb4ca0924ed1 P 7282f870bd6b401abbe43d9712f99513 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1424b7eed8241dc830423a1d1c64d00 in term 0.
I20260808 04:44:15.146941 9969 leader_election.cc:302] T 2e0c4faa33c04814a011cb4ca0924ed1 P e1424b7eed8241dc830423a1d1c64d00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e1424b7eed8241dc830423a1d1c64d00, ef91a77512a5482281c1c9c7e217b3fb; no voters:
I20260808 04:44:15.147226 10454 raft_consensus.cc:2781] T 2e0c4faa33c04814a011cb4ca0924ed1 P e1424b7eed8241dc830423a1d1c64d00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:44:15.147315 10454 raft_consensus.cc:482] T 2e0c4faa33c04814a011cb4ca0924ed1 P e1424b7eed8241dc830423a1d1c64d00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:44:15.147367 10454 raft_consensus.cc:3037] T 2e0c4faa33c04814a011cb4ca0924ed1 P e1424b7eed8241dc830423a1d1c64d00 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:15.148447 10454 raft_consensus.cc:504] T 2e0c4faa33c04814a011cb4ca0924ed1 P e1424b7eed8241dc830423a1d1c64d00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef91a77512a5482281c1c9c7e217b3fb" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 34605 } } peers { permanent_uuid: "e1424b7eed8241dc830423a1d1c64d00" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 44855 } } peers { permanent_uuid: "7282f870bd6b401abbe43d9712f99513" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 42765 } }
I20260808 04:44:15.148777 10454 leader_election.cc:288] T 2e0c4faa33c04814a011cb4ca0924ed1 P e1424b7eed8241dc830423a1d1c64d00 [CANDIDATE]: Term 1 election: Requested vote from peers ef91a77512a5482281c1c9c7e217b3fb (127.12.148.65:34605), 7282f870bd6b401abbe43d9712f99513 (127.12.148.67:42765)
I20260808 04:44:15.149155 9835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e0c4faa33c04814a011cb4ca0924ed1" candidate_uuid: "e1424b7eed8241dc830423a1d1c64d00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef91a77512a5482281c1c9c7e217b3fb"
I20260808 04:44:15.149158 10305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e0c4faa33c04814a011cb4ca0924ed1" candidate_uuid: "e1424b7eed8241dc830423a1d1c64d00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7282f870bd6b401abbe43d9712f99513"
I20260808 04:44:15.149271 10305 raft_consensus.cc:3037] T 2e0c4faa33c04814a011cb4ca0924ed1 P 7282f870bd6b401abbe43d9712f99513 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:15.149287 9835 raft_consensus.cc:3037] T 2e0c4faa33c04814a011cb4ca0924ed1 P ef91a77512a5482281c1c9c7e217b3fb [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:15.150408 10305 raft_consensus.cc:2454] T 2e0c4faa33c04814a011cb4ca0924ed1 P 7282f870bd6b401abbe43d9712f99513 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1424b7eed8241dc830423a1d1c64d00 in term 1.
I20260808 04:44:15.150524 9835 raft_consensus.cc:2454] T 2e0c4faa33c04814a011cb4ca0924ed1 P ef91a77512a5482281c1c9c7e217b3fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1424b7eed8241dc830423a1d1c64d00 in term 1.
I20260808 04:44:15.150745 9970 leader_election.cc:302] T 2e0c4faa33c04814a011cb4ca0924ed1 P e1424b7eed8241dc830423a1d1c64d00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7282f870bd6b401abbe43d9712f99513, e1424b7eed8241dc830423a1d1c64d00; no voters:
I20260808 04:44:15.150925 10454 raft_consensus.cc:2781] T 2e0c4faa33c04814a011cb4ca0924ed1 P e1424b7eed8241dc830423a1d1c64d00 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:15.151156 10454 raft_consensus.cc:686] T 2e0c4faa33c04814a011cb4ca0924ed1 P e1424b7eed8241dc830423a1d1c64d00 [term 1 LEADER]: Becoming Leader. State: Replica: e1424b7eed8241dc830423a1d1c64d00, State: Running, Role: LEADER
I20260808 04:44:15.151495 10454 consensus_queue.cc:237] T 2e0c4faa33c04814a011cb4ca0924ed1 P e1424b7eed8241dc830423a1d1c64d00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef91a77512a5482281c1c9c7e217b3fb" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 34605 } } peers { permanent_uuid: "e1424b7eed8241dc830423a1d1c64d00" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 44855 } } peers { permanent_uuid: "7282f870bd6b401abbe43d9712f99513" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 42765 } }
I20260808 04:44:15.154695 9581 catalog_manager.cc:5495] T 2e0c4faa33c04814a011cb4ca0924ed1 P e1424b7eed8241dc830423a1d1c64d00 reported cstate change: term changed from 0 to 1, leader changed from <none> to e1424b7eed8241dc830423a1d1c64d00 (127.12.148.66). New cstate: current_term: 1 leader_uuid: "e1424b7eed8241dc830423a1d1c64d00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef91a77512a5482281c1c9c7e217b3fb" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1424b7eed8241dc830423a1d1c64d00" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 44855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7282f870bd6b401abbe43d9712f99513" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 42765 } health_report { overall_health: UNKNOWN } } }
W20260808 04:44:15.170902 9935 tablet.cc:2369] T 2e0c4faa33c04814a011cb4ca0924ed1 P ef91a77512a5482281c1c9c7e217b3fb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:44:15.171813 10423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:15.168133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55596 (local address 127.12.148.66:44855)
0808 04:44:15.168263 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:15.168267 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:15.168280 (+ 13us) server_negotiation.cc:407] Connection header received
0808 04:44:15.168350 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:15.168352 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:15.168407 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:15.168498 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:44:15.168676 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:15.169164 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:15.170177 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:15.170400 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:15.170493 (+ 93us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:15.170838 (+ 345us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:44:15.171312 (+ 474us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:44:15.171456 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:15.171624 (+ 168us) server_negotiation.cc:299] Negotiation successful
0808 04:44:15.171664 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 04:44:15.177837 10305 raft_consensus.cc:1261] T 2e0c4faa33c04814a011cb4ca0924ed1 P 7282f870bd6b401abbe43d9712f99513 [term 1 FOLLOWER]: Refusing update from remote peer e1424b7eed8241dc830423a1d1c64d00: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:44:15.177838 9835 raft_consensus.cc:1261] T 2e0c4faa33c04814a011cb4ca0924ed1 P ef91a77512a5482281c1c9c7e217b3fb [term 1 FOLLOWER]: Refusing update from remote peer e1424b7eed8241dc830423a1d1c64d00: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:44:15.178598 10454 consensus_queue.cc:1035] T 2e0c4faa33c04814a011cb4ca0924ed1 P e1424b7eed8241dc830423a1d1c64d00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef91a77512a5482281c1c9c7e217b3fb" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:44:15.178809 10456 consensus_queue.cc:1035] T 2e0c4faa33c04814a011cb4ca0924ed1 P e1424b7eed8241dc830423a1d1c64d00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7282f870bd6b401abbe43d9712f99513" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 42765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:44:15.187211 10461 mvcc.cc:205] Tried to move back new op lower bound from 7316128789200797696 to 7316128789103009792. Current Snapshot: MvccSnapshot[applied={T|T < 7316128789200797696}]
I20260808 04:44:15.187450 10463 mvcc.cc:205] Tried to move back new op lower bound from 7316128789200797696 to 7316128789103009792. Current Snapshot: MvccSnapshot[applied={T|T < 7316128789200797696}]
I20260808 04:44:15.196280 9580 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59926:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:44:15.196491 9580 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59926:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:44:15.199038 9580 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 28a5a25120c54baab58700fb5c213c71: Sending DeleteTablet for 3 replicas of tablet 2e0c4faa33c04814a011cb4ca0924ed1
I20260808 04:44:15.199950 9802 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e0c4faa33c04814a011cb4ca0924ed1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:44:15 UTC) from {username='slave'} at 127.0.0.1:56982
I20260808 04:44:15.200393 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 9693
I20260808 04:44:15.200544 10269 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e0c4faa33c04814a011cb4ca0924ed1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:44:15 UTC) from {username='slave'} at 127.0.0.1:35324
I20260808 04:44:15.220064 10056 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e0c4faa33c04814a011cb4ca0924ed1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:44:15 UTC) from {username='slave'} at 127.0.0.1:55584
I20260808 04:44:15.221136 10479 tablet_replica.cc:330] T 2e0c4faa33c04814a011cb4ca0924ed1 P e1424b7eed8241dc830423a1d1c64d00: stopping tablet replica
I20260808 04:44:15.221161 10478 tablet_replica.cc:330] T 2e0c4faa33c04814a011cb4ca0924ed1 P 7282f870bd6b401abbe43d9712f99513: stopping tablet replica
I20260808 04:44:15.221556 10478 raft_consensus.cc:2229] T 2e0c4faa33c04814a011cb4ca0924ed1 P 7282f870bd6b401abbe43d9712f99513 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:44:15.221580 10479 raft_consensus.cc:2229] T 2e0c4faa33c04814a011cb4ca0924ed1 P e1424b7eed8241dc830423a1d1c64d00 [term 1 LEADER]: Raft consensus shutting down.
I20260808 04:44:15.222016 10478 raft_consensus.cc:2258] T 2e0c4faa33c04814a011cb4ca0924ed1 P 7282f870bd6b401abbe43d9712f99513 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:44:15.222397 10479 raft_consensus.cc:2258] T 2e0c4faa33c04814a011cb4ca0924ed1 P e1424b7eed8241dc830423a1d1c64d00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:44:15.223789 10478 ts_tablet_manager.cc:1905] T 2e0c4faa33c04814a011cb4ca0924ed1 P 7282f870bd6b401abbe43d9712f99513: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:44:15.223820 10479 ts_tablet_manager.cc:1905] T 2e0c4faa33c04814a011cb4ca0924ed1 P e1424b7eed8241dc830423a1d1c64d00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:44:15.226670 10478 ts_tablet_manager.cc:1918] T 2e0c4faa33c04814a011cb4ca0924ed1 P 7282f870bd6b401abbe43d9712f99513: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:44:15.226670 10479 ts_tablet_manager.cc:1918] T 2e0c4faa33c04814a011cb4ca0924ed1 P e1424b7eed8241dc830423a1d1c64d00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:44:15.226774 10478 log.cc:1196] T 2e0c4faa33c04814a011cb4ca0924ed1 P 7282f870bd6b401abbe43d9712f99513: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-2/wal/wals/2e0c4faa33c04814a011cb4ca0924ed1
I20260808 04:44:15.226909 10479 log.cc:1196] T 2e0c4faa33c04814a011cb4ca0924ed1 P e1424b7eed8241dc830423a1d1c64d00: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786164004017495-12881-0/minicluster-data/ts-1/wal/wals/2e0c4faa33c04814a011cb4ca0924ed1
I20260808 04:44:15.227097 10478 ts_tablet_manager.cc:1939] T 2e0c4faa33c04814a011cb4ca0924ed1 P 7282f870bd6b401abbe43d9712f99513: Deleting consensus metadata
I20260808 04:44:15.227339 10479 ts_tablet_manager.cc:1939] T 2e0c4faa33c04814a011cb4ca0924ed1 P e1424b7eed8241dc830423a1d1c64d00: Deleting consensus metadata
W20260808 04:44:15.228259 9559 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.148.65:34605 (error 108)
I20260808 04:44:15.228551 9561 catalog_manager.cc:4841] TS 7282f870bd6b401abbe43d9712f99513 (127.12.148.67:42765): tablet 2e0c4faa33c04814a011cb4ca0924ed1 (table test-table [id=6106b8c638444d6386bae591d3ce639f]) successfully deleted
I20260808 04:44:15.228907 9559 catalog_manager.cc:4841] TS e1424b7eed8241dc830423a1d1c64d00 (127.12.148.66:44855): tablet 2e0c4faa33c04814a011cb4ca0924ed1 (table test-table [id=6106b8c638444d6386bae591d3ce639f]) successfully deleted
I20260808 04:44:15.229148 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 9940
I20260808 04:44:15.238070 10420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:15.229214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:34605 (local address 127.0.0.1:56990)
0808 04:44:15.237831 (+ 8617us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:15.237955 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.65:34605: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":5140}
W20260808 04:44:15.238353 9559 catalog_manager.cc:4584] TS ef91a77512a5482281c1c9c7e217b3fb (127.12.148.65:34605): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2e0c4faa33c04814a011cb4ca0924ed1: Network error: Client connection negotiation failed: client connection to 127.12.148.65:34605: connect: Connection refused (error 111)
I20260808 04:44:15.243314 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 10173
I20260808 04:44:15.255517 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 9530
2026-08-08T04:44:15Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1054 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:15 dist-test-slave-t7g5 krb5kdc[10485](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:15 dist-test-slave-t7g5 krb5kdc[10485](info): set up 2 sockets
Aug 08 04:44:15 dist-test-slave-t7g5 krb5kdc[10485](info): commencing operation
krb5kdc: starting...
W20260808 04:44:16.408547 12881 mini_kdc.cc:121] Time spent starting KDC: real 1.123s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Aug 08 04:44:16 dist-test-slave-t7g5 krb5kdc[10485](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164256, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.148.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
I20260808 04:44:16.536908 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:44507
--webserver_interface=127.12.148.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:39019
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:44507
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:16.649538 10512 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:16.649866 10512 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:16.649909 10512 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:16.653966 10512 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:16.654032 10512 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:16.654050 10512 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:16.654066 10512 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:16.654079 10512 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:16.659376 10512 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:39019
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:44507
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:44507
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10512
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:16.660424 10512 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:16.661409 10512 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:16.669925 10520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:16.669943 10521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:16.670095 10512 server_base.cc:1034] running on GCE node
W20260808 04:44:16.669998 10524 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:16.670804 10512 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:16.671952 10512 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:16.673120 10512 hybrid_clock.cc:648] HybridClock initialized: now 1786164256673092 us; error 37 us; skew 500 ppm
Aug 08 04:44:16 dist-test-slave-t7g5 krb5kdc[10485](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164256, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:16.675853 10512 init.cc:377] Logged in from keytab as kudu/127.12.148.126@KRBTEST.COM (short username kudu)
I20260808 04:44:16.676707 10512 webserver.cc:460] Webserver started at http://127.12.148.126:42663/ using document root <none> and password file <none>
I20260808 04:44:16.677232 10512 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:16.677289 10512 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:16.677460 10512 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:16.679535 10512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "61815d639912467198b0904daecff3a3"
format_stamp: "Formatted at 2026-08-08 04:44:16 on dist-test-slave-t7g5"
server_key: "24e3e9a7f0039cba50a380f91df325b8"
server_key_iv: "e547a6cb95fb5ebdb7256c52b4c30fcb"
server_key_version: "encryptionkey@0"
I20260808 04:44:16.680063 10512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "61815d639912467198b0904daecff3a3"
format_stamp: "Formatted at 2026-08-08 04:44:16 on dist-test-slave-t7g5"
server_key: "24e3e9a7f0039cba50a380f91df325b8"
server_key_iv: "e547a6cb95fb5ebdb7256c52b4c30fcb"
server_key_version: "encryptionkey@0"
I20260808 04:44:16.683807 10512 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 04:44:16.686259 10535 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:16.687500 10512 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:44:16.687614 10512 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "61815d639912467198b0904daecff3a3"
format_stamp: "Formatted at 2026-08-08 04:44:16 on dist-test-slave-t7g5"
server_key: "24e3e9a7f0039cba50a380f91df325b8"
server_key_iv: "e547a6cb95fb5ebdb7256c52b4c30fcb"
server_key_version: "encryptionkey@0"
I20260808 04:44:16.687713 10512 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:16.708128 10512 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:16.711383 10512 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:16.711553 10512 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:16.718879 10512 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:44507
I20260808 04:44:16.718899 10618 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:44507 every 8 connection(s)
I20260808 04:44:16.720062 10512 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:16.722990 10621 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:16.723214 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 10512
I20260808 04:44:16.723344 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:44:16.723662 12881 external_mini_cluster.cc:1428] Setting key 0ec9c38dda29b6907a89aad337d90f92
I20260808 04:44:16.730026 10621 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61815d639912467198b0904daecff3a3: Bootstrap starting.
I20260808 04:44:16.732283 10621 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 61815d639912467198b0904daecff3a3: Neither blocks nor log segments found. Creating new log.
Aug 08 04:44:16 dist-test-slave-t7g5 krb5kdc[10485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164256, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:44:16.733065 10621 log.cc:824] T 00000000000000000000000000000000 P 61815d639912467198b0904daecff3a3: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:16.735579 10621 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61815d639912467198b0904daecff3a3: No bootstrap required, opened a new log
I20260808 04:44:16.738735 10626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:16.725211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55332 (local address 127.12.148.126:44507)
0808 04:44:16.725733 (+ 522us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:16.725749 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:16.725786 (+ 37us) server_negotiation.cc:407] Connection header received
0808 04:44:16.726645 (+ 859us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:16.726665 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:16.727011 (+ 346us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:16.727336 (+ 325us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:16.728188 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:16.729205 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:16.730147 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:16.730663 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:16.730814 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:16.733317 (+ 2503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:16.733324 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:16.733342 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:16.733373 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:16.735421 (+ 2048us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:16.735932 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:16.735939 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:16.735945 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:16.736095 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:16.736358 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:16.736361 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:16.736363 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:16.736895 (+ 532us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:16.737106 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:16.737340 (+ 234us) server_negotiation.cc:299] Negotiation successful
0808 04:44:16.737697 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":158,"threads_started":1}
I20260808 04:44:16.740232 10621 raft_consensus.cc:348] T 00000000000000000000000000000000 P 61815d639912467198b0904daecff3a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61815d639912467198b0904daecff3a3" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 44507 } }
I20260808 04:44:16.740463 10621 raft_consensus.cc:374] T 00000000000000000000000000000000 P 61815d639912467198b0904daecff3a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:16.740499 10621 raft_consensus.cc:729] T 00000000000000000000000000000000 P 61815d639912467198b0904daecff3a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61815d639912467198b0904daecff3a3, State: Initialized, Role: FOLLOWER
I20260808 04:44:16.740952 10621 consensus_queue.cc:260] T 00000000000000000000000000000000 P 61815d639912467198b0904daecff3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61815d639912467198b0904daecff3a3" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 44507 } }
I20260808 04:44:16.741127 10621 raft_consensus.cc:388] T 00000000000000000000000000000000 P 61815d639912467198b0904daecff3a3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:16.741195 10621 raft_consensus.cc:482] T 00000000000000000000000000000000 P 61815d639912467198b0904daecff3a3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:16.741293 10621 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 61815d639912467198b0904daecff3a3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:16.742314 10621 raft_consensus.cc:504] T 00000000000000000000000000000000 P 61815d639912467198b0904daecff3a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61815d639912467198b0904daecff3a3" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 44507 } }
I20260808 04:44:16.742655 10621 leader_election.cc:302] T 00000000000000000000000000000000 P 61815d639912467198b0904daecff3a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 61815d639912467198b0904daecff3a3; no voters:
I20260808 04:44:16.742975 10621 leader_election.cc:288] T 00000000000000000000000000000000 P 61815d639912467198b0904daecff3a3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:16.743105 10634 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 61815d639912467198b0904daecff3a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:16.743350 10634 raft_consensus.cc:686] T 00000000000000000000000000000000 P 61815d639912467198b0904daecff3a3 [term 1 LEADER]: Becoming Leader. State: Replica: 61815d639912467198b0904daecff3a3, State: Running, Role: LEADER
I20260808 04:44:16.743654 10634 consensus_queue.cc:237] T 00000000000000000000000000000000 P 61815d639912467198b0904daecff3a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61815d639912467198b0904daecff3a3" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 44507 } }
I20260808 04:44:16.744177 10621 sys_catalog.cc:564] T 00000000000000000000000000000000 P 61815d639912467198b0904daecff3a3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:16.745333 10637 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61815d639912467198b0904daecff3a3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 61815d639912467198b0904daecff3a3. Latest consensus state: current_term: 1 leader_uuid: "61815d639912467198b0904daecff3a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61815d639912467198b0904daecff3a3" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 44507 } } }
I20260808 04:44:16.745467 10637 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61815d639912467198b0904daecff3a3 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:16.745795 10636 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61815d639912467198b0904daecff3a3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "61815d639912467198b0904daecff3a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61815d639912467198b0904daecff3a3" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 44507 } } }
I20260808 04:44:16.745889 10636 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61815d639912467198b0904daecff3a3 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:16.746197 10655 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:16.750015 10655 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:16.756065 10655 catalog_manager.cc:1347] Generated new cluster ID: e44eedec238c40a392b80bcda5ff0797
I20260808 04:44:16.756155 10655 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:16.773955 10655 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:16.775520 10655 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:16.792423 10655 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 61815d639912467198b0904daecff3a3: Generated new TSK 0
I20260808 04:44:16.793206 10655 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.148.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab.
Entry for principal kudu/127.12.148.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab.
I20260808 04:44:16.828869 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.65:0
--local_ip_for_outbound_sockets=127.12.148.65
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:44507
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:39019
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:16.944660 10671 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:16.944979 10671 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:16.945046 10671 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:16.949251 10671 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:16.949334 10671 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:16.949415 10671 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.65
I20260808 04:44:16.954823 10671 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:39019
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.65.keytab
--principal=kudu/127.12.148.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:44507
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10671
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.65
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:16.955911 10671 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:16.956928 10671 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:16.966463 10680 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:16.966533 10671 server_base.cc:1034] running on GCE node
W20260808 04:44:16.966463 10682 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:16.966488 10685 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:16.967123 10671 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:16.967792 10671 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:16.968971 10671 hybrid_clock.cc:648] HybridClock initialized: now 1786164256968947 us; error 34 us; skew 500 ppm
Aug 08 04:44:16 dist-test-slave-t7g5 krb5kdc[10485](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164256, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:16.971683 10671 init.cc:377] Logged in from keytab as kudu/127.12.148.65@KRBTEST.COM (short username kudu)
I20260808 04:44:16.972553 10671 webserver.cc:460] Webserver started at http://127.12.148.65:39501/ using document root <none> and password file <none>
I20260808 04:44:16.973097 10671 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:16.973165 10671 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:16.973368 10671 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:16.975432 10671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-0/data/instance:
uuid: "391d0b7264af4d32ac265eae15357334"
format_stamp: "Formatted at 2026-08-08 04:44:16 on dist-test-slave-t7g5"
server_key: "827b3c074cc3f0abf2de7fb66d603d49"
server_key_iv: "3b8cedbe9b14e0f7f2b983465d50c24a"
server_key_version: "encryptionkey@0"
I20260808 04:44:16.975997 10671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance:
uuid: "391d0b7264af4d32ac265eae15357334"
format_stamp: "Formatted at 2026-08-08 04:44:16 on dist-test-slave-t7g5"
server_key: "827b3c074cc3f0abf2de7fb66d603d49"
server_key_iv: "3b8cedbe9b14e0f7f2b983465d50c24a"
server_key_version: "encryptionkey@0"
I20260808 04:44:16.979595 10671 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 04:44:16.982220 10693 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:16.983421 10671 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:44:16.983533 10671 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-0/wal
uuid: "391d0b7264af4d32ac265eae15357334"
format_stamp: "Formatted at 2026-08-08 04:44:16 on dist-test-slave-t7g5"
server_key: "827b3c074cc3f0abf2de7fb66d603d49"
server_key_iv: "3b8cedbe9b14e0f7f2b983465d50c24a"
server_key_version: "encryptionkey@0"
I20260808 04:44:16.983633 10671 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:16.996938 10671 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:16.999749 10671 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:16.999941 10671 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:17.000530 10671 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:44:17.001362 10671 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:44:17.001412 10671 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:17.001466 10671 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:44:17.001493 10671 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:17.009886 10671 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.65:38873
I20260808 04:44:17.009913 10903 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.65:38873 every 8 connection(s)
I20260808 04:44:17.010767 10671 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
I20260808 04:44:17.016793 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 10671
I20260808 04:44:17.016921 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance
I20260808 04:44:17.017208 12881 external_mini_cluster.cc:1428] Setting key a851162d66e9da81d8f4559c474a1763
Aug 08 04:44:17 dist-test-slave-t7g5 krb5kdc[10485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164256, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.65@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:44:17.024501 10626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:17.012499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:58831 (local address 127.12.148.126:44507)
0808 04:44:17.012661 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:17.012665 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:17.013479 (+ 814us) server_negotiation.cc:407] Connection header received
0808 04:44:17.014829 (+ 1350us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:17.014832 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:17.014882 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:17.014954 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:17.016143 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:17.016698 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:17.018028 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:17.018287 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:17.018393 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:17.021074 (+ 2681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:17.021077 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:17.021079 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:17.021104 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:17.022515 (+ 1411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:17.022986 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:17.022990 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:17.022991 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:17.023075 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:17.023388 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:17.023392 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:17.023394 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:17.023582 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:17.023668 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:17.024199 (+ 531us) server_negotiation.cc:299] Negotiation successful
0808 04:44:17.024329 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":60}
I20260808 04:44:17.025311 10909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:17.012886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:44507 (local address 127.12.148.65:58831)
0808 04:44:17.013332 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:17.013378 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:17.014626 (+ 1248us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:17.015121 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:17.015127 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:17.015494 (+ 367us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:17.015996 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:17.016010 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:17.016833 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:17.016836 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:17.017926 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:17.017937 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:17.018558 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:17.018561 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:17.018707 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:17.019282 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:17.019297 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:17.020913 (+ 1616us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:17.022622 (+ 1709us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:17.022626 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:17.022638 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:17.022887 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:17.023161 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:17.023164 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:17.023165 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:17.023300 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:17.023683 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:17.023690 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:17.023944 (+ 254us) client_negotiation.cc:769] Sending connection context
0808 04:44:17.024143 (+ 199us) client_negotiation.cc:240] Negotiation successful
0808 04:44:17.024500 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":120,"threads_started":1}
I20260808 04:44:17.026852 10905 heartbeater.cc:347] Connected to a master server at 127.12.148.126:44507
I20260808 04:44:17.027243 10905 heartbeater.cc:464] Registering TS with master...
I20260808 04:44:17.027794 10905 heartbeater.cc:511] Master 127.12.148.126:44507 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.12.148.66@KRBTEST.COM; defaulting to no policy
I20260808 04:44:17.029374 10561 ts_manager.cc:194] Registered new tserver with Master: 391d0b7264af4d32ac265eae15357334 (127.12.148.65:38873)
I20260808 04:44:17.030535 10561 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.65@KRBTEST.COM'} at 127.12.148.65:58831
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab.
Entry for principal kudu/127.12.148.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab.
I20260808 04:44:17.046485 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.66:0
--local_ip_for_outbound_sockets=127.12.148.66
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:44507
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:39019
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:17.159417 10913 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:17.159688 10913 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:17.159729 10913 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:17.163698 10913 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:17.163753 10913 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:17.163811 10913 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.66
I20260808 04:44:17.169257 10913 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:39019
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.66.keytab
--principal=kudu/127.12.148.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:44507
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10913
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.66
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:17.170271 10913 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:17.171229 10913 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:17.180725 10919 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:17.180840 10913 server_base.cc:1034] running on GCE node
W20260808 04:44:17.180761 10920 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:17.180765 10925 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:17.181411 10913 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:17.182097 10913 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:17.183252 10913 hybrid_clock.cc:648] HybridClock initialized: now 1786164257183224 us; error 40 us; skew 500 ppm
Aug 08 04:44:17 dist-test-slave-t7g5 krb5kdc[10485](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164257, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:17.185974 10913 init.cc:377] Logged in from keytab as kudu/127.12.148.66@KRBTEST.COM (short username kudu)
I20260808 04:44:17.186882 10913 webserver.cc:460] Webserver started at http://127.12.148.66:36209/ using document root <none> and password file <none>
I20260808 04:44:17.187426 10913 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:17.187527 10913 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:17.187739 10913 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:17.189878 10913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-1/data/instance:
uuid: "4f89ebf8814945fab17532582e395ed6"
format_stamp: "Formatted at 2026-08-08 04:44:17 on dist-test-slave-t7g5"
server_key: "903cc1b89d75b5864f276122c991c051"
server_key_iv: "8392fb000c36e74a962c646a40e5bc9f"
server_key_version: "encryptionkey@0"
I20260808 04:44:17.190438 10913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance:
uuid: "4f89ebf8814945fab17532582e395ed6"
format_stamp: "Formatted at 2026-08-08 04:44:17 on dist-test-slave-t7g5"
server_key: "903cc1b89d75b5864f276122c991c051"
server_key_iv: "8392fb000c36e74a962c646a40e5bc9f"
server_key_version: "encryptionkey@0"
I20260808 04:44:17.194314 10913 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 04:44:17.196775 10936 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:17.198120 10913 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260808 04:44:17.198233 10913 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-1/wal
uuid: "4f89ebf8814945fab17532582e395ed6"
format_stamp: "Formatted at 2026-08-08 04:44:17 on dist-test-slave-t7g5"
server_key: "903cc1b89d75b5864f276122c991c051"
server_key_iv: "8392fb000c36e74a962c646a40e5bc9f"
server_key_version: "encryptionkey@0"
I20260808 04:44:17.198343 10913 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:17.210032 10913 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:17.212886 10913 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:17.213057 10913 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:17.213689 10913 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:44:17.214540 10913 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:44:17.214589 10913 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:17.214640 10913 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:44:17.214668 10913 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:17.223165 10913 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.66:43353
I20260808 04:44:17.223196 11139 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.66:43353 every 8 connection(s)
I20260808 04:44:17.224092 10913 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
Aug 08 04:44:17 dist-test-slave-t7g5 krb5kdc[10485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164257, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.66@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:44:17.233644 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 10913
I20260808 04:44:17.233800 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance
I20260808 04:44:17.234126 12881 external_mini_cluster.cc:1428] Setting key ba16eb92b75f9fac650d4b08e3bbea7b
I20260808 04:44:17.237115 10626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:17.225842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:39401 (local address 127.12.148.126:44507)
0808 04:44:17.225977 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:17.225981 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:17.226830 (+ 849us) server_negotiation.cc:407] Connection header received
0808 04:44:17.228096 (+ 1266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:17.228099 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:17.228146 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:17.228216 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:17.229308 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:17.229888 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:17.230981 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:17.231193 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:17.231258 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:17.233537 (+ 2279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:17.233541 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:17.233544 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:17.233574 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:17.235061 (+ 1487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:17.235582 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:17.235586 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:17.235588 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:17.235682 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:17.236075 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:17.236077 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:17.236078 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:17.236246 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:17.236317 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:17.236892 (+ 575us) server_negotiation.cc:299] Negotiation successful
0808 04:44:17.237000 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 04:44:17.238229 11144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:17.226234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:44507 (local address 127.12.148.66:39401)
0808 04:44:17.226675 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:17.226718 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:17.227903 (+ 1185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:17.228350 (+ 447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:17.228356 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:17.228716 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:17.229191 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:17.229204 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:17.229998 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:17.230001 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:17.230884 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:17.230893 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:17.231300 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:17.231302 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:17.231451 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:17.231964 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:17.231980 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:17.233369 (+ 1389us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:17.235164 (+ 1795us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:17.235169 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:17.235180 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:17.235488 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:17.235778 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:17.235782 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:17.235784 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:17.235990 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:17.236339 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:17.236345 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:17.236663 (+ 318us) client_negotiation.cc:769] Sending connection context
0808 04:44:17.236859 (+ 196us) client_negotiation.cc:240] Negotiation successful
0808 04:44:17.237185 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":119,"threads_started":1}
I20260808 04:44:17.239390 11141 heartbeater.cc:347] Connected to a master server at 127.12.148.126:44507
I20260808 04:44:17.239614 11141 heartbeater.cc:464] Registering TS with master...
I20260808 04:44:17.240064 11141 heartbeater.cc:511] Master 127.12.148.126:44507 requested a full tablet report, sending...
I20260808 04:44:17.241071 10561 ts_manager.cc:194] Registered new tserver with Master: 4f89ebf8814945fab17532582e395ed6 (127.12.148.66:43353)
I20260808 04:44:17.241626 10561 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.66@KRBTEST.COM'} at 127.12.148.66:39401
WARNING: no policy specified for kudu/127.12.148.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab.
Entry for principal kudu/127.12.148.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab.
I20260808 04:44:17.262375 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.67:0
--local_ip_for_outbound_sockets=127.12.148.67
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:44507
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:39019
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:17.376577 11149 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:17.376847 11149 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:17.376904 11149 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:17.380858 11149 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:17.380921 11149 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:17.380999 11149 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.67
I20260808 04:44:17.386202 11149 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:39019
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.67.keytab
--principal=kudu/127.12.148.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:44507
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11149
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.67
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:17.387243 11149 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:17.388269 11149 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:17.397918 11162 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:17.398422 11157 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:17.397914 11159 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:17.398890 11149 server_base.cc:1034] running on GCE node
I20260808 04:44:17.399307 11149 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:17.400039 11149 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:17.401196 11149 hybrid_clock.cc:648] HybridClock initialized: now 1786164257401163 us; error 45 us; skew 500 ppm
Aug 08 04:44:17 dist-test-slave-t7g5 krb5kdc[10485](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164257, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:17.403898 11149 init.cc:377] Logged in from keytab as kudu/127.12.148.67@KRBTEST.COM (short username kudu)
I20260808 04:44:17.404772 11149 webserver.cc:460] Webserver started at http://127.12.148.67:38549/ using document root <none> and password file <none>
I20260808 04:44:17.405308 11149 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:17.405376 11149 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:17.405588 11149 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:17.407641 11149 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-2/data/instance:
uuid: "e7b1db8abb414e60b312d18023edaf7d"
format_stamp: "Formatted at 2026-08-08 04:44:17 on dist-test-slave-t7g5"
server_key: "99e9ea8bc1656ce502884367c913d8cd"
server_key_iv: "c166fcdcd870135e0981897888a252bb"
server_key_version: "encryptionkey@0"
I20260808 04:44:17.408177 11149 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance:
uuid: "e7b1db8abb414e60b312d18023edaf7d"
format_stamp: "Formatted at 2026-08-08 04:44:17 on dist-test-slave-t7g5"
server_key: "99e9ea8bc1656ce502884367c913d8cd"
server_key_iv: "c166fcdcd870135e0981897888a252bb"
server_key_version: "encryptionkey@0"
I20260808 04:44:17.411969 11149 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 04:44:17.414366 11174 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:17.415571 11149 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 04:44:17.415679 11149 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-2/wal
uuid: "e7b1db8abb414e60b312d18023edaf7d"
format_stamp: "Formatted at 2026-08-08 04:44:17 on dist-test-slave-t7g5"
server_key: "99e9ea8bc1656ce502884367c913d8cd"
server_key_iv: "c166fcdcd870135e0981897888a252bb"
server_key_version: "encryptionkey@0"
I20260808 04:44:17.415777 11149 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:17.437140 11149 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:17.440064 11149 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:17.440251 11149 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:17.440843 11149 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:44:17.441746 11149 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:44:17.441800 11149 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:17.441856 11149 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:44:17.441881 11149 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:17.450862 11149 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.67:40595
I20260808 04:44:17.450888 11347 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.67:40595 every 8 connection(s)
I20260808 04:44:17.451756 11149 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
I20260808 04:44:17.459281 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 11149
I20260808 04:44:17.459426 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance
I20260808 04:44:17.459722 12881 external_mini_cluster.cc:1428] Setting key b3c3c0a1eb4f46cf28a2694de339f2e7
Aug 08 04:44:17 dist-test-slave-t7g5 krb5kdc[10485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164257, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.67@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:44:17.464753 10626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:17.453513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:54811 (local address 127.12.148.126:44507)
0808 04:44:17.453687 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:17.453692 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:17.454540 (+ 848us) server_negotiation.cc:407] Connection header received
0808 04:44:17.455802 (+ 1262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:17.455804 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:17.455852 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:17.455925 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:17.457053 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:17.457584 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:17.458686 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:17.458908 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:17.458995 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:17.461750 (+ 2755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:17.461754 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:17.461757 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:17.461788 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:17.462970 (+ 1182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:17.463430 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:17.463433 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:17.463434 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:17.463504 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:17.463769 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:17.463771 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:17.463772 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:17.463999 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:17.464101 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:17.464524 (+ 423us) server_negotiation.cc:299] Negotiation successful
0808 04:44:17.464630 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 04:44:17.465603 11354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:17.453910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:44507 (local address 127.12.148.67:54811)
0808 04:44:17.454371 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:17.454415 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:17.455608 (+ 1193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:17.456081 (+ 473us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:17.456087 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:17.456454 (+ 367us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:17.456935 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:17.456949 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:17.457698 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:17.457701 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:17.458585 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:17.458594 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:17.459072 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:17.459076 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:17.459276 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:17.459912 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:17.459933 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:17.461569 (+ 1636us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:17.463071 (+ 1502us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:17.463077 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:17.463090 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:17.463351 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:17.463565 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:17.463567 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:17.463568 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:17.463702 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:17.464086 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:17.464090 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:17.464326 (+ 236us) client_negotiation.cc:769] Sending connection context
0808 04:44:17.464472 (+ 146us) client_negotiation.cc:240] Negotiation successful
0808 04:44:17.464732 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":124,"threads_started":1}
I20260808 04:44:17.466802 11349 heartbeater.cc:347] Connected to a master server at 127.12.148.126:44507
I20260808 04:44:17.467067 11349 heartbeater.cc:464] Registering TS with master...
I20260808 04:44:17.467593 11349 heartbeater.cc:511] Master 127.12.148.126:44507 requested a full tablet report, sending...
I20260808 04:44:17.468613 10561 ts_manager.cc:194] Registered new tserver with Master: e7b1db8abb414e60b312d18023edaf7d (127.12.148.67:40595)
I20260808 04:44:17.469175 10561 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.148.67@KRBTEST.COM'} at 127.12.148.67:54811
I20260808 04:44:17.473779 12881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 04:44:17.482995 10626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:17.475738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55338 (local address 127.12.148.126:44507)
0808 04:44:17.475894 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:17.475899 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:17.476068 (+ 169us) server_negotiation.cc:407] Connection header received
0808 04:44:17.476168 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:17.476170 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:17.476216 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:17.476288 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:17.476956 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:17.477475 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:17.478298 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:17.478516 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:17.478600 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:17.479820 (+ 1220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:17.479823 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:17.479825 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:17.479849 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:17.481283 (+ 1434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:17.481669 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:17.481674 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:17.481676 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:17.481801 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:17.482114 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:17.482118 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:17.482119 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:17.482353 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:17.482477 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:17.482719 (+ 242us) server_negotiation.cc:299] Negotiation successful
0808 04:44:17.482840 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 04:44:17.486029 10561 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55338:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:44:17.489009 10561 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:44:17.502768 11366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:17.497223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55594 (local address 127.12.148.67:40595)
0808 04:44:17.497514 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:17.497526 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:17.497548 (+ 22us) server_negotiation.cc:407] Connection header received
0808 04:44:17.497792 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:17.497799 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:17.498029 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:17.498201 (+ 172us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:17.498703 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:17.499620 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:17.501257 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:17.502040 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:17.502140 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:17.502299 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:17.502459 (+ 160us) server_negotiation.cc:299] Negotiation successful
0808 04:44:17.502617 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":100,"threads_started":1}
I20260808 04:44:17.502838 11365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:17.497076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.67:40595 (local address 127.0.0.1:55594)
0808 04:44:17.497423 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:17.497481 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:17.497605 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:17.498397 (+ 792us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:17.498404 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:17.498430 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:17.498561 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:17.498570 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:17.499760 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:17.499763 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:17.501125 (+ 1362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:17.501135 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:17.502153 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:17.502156 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:17.502275 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:17.502314 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 04:44:17.502418 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 04:44:17.502604 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":82,"threads_started":1}
I20260808 04:44:17.503640 11367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:17.498223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:38873 (local address 127.0.0.1:44574)
0808 04:44:17.498634 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:17.498645 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:17.498713 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:17.499313 (+ 600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:17.499316 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:17.499336 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:17.499431 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:17.499437 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:17.500852 (+ 1415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:17.500856 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:17.502151 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:17.502162 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:17.503274 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:17.503277 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:17.503355 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:17.503380 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 04:44:17.503443 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 04:44:17.503511 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":360,"mutex_wait_us":22,"thread_start_us":80,"threads_started":1}
I20260808 04:44:17.503731 11373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:17.498620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44574 (local address 127.12.148.65:38873)
0808 04:44:17.498926 (+ 306us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:17.498939 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:17.498969 (+ 30us) server_negotiation.cc:407] Connection header received
0808 04:44:17.499035 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:17.499039 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:17.499176 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:17.499321 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:17.499545 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:17.500693 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:17.502293 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:17.503157 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:17.503273 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:17.503424 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:17.503491 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 04:44:17.503584 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":214,"thread_start_us":91,"threads_started":1}
I20260808 04:44:17.504626 11372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:17.497858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:43353 (local address 127.0.0.1:46734)
0808 04:44:17.498513 (+ 655us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:17.498527 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:17.498614 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:17.499485 (+ 871us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:17.499488 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:17.499508 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:17.499619 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:17.499626 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:17.500652 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:17.500655 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:17.502151 (+ 1496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:17.502162 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:17.504236 (+ 2074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:17.504240 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:17.504342 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:17.504366 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 04:44:17.504445 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 04:44:17.504506 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":576,"mutex_wait_us":293,"thread_start_us":119,"threads_started":1}
I20260808 04:44:17.505031 11369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:17.498037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46734 (local address 127.12.148.66:43353)
0808 04:44:17.498861 (+ 824us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:17.498874 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:17.498897 (+ 23us) server_negotiation.cc:407] Connection header received
0808 04:44:17.498972 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:17.498977 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:17.499166 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:17.499321 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:17.499742 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:17.500505 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:17.502292 (+ 1787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:17.503736 (+ 1444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:17.504241 (+ 505us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:17.504377 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:17.504796 (+ 419us) server_negotiation.cc:299] Negotiation successful
0808 04:44:17.504905 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":720,"thread_start_us":136,"threads_started":1}
I20260808 04:44:17.506520 11248 tablet_service.cc:1467] Processing CreateTablet for tablet 45d7d34e8b9e454fbbbc6079faf2c6e8 (DEFAULT_TABLE table=test-table [id=579aeea547f841c7b84841f474ffdc36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:44:17.506721 10787 tablet_service.cc:1467] Processing CreateTablet for tablet 45d7d34e8b9e454fbbbc6079faf2c6e8 (DEFAULT_TABLE table=test-table [id=579aeea547f841c7b84841f474ffdc36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:44:17.507431 11248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45d7d34e8b9e454fbbbc6079faf2c6e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:17.507792 10787 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45d7d34e8b9e454fbbbc6079faf2c6e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:17.507578 11028 tablet_service.cc:1467] Processing CreateTablet for tablet 45d7d34e8b9e454fbbbc6079faf2c6e8 (DEFAULT_TABLE table=test-table [id=579aeea547f841c7b84841f474ffdc36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:44:17.508515 11028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45d7d34e8b9e454fbbbc6079faf2c6e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:17.514101 11375 tablet_bootstrap.cc:492] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P e7b1db8abb414e60b312d18023edaf7d: Bootstrap starting.
I20260808 04:44:17.514863 11376 tablet_bootstrap.cc:492] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 391d0b7264af4d32ac265eae15357334: Bootstrap starting.
I20260808 04:44:17.515908 11379 tablet_bootstrap.cc:492] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 4f89ebf8814945fab17532582e395ed6: Bootstrap starting.
I20260808 04:44:17.516388 11375 tablet_bootstrap.cc:654] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P e7b1db8abb414e60b312d18023edaf7d: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:17.517256 11376 tablet_bootstrap.cc:654] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 391d0b7264af4d32ac265eae15357334: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:17.517746 11379 tablet_bootstrap.cc:654] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 4f89ebf8814945fab17532582e395ed6: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:17.517763 11375 log.cc:824] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P e7b1db8abb414e60b312d18023edaf7d: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:17.518474 11376 log.cc:824] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 391d0b7264af4d32ac265eae15357334: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:17.518903 11379 log.cc:824] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 4f89ebf8814945fab17532582e395ed6: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:17.520013 11375 tablet_bootstrap.cc:492] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P e7b1db8abb414e60b312d18023edaf7d: No bootstrap required, opened a new log
I20260808 04:44:17.520218 11375 ts_tablet_manager.cc:1397] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P e7b1db8abb414e60b312d18023edaf7d: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260808 04:44:17.520783 11376 tablet_bootstrap.cc:492] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 391d0b7264af4d32ac265eae15357334: No bootstrap required, opened a new log
I20260808 04:44:17.520783 11379 tablet_bootstrap.cc:492] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 4f89ebf8814945fab17532582e395ed6: No bootstrap required, opened a new log
I20260808 04:44:17.520972 11379 ts_tablet_manager.cc:1397] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 4f89ebf8814945fab17532582e395ed6: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 04:44:17.520972 11376 ts_tablet_manager.cc:1397] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 391d0b7264af4d32ac265eae15357334: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.003s
I20260808 04:44:17.523281 11375 raft_consensus.cc:348] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P e7b1db8abb414e60b312d18023edaf7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7b1db8abb414e60b312d18023edaf7d" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 40595 } } peers { permanent_uuid: "4f89ebf8814945fab17532582e395ed6" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 43353 } } peers { permanent_uuid: "391d0b7264af4d32ac265eae15357334" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 38873 } }
I20260808 04:44:17.523523 11375 raft_consensus.cc:374] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P e7b1db8abb414e60b312d18023edaf7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:17.523579 11375 raft_consensus.cc:729] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P e7b1db8abb414e60b312d18023edaf7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7b1db8abb414e60b312d18023edaf7d, State: Initialized, Role: FOLLOWER
I20260808 04:44:17.524013 11375 consensus_queue.cc:260] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P e7b1db8abb414e60b312d18023edaf7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7b1db8abb414e60b312d18023edaf7d" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 40595 } } peers { permanent_uuid: "4f89ebf8814945fab17532582e395ed6" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 43353 } } peers { permanent_uuid: "391d0b7264af4d32ac265eae15357334" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 38873 } }
I20260808 04:44:17.524705 11349 heartbeater.cc:503] Master 127.12.148.126:44507 was elected leader, sending a full tablet report...
I20260808 04:44:17.524838 11376 raft_consensus.cc:348] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 391d0b7264af4d32ac265eae15357334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7b1db8abb414e60b312d18023edaf7d" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 40595 } } peers { permanent_uuid: "4f89ebf8814945fab17532582e395ed6" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 43353 } } peers { permanent_uuid: "391d0b7264af4d32ac265eae15357334" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 38873 } }
I20260808 04:44:17.524838 11379 raft_consensus.cc:348] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 4f89ebf8814945fab17532582e395ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7b1db8abb414e60b312d18023edaf7d" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 40595 } } peers { permanent_uuid: "4f89ebf8814945fab17532582e395ed6" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 43353 } } peers { permanent_uuid: "391d0b7264af4d32ac265eae15357334" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 38873 } }
I20260808 04:44:17.525071 11375 ts_tablet_manager.cc:1428] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P e7b1db8abb414e60b312d18023edaf7d: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260808 04:44:17.525084 11376 raft_consensus.cc:374] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 391d0b7264af4d32ac265eae15357334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:17.525084 11379 raft_consensus.cc:374] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 4f89ebf8814945fab17532582e395ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:17.525133 11379 raft_consensus.cc:729] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 4f89ebf8814945fab17532582e395ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f89ebf8814945fab17532582e395ed6, State: Initialized, Role: FOLLOWER
I20260808 04:44:17.525134 11376 raft_consensus.cc:729] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 391d0b7264af4d32ac265eae15357334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 391d0b7264af4d32ac265eae15357334, State: Initialized, Role: FOLLOWER
I20260808 04:44:17.525564 11376 consensus_queue.cc:260] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 391d0b7264af4d32ac265eae15357334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7b1db8abb414e60b312d18023edaf7d" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 40595 } } peers { permanent_uuid: "4f89ebf8814945fab17532582e395ed6" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 43353 } } peers { permanent_uuid: "391d0b7264af4d32ac265eae15357334" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 38873 } }
I20260808 04:44:17.525564 11379 consensus_queue.cc:260] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 4f89ebf8814945fab17532582e395ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7b1db8abb414e60b312d18023edaf7d" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 40595 } } peers { permanent_uuid: "4f89ebf8814945fab17532582e395ed6" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 43353 } } peers { permanent_uuid: "391d0b7264af4d32ac265eae15357334" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 38873 } }
I20260808 04:44:17.526264 10905 heartbeater.cc:503] Master 127.12.148.126:44507 was elected leader, sending a full tablet report...
I20260808 04:44:17.526598 11141 heartbeater.cc:503] Master 127.12.148.126:44507 was elected leader, sending a full tablet report...
I20260808 04:44:17.526754 11379 ts_tablet_manager.cc:1428] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 4f89ebf8814945fab17532582e395ed6: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260808 04:44:17.527534 11376 ts_tablet_manager.cc:1428] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 391d0b7264af4d32ac265eae15357334: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260808 04:44:17.528082 11390 raft_consensus.cc:482] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 4f89ebf8814945fab17532582e395ed6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:44:17.528219 11390 raft_consensus.cc:504] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 4f89ebf8814945fab17532582e395ed6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7b1db8abb414e60b312d18023edaf7d" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 40595 } } peers { permanent_uuid: "4f89ebf8814945fab17532582e395ed6" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 43353 } } peers { permanent_uuid: "391d0b7264af4d32ac265eae15357334" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 38873 } }
I20260808 04:44:17.530112 11390 leader_election.cc:288] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 4f89ebf8814945fab17532582e395ed6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7b1db8abb414e60b312d18023edaf7d (127.12.148.67:40595), 391d0b7264af4d32ac265eae15357334 (127.12.148.65:38873)
I20260808 04:44:17.533567 11144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:17.529533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.67:40595 (local address 127.12.148.66:47311)
0808 04:44:17.529644 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:17.529679 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:17.529768 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:17.530520 (+ 752us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:17.530523 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:17.530564 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:17.530674 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:17.530680 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:17.531581 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:17.531584 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:17.532466 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:17.532476 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:17.533156 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:17.533160 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:17.533262 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:17.533284 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 04:44:17.533354 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 04:44:17.533426 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36,"mutex_wait_us":28,"spinlock_wait_cycles":1664}
I20260808 04:44:17.533563 11373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:17.530098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:42815 (local address 127.12.148.65:38873)
0808 04:44:17.530356 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:17.530361 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:17.530479 (+ 118us) server_negotiation.cc:407] Connection header received
0808 04:44:17.530652 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:17.530656 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:17.530700 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:17.530765 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:17.531024 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:17.531647 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:17.532725 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:17.533105 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:17.533214 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:17.533273 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:17.533403 (+ 130us) server_negotiation.cc:299] Negotiation successful
0808 04:44:17.533466 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180}
I20260808 04:44:17.533571 11366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:17.530068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:47311 (local address 127.12.148.67:40595)
0808 04:44:17.530176 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:17.530180 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:17.530193 (+ 13us) server_negotiation.cc:407] Connection header received
0808 04:44:17.530238 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:17.530241 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:17.530284 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:17.530349 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:17.530787 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:17.531502 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:17.532596 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:17.533044 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:17.533133 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:17.533179 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:17.533382 (+ 203us) server_negotiation.cc:299] Negotiation successful
0808 04:44:17.533451 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 04:44:17.533596 11392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:17.529898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:38873 (local address 127.12.148.66:42815)
0808 04:44:17.530405 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:17.530419 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:17.530568 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:17.530809 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:17.530811 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:17.530826 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:17.530927 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:17.530932 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:17.531743 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:17.531746 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:17.532607 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:17.532618 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:17.533221 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:17.533224 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:17.533298 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:17.533315 (+ 17us) client_negotiation.cc:769] Sending connection context
0808 04:44:17.533387 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 04:44:17.533461 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":449,"mutex_wait_us":26,"spinlock_wait_cycles":30848,"thread_start_us":98,"threads_started":1}
I20260808 04:44:17.534257 11279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45d7d34e8b9e454fbbbc6079faf2c6e8" candidate_uuid: "4f89ebf8814945fab17532582e395ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7b1db8abb414e60b312d18023edaf7d" is_pre_election: true
I20260808 04:44:17.534255 10828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45d7d34e8b9e454fbbbc6079faf2c6e8" candidate_uuid: "4f89ebf8814945fab17532582e395ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391d0b7264af4d32ac265eae15357334" is_pre_election: true
I20260808 04:44:17.534499 11279 raft_consensus.cc:2454] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P e7b1db8abb414e60b312d18023edaf7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f89ebf8814945fab17532582e395ed6 in term 0.
I20260808 04:44:17.534505 10828 raft_consensus.cc:2454] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 391d0b7264af4d32ac265eae15357334 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f89ebf8814945fab17532582e395ed6 in term 0.
I20260808 04:44:17.534914 10939 leader_election.cc:302] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 4f89ebf8814945fab17532582e395ed6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f89ebf8814945fab17532582e395ed6, e7b1db8abb414e60b312d18023edaf7d; no voters:
I20260808 04:44:17.535184 11390 raft_consensus.cc:2781] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 4f89ebf8814945fab17532582e395ed6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:44:17.535284 11390 raft_consensus.cc:482] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 4f89ebf8814945fab17532582e395ed6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:44:17.535336 11390 raft_consensus.cc:3037] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 4f89ebf8814945fab17532582e395ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:17.536351 11390 raft_consensus.cc:504] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 4f89ebf8814945fab17532582e395ed6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7b1db8abb414e60b312d18023edaf7d" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 40595 } } peers { permanent_uuid: "4f89ebf8814945fab17532582e395ed6" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 43353 } } peers { permanent_uuid: "391d0b7264af4d32ac265eae15357334" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 38873 } }
I20260808 04:44:17.536669 11390 leader_election.cc:288] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 4f89ebf8814945fab17532582e395ed6 [CANDIDATE]: Term 1 election: Requested vote from peers e7b1db8abb414e60b312d18023edaf7d (127.12.148.67:40595), 391d0b7264af4d32ac265eae15357334 (127.12.148.65:38873)
I20260808 04:44:17.536957 11279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45d7d34e8b9e454fbbbc6079faf2c6e8" candidate_uuid: "4f89ebf8814945fab17532582e395ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7b1db8abb414e60b312d18023edaf7d"
I20260808 04:44:17.537051 10828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45d7d34e8b9e454fbbbc6079faf2c6e8" candidate_uuid: "4f89ebf8814945fab17532582e395ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391d0b7264af4d32ac265eae15357334"
I20260808 04:44:17.537081 11279 raft_consensus.cc:3037] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P e7b1db8abb414e60b312d18023edaf7d [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:17.537168 10828 raft_consensus.cc:3037] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 391d0b7264af4d32ac265eae15357334 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:17.538143 11279 raft_consensus.cc:2454] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P e7b1db8abb414e60b312d18023edaf7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f89ebf8814945fab17532582e395ed6 in term 1.
I20260808 04:44:17.538250 10828 raft_consensus.cc:2454] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 391d0b7264af4d32ac265eae15357334 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f89ebf8814945fab17532582e395ed6 in term 1.
I20260808 04:44:17.538496 10939 leader_election.cc:302] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 4f89ebf8814945fab17532582e395ed6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f89ebf8814945fab17532582e395ed6, e7b1db8abb414e60b312d18023edaf7d; no voters:
I20260808 04:44:17.538663 11390 raft_consensus.cc:2781] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 4f89ebf8814945fab17532582e395ed6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:17.538796 11390 raft_consensus.cc:686] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 4f89ebf8814945fab17532582e395ed6 [term 1 LEADER]: Becoming Leader. State: Replica: 4f89ebf8814945fab17532582e395ed6, State: Running, Role: LEADER
I20260808 04:44:17.539094 11390 consensus_queue.cc:237] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 4f89ebf8814945fab17532582e395ed6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7b1db8abb414e60b312d18023edaf7d" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 40595 } } peers { permanent_uuid: "4f89ebf8814945fab17532582e395ed6" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 43353 } } peers { permanent_uuid: "391d0b7264af4d32ac265eae15357334" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 38873 } }
I20260808 04:44:17.542160 10561 catalog_manager.cc:5495] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 4f89ebf8814945fab17532582e395ed6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f89ebf8814945fab17532582e395ed6 (127.12.148.66). New cstate: current_term: 1 leader_uuid: "4f89ebf8814945fab17532582e395ed6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7b1db8abb414e60b312d18023edaf7d" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 40595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f89ebf8814945fab17532582e395ed6" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 43353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "391d0b7264af4d32ac265eae15357334" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 38873 } health_report { overall_health: UNKNOWN } } }
I20260808 04:44:17.555040 11369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:17.551626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46738 (local address 127.12.148.66:43353)
0808 04:44:17.551789 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:17.551794 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:17.551810 (+ 16us) server_negotiation.cc:407] Connection header received
0808 04:44:17.551898 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:17.551901 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:17.551956 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:17.552043 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:44:17.552331 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:17.552836 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:17.553696 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:17.553903 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:17.553976 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:17.554220 (+ 244us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:44:17.554700 (+ 480us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:44:17.554793 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:17.554873 (+ 80us) server_negotiation.cc:299] Negotiation successful
0808 04:44:17.554926 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 04:44:17.560875 11279 raft_consensus.cc:1261] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P e7b1db8abb414e60b312d18023edaf7d [term 1 FOLLOWER]: Refusing update from remote peer 4f89ebf8814945fab17532582e395ed6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:44:17.560876 10828 raft_consensus.cc:1261] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 391d0b7264af4d32ac265eae15357334 [term 1 FOLLOWER]: Refusing update from remote peer 4f89ebf8814945fab17532582e395ed6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:44:17.561582 11390 consensus_queue.cc:1035] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 4f89ebf8814945fab17532582e395ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7b1db8abb414e60b312d18023edaf7d" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 40595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:44:17.561838 11389 consensus_queue.cc:1035] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 4f89ebf8814945fab17532582e395ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "391d0b7264af4d32ac265eae15357334" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 38873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:44:17.568761 11397 mvcc.cc:205] Tried to move back new op lower bound from 7316128798961844224 to 7316128798882430976. Current Snapshot: MvccSnapshot[applied={T|T < 7316128798961844224}]
I20260808 04:44:17.570719 11399 mvcc.cc:205] Tried to move back new op lower bound from 7316128798961844224 to 7316128798882430976. Current Snapshot: MvccSnapshot[applied={T|T < 7316128798961844224}]
I20260808 04:44:17.570928 11401 mvcc.cc:205] Tried to move back new op lower bound from 7316128798961844224 to 7316128798882430976. Current Snapshot: MvccSnapshot[applied={T|T < 7316128798961844224}]
I20260808 04:44:17.577827 10561 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55338:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:44:17.578014 10561 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55338:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:44:17.580370 10561 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 61815d639912467198b0904daecff3a3: Sending DeleteTablet for 3 replicas of tablet 45d7d34e8b9e454fbbbc6079faf2c6e8
I20260808 04:44:17.581228 10787 tablet_service.cc:1514] Processing DeleteTablet for tablet 45d7d34e8b9e454fbbbc6079faf2c6e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:44:17 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:44574
I20260808 04:44:17.581408 11248 tablet_service.cc:1514] Processing DeleteTablet for tablet 45d7d34e8b9e454fbbbc6079faf2c6e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:44:17 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:55594
I20260808 04:44:17.581753 11408 tablet_replica.cc:330] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 391d0b7264af4d32ac265eae15357334: stopping tablet replica
I20260808 04:44:17.581912 11028 tablet_service.cc:1514] Processing DeleteTablet for tablet 45d7d34e8b9e454fbbbc6079faf2c6e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:44:17 UTC) from {username='kudu', principal='kudu/127.12.148.126@KRBTEST.COM'} at 127.0.0.1:46734
I20260808 04:44:17.582082 11408 raft_consensus.cc:2229] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 391d0b7264af4d32ac265eae15357334 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:44:17.582406 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 10671
I20260808 04:44:17.582413 11408 raft_consensus.cc:2258] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 391d0b7264af4d32ac265eae15357334 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:44:17.583112 11412 tablet_replica.cc:330] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 4f89ebf8814945fab17532582e395ed6: stopping tablet replica
I20260808 04:44:17.583388 11412 raft_consensus.cc:2229] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 4f89ebf8814945fab17532582e395ed6 [term 1 LEADER]: Raft consensus shutting down.
I20260808 04:44:17.583758 11412 raft_consensus.cc:2258] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 4f89ebf8814945fab17532582e395ed6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:44:17.583976 11409 tablet_replica.cc:330] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P e7b1db8abb414e60b312d18023edaf7d: stopping tablet replica
I20260808 04:44:17.584296 11409 raft_consensus.cc:2229] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P e7b1db8abb414e60b312d18023edaf7d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:44:17.584570 11409 raft_consensus.cc:2258] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P e7b1db8abb414e60b312d18023edaf7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:44:17.589140 11412 ts_tablet_manager.cc:1905] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 4f89ebf8814945fab17532582e395ed6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:44:17.591987 11412 ts_tablet_manager.cc:1918] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 4f89ebf8814945fab17532582e395ed6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:44:17.592077 11412 log.cc:1196] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 4f89ebf8814945fab17532582e395ed6: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-1/wal/wals/45d7d34e8b9e454fbbbc6079faf2c6e8
I20260808 04:44:17.592463 11412 ts_tablet_manager.cc:1939] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P 4f89ebf8814945fab17532582e395ed6: Deleting consensus metadata
I20260808 04:44:17.593636 10538 catalog_manager.cc:4841] TS 4f89ebf8814945fab17532582e395ed6 (127.12.148.66:43353): tablet 45d7d34e8b9e454fbbbc6079faf2c6e8 (table test-table [id=579aeea547f841c7b84841f474ffdc36]) successfully deleted
I20260808 04:44:17.594936 11409 ts_tablet_manager.cc:1905] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P e7b1db8abb414e60b312d18023edaf7d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:44:17.597937 11409 ts_tablet_manager.cc:1918] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P e7b1db8abb414e60b312d18023edaf7d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:44:17.598040 11409 log.cc:1196] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P e7b1db8abb414e60b312d18023edaf7d: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786164004017495-12881-0/minicluster-data/ts-2/wal/wals/45d7d34e8b9e454fbbbc6079faf2c6e8
I20260808 04:44:17.598321 11409 ts_tablet_manager.cc:1939] T 45d7d34e8b9e454fbbbc6079faf2c6e8 P e7b1db8abb414e60b312d18023edaf7d: Deleting consensus metadata
I20260808 04:44:17.599542 10538 catalog_manager.cc:4841] TS e7b1db8abb414e60b312d18023edaf7d (127.12.148.67:40595): tablet 45d7d34e8b9e454fbbbc6079faf2c6e8 (table test-table [id=579aeea547f841c7b84841f474ffdc36]) successfully deleted
W20260808 04:44:17.602953 10538 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.148.65:38873 (error 108)
I20260808 04:44:17.603209 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 10913
I20260808 04:44:17.605868 11372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:17.605514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:38873 (local address 127.0.0.1:44578)
0808 04:44:17.605683 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:17.605761 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.65:38873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260808 04:44:17.606279 10538 catalog_manager.cc:4584] TS 391d0b7264af4d32ac265eae15357334 (127.12.148.65:38873): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 45d7d34e8b9e454fbbbc6079faf2c6e8: Network error: Client connection negotiation failed: client connection to 127.12.148.65:38873: connect: Connection refused (error 111)
I20260808 04:44:17.613833 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 11149
I20260808 04:44:17.639343 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 10512
2026-08-08T04:44:17Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2380 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-08T04:44:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:17Z Disabled control of system clock
I20260808 04:44:17.674604 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:37775
--webserver_interface=127.12.148.126
--webserver_port=0
--builtin_ntp_servers=127.12.148.84:43849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:37775
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 04:44:17.786710 11418 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:17.786990 11418 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:17.787025 11418 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:17.791067 11418 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:17.791131 11418 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:17.791145 11418 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:17.791175 11418 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:17.791203 11418 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:17.796056 11418 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:43849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:37775
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:37775
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11418
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:17.797155 11418 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:17.798650 11418 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:17.807039 11427 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:17.807010 11425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:17.807011 11431 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:17.807080 11418 server_base.cc:1034] running on GCE node
I20260808 04:44:17.807742 11418 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:17.808831 11418 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:17.810009 11418 hybrid_clock.cc:648] HybridClock initialized: now 1786164257809992 us; error 30 us; skew 500 ppm
I20260808 04:44:17.811928 11418 webserver.cc:460] Webserver started at http://127.12.148.126:46239/ using document root <none> and password file <none>
I20260808 04:44:17.812513 11418 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:17.812582 11418 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:17.812793 11418 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:17.814957 11418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "428270e9b0ca41bf86cab0f2971b9fc6"
format_stamp: "Formatted at 2026-08-08 04:44:17 on dist-test-slave-t7g5"
server_key: "898207fd4af8b40c70f1cd4f04c08de4"
server_key_iv: "f7f7e6c175618c5f4e8d6453d087c27b"
server_key_version: "encryptionkey@0"
I20260808 04:44:17.815579 11418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "428270e9b0ca41bf86cab0f2971b9fc6"
format_stamp: "Formatted at 2026-08-08 04:44:17 on dist-test-slave-t7g5"
server_key: "898207fd4af8b40c70f1cd4f04c08de4"
server_key_iv: "f7f7e6c175618c5f4e8d6453d087c27b"
server_key_version: "encryptionkey@0"
I20260808 04:44:17.819357 11418 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 04:44:17.821802 11439 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:17.823038 11418 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:44:17.823171 11418 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "428270e9b0ca41bf86cab0f2971b9fc6"
format_stamp: "Formatted at 2026-08-08 04:44:17 on dist-test-slave-t7g5"
server_key: "898207fd4af8b40c70f1cd4f04c08de4"
server_key_iv: "f7f7e6c175618c5f4e8d6453d087c27b"
server_key_version: "encryptionkey@0"
I20260808 04:44:17.823275 11418 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:17.848151 11418 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:17.848917 11418 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:17.849105 11418 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:17.856172 11528 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:37775 every 8 connection(s)
I20260808 04:44:17.856174 11418 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:37775
I20260808 04:44:17.857203 11418 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:17.860399 11530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:17.860952 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 11418
I20260808 04:44:17.861085 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:44:17.861402 12881 external_mini_cluster.cc:1428] Setting key a3a82dd760d29e265adbe7652eeaa7ce
I20260808 04:44:17.866714 11530 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 428270e9b0ca41bf86cab0f2971b9fc6: Bootstrap starting.
I20260808 04:44:17.869043 11530 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 428270e9b0ca41bf86cab0f2971b9fc6: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:17.869798 11530 log.cc:824] T 00000000000000000000000000000000 P 428270e9b0ca41bf86cab0f2971b9fc6: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:17.870884 11533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:17.862926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37614 (local address 127.12.148.126:37775)
0808 04:44:17.863596 (+ 670us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:17.863612 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:17.863649 (+ 37us) server_negotiation.cc:407] Connection header received
0808 04:44:17.864310 (+ 661us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:17.864328 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:17.864766 (+ 438us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:17.865076 (+ 310us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:17.865513 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:17.866523 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:17.867471 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:17.867970 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:17.868128 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:17.868967 (+ 839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:17.868972 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:17.868986 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:17.869399 (+ 413us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:17.869469 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:17.869490 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:17.869576 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:17.869737 (+ 161us) server_negotiation.cc:299] Negotiation successful
0808 04:44:17.870017 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":137,"threads_started":1}
I20260808 04:44:17.871803 11530 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 428270e9b0ca41bf86cab0f2971b9fc6: No bootstrap required, opened a new log
I20260808 04:44:17.875475 11530 raft_consensus.cc:348] T 00000000000000000000000000000000 P 428270e9b0ca41bf86cab0f2971b9fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "428270e9b0ca41bf86cab0f2971b9fc6" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 37775 } }
I20260808 04:44:17.875720 11530 raft_consensus.cc:374] T 00000000000000000000000000000000 P 428270e9b0ca41bf86cab0f2971b9fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:17.875782 11530 raft_consensus.cc:729] T 00000000000000000000000000000000 P 428270e9b0ca41bf86cab0f2971b9fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 428270e9b0ca41bf86cab0f2971b9fc6, State: Initialized, Role: FOLLOWER
I20260808 04:44:17.876216 11530 consensus_queue.cc:260] T 00000000000000000000000000000000 P 428270e9b0ca41bf86cab0f2971b9fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "428270e9b0ca41bf86cab0f2971b9fc6" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 37775 } }
I20260808 04:44:17.876380 11530 raft_consensus.cc:388] T 00000000000000000000000000000000 P 428270e9b0ca41bf86cab0f2971b9fc6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:17.876452 11530 raft_consensus.cc:482] T 00000000000000000000000000000000 P 428270e9b0ca41bf86cab0f2971b9fc6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:17.876559 11530 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 428270e9b0ca41bf86cab0f2971b9fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:17.877600 11530 raft_consensus.cc:504] T 00000000000000000000000000000000 P 428270e9b0ca41bf86cab0f2971b9fc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "428270e9b0ca41bf86cab0f2971b9fc6" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 37775 } }
I20260808 04:44:17.877986 11530 leader_election.cc:302] T 00000000000000000000000000000000 P 428270e9b0ca41bf86cab0f2971b9fc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 428270e9b0ca41bf86cab0f2971b9fc6; no voters:
I20260808 04:44:17.878328 11530 leader_election.cc:288] T 00000000000000000000000000000000 P 428270e9b0ca41bf86cab0f2971b9fc6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:17.878424 11535 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 428270e9b0ca41bf86cab0f2971b9fc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:17.878664 11535 raft_consensus.cc:686] T 00000000000000000000000000000000 P 428270e9b0ca41bf86cab0f2971b9fc6 [term 1 LEADER]: Becoming Leader. State: Replica: 428270e9b0ca41bf86cab0f2971b9fc6, State: Running, Role: LEADER
I20260808 04:44:17.878989 11535 consensus_queue.cc:237] T 00000000000000000000000000000000 P 428270e9b0ca41bf86cab0f2971b9fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "428270e9b0ca41bf86cab0f2971b9fc6" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 37775 } }
I20260808 04:44:17.879662 11530 sys_catalog.cc:564] T 00000000000000000000000000000000 P 428270e9b0ca41bf86cab0f2971b9fc6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:17.880693 11536 sys_catalog.cc:455] T 00000000000000000000000000000000 P 428270e9b0ca41bf86cab0f2971b9fc6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "428270e9b0ca41bf86cab0f2971b9fc6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "428270e9b0ca41bf86cab0f2971b9fc6" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 37775 } } }
I20260808 04:44:17.880720 11539 sys_catalog.cc:455] T 00000000000000000000000000000000 P 428270e9b0ca41bf86cab0f2971b9fc6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 428270e9b0ca41bf86cab0f2971b9fc6. Latest consensus state: current_term: 1 leader_uuid: "428270e9b0ca41bf86cab0f2971b9fc6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "428270e9b0ca41bf86cab0f2971b9fc6" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 37775 } } }
I20260808 04:44:17.880828 11536 sys_catalog.cc:458] T 00000000000000000000000000000000 P 428270e9b0ca41bf86cab0f2971b9fc6 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:17.880827 11539 sys_catalog.cc:458] T 00000000000000000000000000000000 P 428270e9b0ca41bf86cab0f2971b9fc6 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:17.881213 11558 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:17.884163 11558 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:17.889791 11558 catalog_manager.cc:1347] Generated new cluster ID: a25e23278e5a43569c708e67fb1fb8a7
I20260808 04:44:17.889865 11558 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:17.895886 11558 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:17.897042 11558 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:17.907395 11558 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 428270e9b0ca41bf86cab0f2971b9fc6: Generated new TSK 0
I20260808 04:44:17.908233 11558 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:44:17.912654 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.65:0
--local_ip_for_outbound_sockets=127.12.148.65
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:37775
--builtin_ntp_servers=127.12.148.84:43849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 04:44:18.026183 11574 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:18.026499 11574 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:18.026546 11574 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:18.030620 11574 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:18.030685 11574 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:18.030741 11574 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.65
I20260808 04:44:18.035547 11574 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:43849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.148.65
--webserver_port=0
--tserver_master_addrs=127.12.148.126:37775
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11574
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.65
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:18.036623 11574 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:18.038028 11574 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:18.047866 11583 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:18.047875 11580 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:18.047910 11581 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:18.048019 11574 server_base.cc:1034] running on GCE node
I20260808 04:44:18.048487 11574 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:18.049175 11574 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:18.050334 11574 hybrid_clock.cc:648] HybridClock initialized: now 1786164258050310 us; error 35 us; skew 500 ppm
I20260808 04:44:18.052138 11574 webserver.cc:460] Webserver started at http://127.12.148.65:35733/ using document root <none> and password file <none>
I20260808 04:44:18.052680 11574 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:18.052742 11574 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:18.052919 11574 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:18.055071 11574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-0/data/instance:
uuid: "6ef38c6c77e047be8627fb8b646f4484"
format_stamp: "Formatted at 2026-08-08 04:44:18 on dist-test-slave-t7g5"
server_key: "340c62607053805ffc3c1dadeeda3065"
server_key_iv: "d96a0c0d216475a0e412e4662bf28f3e"
server_key_version: "encryptionkey@0"
I20260808 04:44:18.055614 11574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance:
uuid: "6ef38c6c77e047be8627fb8b646f4484"
format_stamp: "Formatted at 2026-08-08 04:44:18 on dist-test-slave-t7g5"
server_key: "340c62607053805ffc3c1dadeeda3065"
server_key_iv: "d96a0c0d216475a0e412e4662bf28f3e"
server_key_version: "encryptionkey@0"
I20260808 04:44:18.059335 11574 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260808 04:44:18.061790 11596 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:18.063005 11574 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 04:44:18.063109 11574 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-0/wal
uuid: "6ef38c6c77e047be8627fb8b646f4484"
format_stamp: "Formatted at 2026-08-08 04:44:18 on dist-test-slave-t7g5"
server_key: "340c62607053805ffc3c1dadeeda3065"
server_key_iv: "d96a0c0d216475a0e412e4662bf28f3e"
server_key_version: "encryptionkey@0"
I20260808 04:44:18.063202 11574 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:18.080787 11574 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:18.081532 11574 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:18.081744 11574 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:18.082346 11574 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:44:18.083284 11574 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:44:18.083335 11574 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:18.083375 11574 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:44:18.083395 11574 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:18.091818 11574 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.65:38439
I20260808 04:44:18.091847 11792 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.65:38439 every 8 connection(s)
I20260808 04:44:18.092715 11574 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-0/data/info.pb
I20260808 04:44:18.099817 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 11574
I20260808 04:44:18.099951 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-0/wal/instance
I20260808 04:44:18.100267 12881 external_mini_cluster.cc:1428] Setting key 1e26484a5a79aa75d6163787c4f01a4f
I20260808 04:44:18.102201 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.66:0
--local_ip_for_outbound_sockets=127.12.148.66
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:37775
--builtin_ntp_servers=127.12.148.84:43849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 04:44:18.102205 11533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:18.094611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.65:45417 (local address 127.12.148.126:37775)
0808 04:44:18.094752 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:18.094756 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:18.095843 (+ 1087us) server_negotiation.cc:407] Connection header received
0808 04:44:18.097168 (+ 1325us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:18.097171 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:18.097218 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:18.097293 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:18.098267 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.098818 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.099988 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.100300 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.100409 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:18.101731 (+ 1322us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:18.101734 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:18.101736 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:18.101748 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:18.101769 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:18.101777 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:18.101838 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:18.101993 (+ 155us) server_negotiation.cc:299] Negotiation successful
0808 04:44:18.102059 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 04:44:18.103097 11798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:18.095009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:37775 (local address 127.12.148.65:45417)
0808 04:44:18.095683 (+ 674us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:18.095725 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:18.096981 (+ 1256us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:18.097479 (+ 498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:18.097485 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:18.097572 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:18.098133 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:18.098146 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.098911 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.098913 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:18.099856 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:18.099866 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.100481 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.100486 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:18.100682 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:18.101449 (+ 767us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:44:18.101451 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:18.101494 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:44:18.101562 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:18.101849 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:18.101859 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:18.101866 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 04:44:18.101976 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 04:44:18.102258 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":125,"threads_started":1}
I20260808 04:44:18.104350 11794 heartbeater.cc:347] Connected to a master server at 127.12.148.126:37775
I20260808 04:44:18.104619 11794 heartbeater.cc:464] Registering TS with master...
I20260808 04:44:18.105233 11794 heartbeater.cc:511] Master 127.12.148.126:37775 requested a full tablet report, sending...
I20260808 04:44:18.106983 11471 ts_manager.cc:194] Registered new tserver with Master: 6ef38c6c77e047be8627fb8b646f4484 (127.12.148.65:38439)
I20260808 04:44:18.108660 11471 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.148.65:45417
W20260808 04:44:18.216048 11799 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:18.216312 11799 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:18.216351 11799 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:18.220482 11799 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:18.220551 11799 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:18.220605 11799 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.66
I20260808 04:44:18.225536 11799 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:43849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.148.66
--webserver_port=0
--tserver_master_addrs=127.12.148.126:37775
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11799
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.66
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:18.226604 11799 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:18.228067 11799 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:18.237542 11812 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:18.237603 11815 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:18.237607 11811 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:18.237818 11799 server_base.cc:1034] running on GCE node
I20260808 04:44:18.238337 11799 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:18.239008 11799 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:18.240186 11799 hybrid_clock.cc:648] HybridClock initialized: now 1786164258240155 us; error 43 us; skew 500 ppm
I20260808 04:44:18.244830 11799 webserver.cc:460] Webserver started at http://127.12.148.66:43183/ using document root <none> and password file <none>
I20260808 04:44:18.245406 11799 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:18.245471 11799 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:18.245674 11799 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:18.247819 11799 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-1/data/instance:
uuid: "47b895e051fa4071b32415132bfcd49d"
format_stamp: "Formatted at 2026-08-08 04:44:18 on dist-test-slave-t7g5"
server_key: "976012001f08df1c5653217f69290174"
server_key_iv: "cddba733ac681b44989d1c56df2ae0fb"
server_key_version: "encryptionkey@0"
I20260808 04:44:18.248354 11799 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance:
uuid: "47b895e051fa4071b32415132bfcd49d"
format_stamp: "Formatted at 2026-08-08 04:44:18 on dist-test-slave-t7g5"
server_key: "976012001f08df1c5653217f69290174"
server_key_iv: "cddba733ac681b44989d1c56df2ae0fb"
server_key_version: "encryptionkey@0"
I20260808 04:44:18.252156 11799 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 04:44:18.254837 11824 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:18.256146 11799 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:44:18.256273 11799 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-1/wal
uuid: "47b895e051fa4071b32415132bfcd49d"
format_stamp: "Formatted at 2026-08-08 04:44:18 on dist-test-slave-t7g5"
server_key: "976012001f08df1c5653217f69290174"
server_key_iv: "cddba733ac681b44989d1c56df2ae0fb"
server_key_version: "encryptionkey@0"
I20260808 04:44:18.256386 11799 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:18.292269 11799 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:18.293047 11799 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:18.293262 11799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:18.293937 11799 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:44:18.295050 11799 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:44:18.295101 11799 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:18.295156 11799 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:44:18.295186 11799 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:18.304214 11799 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.66:36247
I20260808 04:44:18.304245 12007 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.66:36247 every 8 connection(s)
I20260808 04:44:18.305188 11799 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-1/data/info.pb
I20260808 04:44:18.310290 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 11799
I20260808 04:44:18.310424 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-1/wal/instance
I20260808 04:44:18.310711 12881 external_mini_cluster.cc:1428] Setting key bd4a382a3522f5367c790b5543032b5e
I20260808 04:44:18.312669 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.148.67:0
--local_ip_for_outbound_sockets=127.12.148.67
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:37775
--builtin_ntp_servers=127.12.148.84:43849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 04:44:18.314759 11533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:18.307005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.66:51575 (local address 127.12.148.126:37775)
0808 04:44:18.307128 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:18.307131 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:18.308252 (+ 1121us) server_negotiation.cc:407] Connection header received
0808 04:44:18.309686 (+ 1434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:18.309690 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:18.309755 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:18.309829 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:18.310909 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.311522 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.312748 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.313024 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.313118 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:18.314286 (+ 1168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:18.314289 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:18.314292 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:18.314306 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:18.314328 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:18.314336 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:18.314395 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:18.314548 (+ 153us) server_negotiation.cc:299] Negotiation successful
0808 04:44:18.314614 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 04:44:18.315687 12012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:18.307388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:37775 (local address 127.12.148.66:51575)
0808 04:44:18.308097 (+ 709us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:18.308141 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:18.309432 (+ 1291us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:18.310050 (+ 618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:18.310058 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:18.310155 (+ 97us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:18.310709 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:18.310725 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.311652 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.311654 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:18.312630 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:18.312641 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.313176 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.313181 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:18.313349 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:18.313994 (+ 645us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:44:18.313996 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:18.314041 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:44:18.314114 (+ 73us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:18.314407 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:18.314417 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:18.314423 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 04:44:18.314537 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 04:44:18.314843 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":113,"threads_started":1}
I20260808 04:44:18.316798 12009 heartbeater.cc:347] Connected to a master server at 127.12.148.126:37775
I20260808 04:44:18.317030 12009 heartbeater.cc:464] Registering TS with master...
I20260808 04:44:18.317550 12009 heartbeater.cc:511] Master 127.12.148.126:37775 requested a full tablet report, sending...
I20260808 04:44:18.318601 11471 ts_manager.cc:194] Registered new tserver with Master: 47b895e051fa4071b32415132bfcd49d (127.12.148.66:36247)
I20260808 04:44:18.319392 11471 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.148.66:51575
W20260808 04:44:18.428676 12013 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:18.428982 12013 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:18.429039 12013 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:18.433125 12013 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:18.433192 12013 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:18.433246 12013 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.148.67
I20260808 04:44:18.438153 12013 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:43849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.148.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.148.67
--webserver_port=0
--tserver_master_addrs=127.12.148.126:37775
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12013
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.148.67
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:18.439296 12013 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:18.440676 12013 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:18.450368 12024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:18.450405 12026 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:18.450575 12013 server_base.cc:1034] running on GCE node
W20260808 04:44:18.450740 12021 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:18.451157 12013 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:18.451841 12013 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:18.453004 12013 hybrid_clock.cc:648] HybridClock initialized: now 1786164258452984 us; error 34 us; skew 500 ppm
I20260808 04:44:18.454967 12013 webserver.cc:460] Webserver started at http://127.12.148.67:33577/ using document root <none> and password file <none>
I20260808 04:44:18.455581 12013 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:18.455657 12013 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:18.455878 12013 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:18.458103 12013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-2/data/instance:
uuid: "bb996c652c43417295f04135ae2ce566"
format_stamp: "Formatted at 2026-08-08 04:44:18 on dist-test-slave-t7g5"
server_key: "d0a3d81398bde5d8eefc54a5b26f346c"
server_key_iv: "6264f8063ae7eeb66abb936b31ca3ef9"
server_key_version: "encryptionkey@0"
I20260808 04:44:18.458681 12013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance:
uuid: "bb996c652c43417295f04135ae2ce566"
format_stamp: "Formatted at 2026-08-08 04:44:18 on dist-test-slave-t7g5"
server_key: "d0a3d81398bde5d8eefc54a5b26f346c"
server_key_iv: "6264f8063ae7eeb66abb936b31ca3ef9"
server_key_version: "encryptionkey@0"
I20260808 04:44:18.462754 12013 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 04:44:18.465343 12036 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:18.466701 12013 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:44:18.466820 12013 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-2/wal
uuid: "bb996c652c43417295f04135ae2ce566"
format_stamp: "Formatted at 2026-08-08 04:44:18 on dist-test-slave-t7g5"
server_key: "d0a3d81398bde5d8eefc54a5b26f346c"
server_key_iv: "6264f8063ae7eeb66abb936b31ca3ef9"
server_key_version: "encryptionkey@0"
I20260808 04:44:18.466938 12013 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:18.487679 12013 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:18.488404 12013 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:18.488593 12013 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:18.489204 12013 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 04:44:18.490222 12013 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 04:44:18.490273 12013 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:18.490329 12013 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 04:44:18.490357 12013 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:18.500095 12013 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.67:41089
I20260808 04:44:18.500237 12235 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.67:41089 every 8 connection(s)
I20260808 04:44:18.501250 12013 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-2/data/info.pb
I20260808 04:44:18.510562 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 12013
I20260808 04:44:18.510704 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-2/wal/instance
I20260808 04:44:18.511067 12881 external_mini_cluster.cc:1428] Setting key fa89f239b297cff2c4d67e8f98451e46
I20260808 04:44:18.514416 11533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:18.503485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:53441 (local address 127.12.148.126:37775)
0808 04:44:18.503619 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:18.503624 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:18.505016 (+ 1392us) server_negotiation.cc:407] Connection header received
0808 04:44:18.506637 (+ 1621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:18.506641 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:18.506703 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:18.506804 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:18.507967 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.508787 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.510578 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.510910 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.511004 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:18.513817 (+ 2813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:18.513822 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:18.513825 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:18.513844 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:18.513873 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:18.513886 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:18.513941 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:18.514207 (+ 266us) server_negotiation.cc:299] Negotiation successful
0808 04:44:18.514274 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 04:44:18.515702 12239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:18.504048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:37775 (local address 127.12.148.67:53441)
0808 04:44:18.504845 (+ 797us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:18.504901 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:18.506371 (+ 1470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:18.506995 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:18.507005 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:18.507120 (+ 115us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:18.507791 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:18.507807 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.508936 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.508940 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:18.510438 (+ 1498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:18.510451 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.511165 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.511168 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:18.511368 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:18.513363 (+ 1995us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 04:44:18.513366 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:18.513449 (+ 83us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 04:44:18.513567 (+ 118us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:18.514018 (+ 451us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:18.514029 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:18.514036 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 04:44:18.514190 (+ 154us) client_negotiation.cc:240] Negotiation successful
0808 04:44:18.514598 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":164,"threads_started":1}
I20260808 04:44:18.517102 12236 heartbeater.cc:347] Connected to a master server at 127.12.148.126:37775
I20260808 04:44:18.517350 12236 heartbeater.cc:464] Registering TS with master...
I20260808 04:44:18.518016 12236 heartbeater.cc:511] Master 127.12.148.126:37775 requested a full tablet report, sending...
I20260808 04:44:18.519189 11471 ts_manager.cc:194] Registered new tserver with Master: bb996c652c43417295f04135ae2ce566 (127.12.148.67:41089)
I20260808 04:44:18.519923 11471 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.148.67:53441
I20260808 04:44:18.529134 12881 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 04:44:18.535758 11533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:18.531381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37624 (local address 127.12.148.126:37775)
0808 04:44:18.531507 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:18.531512 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:18.531756 (+ 244us) server_negotiation.cc:407] Connection header received
0808 04:44:18.531885 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:18.531888 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:18.531937 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:18.532014 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:18.532300 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.532830 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.534007 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.534360 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.534459 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:18.535315 (+ 856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:18.535319 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:18.535321 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:18.535335 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:18.535357 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:18.535368 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:18.535435 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:18.535543 (+ 108us) server_negotiation.cc:299] Negotiation successful
0808 04:44:18.535605 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 04:44:18.538894 11471 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37624:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 04:44:18.543557 11471 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 04:44:18.559808 12256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:18.553243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.67:41089 (local address 127.0.0.1:36890)
0808 04:44:18.554369 (+ 1126us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:18.554430 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:18.554565 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:18.555122 (+ 557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:18.555128 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:18.555149 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:18.555287 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:18.555293 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.556757 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.556760 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:18.558174 (+ 1414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:18.558185 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.559186 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.559190 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:18.559315 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:18.559362 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 04:44:18.559452 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 04:44:18.559643 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":949,"mutex_wait_us":22,"spinlock_wait_cycles":6272,"thread_start_us":82,"threads_started":1}
I20260808 04:44:18.560498 12255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:18.553363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36890 (local address 127.12.148.67:41089)
0808 04:44:18.553751 (+ 388us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:18.553765 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:18.554635 (+ 870us) server_negotiation.cc:407] Connection header received
0808 04:44:18.554722 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:18.554728 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:18.554963 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:18.555130 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:18.555416 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.556618 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.558306 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.559079 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.559191 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:18.560180 (+ 989us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:18.560233 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 04:44:18.560339 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":237,"thread_start_us":133,"threads_started":1}
I20260808 04:44:18.560751 12257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:18.554025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:36247 (local address 127.0.0.1:51794)
0808 04:44:18.555378 (+ 1353us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:18.555392 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:18.555501 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:18.557254 (+ 1753us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:18.557257 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:18.557276 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:18.557384 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:18.557390 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.558438 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.558440 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:18.559338 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:18.559347 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.560300 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.560303 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:18.560407 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:18.560428 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 04:44:18.560487 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 04:44:18.560559 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1290,"mutex_wait_us":4,"thread_start_us":99,"threads_started":1}
I20260808 04:44:18.560755 12259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:18.554186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51794 (local address 127.12.148.66:36247)
0808 04:44:18.554667 (+ 481us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:18.554679 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:18.556850 (+ 2171us) server_negotiation.cc:407] Connection header received
0808 04:44:18.556927 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:18.556932 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:18.557113 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:18.557275 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:18.557512 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.558331 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.559472 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.560178 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.560275 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:18.560457 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:18.560512 (+ 55us) server_negotiation.cc:299] Negotiation successful
0808 04:44:18.560595 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":116,"threads_started":1}
I20260808 04:44:18.560797 12254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:18.553882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:38439 (local address 127.0.0.1:36414)
0808 04:44:18.554369 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:18.554421 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:18.554566 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:18.555280 (+ 714us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:18.555282 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:18.555297 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:18.555378 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:18.555384 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.557422 (+ 2038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.557426 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:18.558526 (+ 1100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:18.558534 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.560216 (+ 1682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.560220 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:18.560490 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:18.560521 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 04:44:18.560593 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 04:44:18.560666 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":366,"mutex_wait_us":168,"spinlock_wait_cycles":10880,"thread_start_us":94,"threads_started":1}
I20260808 04:44:18.561288 12258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:18.554037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36414 (local address 127.12.148.65:38439)
0808 04:44:18.554440 (+ 403us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:18.554453 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:18.554482 (+ 29us) server_negotiation.cc:407] Connection header received
0808 04:44:18.554777 (+ 295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:18.554783 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:18.554973 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:18.555122 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:18.555511 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.556745 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.558643 (+ 1898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.559710 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.559807 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:18.560449 (+ 642us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:18.561013 (+ 564us) server_negotiation.cc:299] Negotiation successful
0808 04:44:18.561114 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":312,"thread_start_us":95,"threads_started":1}
I20260808 04:44:18.563987 11906 tablet_service.cc:1467] Processing CreateTablet for tablet bfa78b9b63a54511aa131c073141799c (DEFAULT_TABLE table=test-table [id=b0b3c363e01e4ee0aeb3f7954aec509e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:44:18.563987 11675 tablet_service.cc:1467] Processing CreateTablet for tablet bfa78b9b63a54511aa131c073141799c (DEFAULT_TABLE table=test-table [id=b0b3c363e01e4ee0aeb3f7954aec509e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:44:18.565136 11906 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfa78b9b63a54511aa131c073141799c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:18.565135 11675 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfa78b9b63a54511aa131c073141799c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:18.568188 12111 tablet_service.cc:1467] Processing CreateTablet for tablet bfa78b9b63a54511aa131c073141799c (DEFAULT_TABLE table=test-table [id=b0b3c363e01e4ee0aeb3f7954aec509e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 04:44:18.569082 12111 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfa78b9b63a54511aa131c073141799c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:18.572657 12260 tablet_bootstrap.cc:492] T bfa78b9b63a54511aa131c073141799c P 6ef38c6c77e047be8627fb8b646f4484: Bootstrap starting.
I20260808 04:44:18.573980 12263 tablet_bootstrap.cc:492] T bfa78b9b63a54511aa131c073141799c P 47b895e051fa4071b32415132bfcd49d: Bootstrap starting.
I20260808 04:44:18.575091 12260 tablet_bootstrap.cc:654] T bfa78b9b63a54511aa131c073141799c P 6ef38c6c77e047be8627fb8b646f4484: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:18.575695 12263 tablet_bootstrap.cc:654] T bfa78b9b63a54511aa131c073141799c P 47b895e051fa4071b32415132bfcd49d: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:18.575999 12260 log.cc:824] T bfa78b9b63a54511aa131c073141799c P 6ef38c6c77e047be8627fb8b646f4484: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:18.576040 12264 tablet_bootstrap.cc:492] T bfa78b9b63a54511aa131c073141799c P bb996c652c43417295f04135ae2ce566: Bootstrap starting.
I20260808 04:44:18.576505 12263 log.cc:824] T bfa78b9b63a54511aa131c073141799c P 47b895e051fa4071b32415132bfcd49d: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:18.578284 12264 tablet_bootstrap.cc:654] T bfa78b9b63a54511aa131c073141799c P bb996c652c43417295f04135ae2ce566: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:18.578310 12260 tablet_bootstrap.cc:492] T bfa78b9b63a54511aa131c073141799c P 6ef38c6c77e047be8627fb8b646f4484: No bootstrap required, opened a new log
I20260808 04:44:18.578433 12263 tablet_bootstrap.cc:492] T bfa78b9b63a54511aa131c073141799c P 47b895e051fa4071b32415132bfcd49d: No bootstrap required, opened a new log
I20260808 04:44:18.578481 12260 ts_tablet_manager.cc:1397] T bfa78b9b63a54511aa131c073141799c P 6ef38c6c77e047be8627fb8b646f4484: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 04:44:18.578626 12263 ts_tablet_manager.cc:1397] T bfa78b9b63a54511aa131c073141799c P 47b895e051fa4071b32415132bfcd49d: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 04:44:18.579062 12264 log.cc:824] T bfa78b9b63a54511aa131c073141799c P bb996c652c43417295f04135ae2ce566: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:18.580920 12264 tablet_bootstrap.cc:492] T bfa78b9b63a54511aa131c073141799c P bb996c652c43417295f04135ae2ce566: No bootstrap required, opened a new log
I20260808 04:44:18.581110 12264 ts_tablet_manager.cc:1397] T bfa78b9b63a54511aa131c073141799c P bb996c652c43417295f04135ae2ce566: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260808 04:44:18.582070 12260 raft_consensus.cc:348] T bfa78b9b63a54511aa131c073141799c P 6ef38c6c77e047be8627fb8b646f4484 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb996c652c43417295f04135ae2ce566" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 41089 } } peers { permanent_uuid: "6ef38c6c77e047be8627fb8b646f4484" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 38439 } } peers { permanent_uuid: "47b895e051fa4071b32415132bfcd49d" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 36247 } }
I20260808 04:44:18.582293 12260 raft_consensus.cc:374] T bfa78b9b63a54511aa131c073141799c P 6ef38c6c77e047be8627fb8b646f4484 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:18.582347 12260 raft_consensus.cc:729] T bfa78b9b63a54511aa131c073141799c P 6ef38c6c77e047be8627fb8b646f4484 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ef38c6c77e047be8627fb8b646f4484, State: Initialized, Role: FOLLOWER
I20260808 04:44:18.582748 12260 consensus_queue.cc:260] T bfa78b9b63a54511aa131c073141799c P 6ef38c6c77e047be8627fb8b646f4484 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb996c652c43417295f04135ae2ce566" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 41089 } } peers { permanent_uuid: "6ef38c6c77e047be8627fb8b646f4484" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 38439 } } peers { permanent_uuid: "47b895e051fa4071b32415132bfcd49d" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 36247 } }
I20260808 04:44:18.582825 12263 raft_consensus.cc:348] T bfa78b9b63a54511aa131c073141799c P 47b895e051fa4071b32415132bfcd49d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb996c652c43417295f04135ae2ce566" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 41089 } } peers { permanent_uuid: "6ef38c6c77e047be8627fb8b646f4484" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 38439 } } peers { permanent_uuid: "47b895e051fa4071b32415132bfcd49d" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 36247 } }
I20260808 04:44:18.583079 12263 raft_consensus.cc:374] T bfa78b9b63a54511aa131c073141799c P 47b895e051fa4071b32415132bfcd49d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:18.583137 12263 raft_consensus.cc:729] T bfa78b9b63a54511aa131c073141799c P 47b895e051fa4071b32415132bfcd49d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b895e051fa4071b32415132bfcd49d, State: Initialized, Role: FOLLOWER
I20260808 04:44:18.583492 11794 heartbeater.cc:503] Master 127.12.148.126:37775 was elected leader, sending a full tablet report...
I20260808 04:44:18.583556 12263 consensus_queue.cc:260] T bfa78b9b63a54511aa131c073141799c P 47b895e051fa4071b32415132bfcd49d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb996c652c43417295f04135ae2ce566" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 41089 } } peers { permanent_uuid: "6ef38c6c77e047be8627fb8b646f4484" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 38439 } } peers { permanent_uuid: "47b895e051fa4071b32415132bfcd49d" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 36247 } }
I20260808 04:44:18.584578 12263 ts_tablet_manager.cc:1428] T bfa78b9b63a54511aa131c073141799c P 47b895e051fa4071b32415132bfcd49d: Time spent starting tablet: real 0.006s user 0.001s sys 0.005s
I20260808 04:44:18.584928 12009 heartbeater.cc:503] Master 127.12.148.126:37775 was elected leader, sending a full tablet report...
I20260808 04:44:18.585120 12264 raft_consensus.cc:348] T bfa78b9b63a54511aa131c073141799c P bb996c652c43417295f04135ae2ce566 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb996c652c43417295f04135ae2ce566" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 41089 } } peers { permanent_uuid: "6ef38c6c77e047be8627fb8b646f4484" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 38439 } } peers { permanent_uuid: "47b895e051fa4071b32415132bfcd49d" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 36247 } }
I20260808 04:44:18.585315 12264 raft_consensus.cc:374] T bfa78b9b63a54511aa131c073141799c P bb996c652c43417295f04135ae2ce566 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:18.585373 12264 raft_consensus.cc:729] T bfa78b9b63a54511aa131c073141799c P bb996c652c43417295f04135ae2ce566 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb996c652c43417295f04135ae2ce566, State: Initialized, Role: FOLLOWER
I20260808 04:44:18.585945 12264 consensus_queue.cc:260] T bfa78b9b63a54511aa131c073141799c P bb996c652c43417295f04135ae2ce566 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb996c652c43417295f04135ae2ce566" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 41089 } } peers { permanent_uuid: "6ef38c6c77e047be8627fb8b646f4484" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 38439 } } peers { permanent_uuid: "47b895e051fa4071b32415132bfcd49d" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 36247 } }
I20260808 04:44:18.586664 12236 heartbeater.cc:503] Master 127.12.148.126:37775 was elected leader, sending a full tablet report...
I20260808 04:44:18.586918 12264 ts_tablet_manager.cc:1428] T bfa78b9b63a54511aa131c073141799c P bb996c652c43417295f04135ae2ce566: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 04:44:18.587442 12260 ts_tablet_manager.cc:1428] T bfa78b9b63a54511aa131c073141799c P 6ef38c6c77e047be8627fb8b646f4484: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
W20260808 04:44:18.593822 11797 tablet.cc:2369] T bfa78b9b63a54511aa131c073141799c P 6ef38c6c77e047be8627fb8b646f4484: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:44:18.601370 12272 raft_consensus.cc:482] T bfa78b9b63a54511aa131c073141799c P bb996c652c43417295f04135ae2ce566 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 04:44:18.601559 12272 raft_consensus.cc:504] T bfa78b9b63a54511aa131c073141799c P bb996c652c43417295f04135ae2ce566 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb996c652c43417295f04135ae2ce566" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 41089 } } peers { permanent_uuid: "6ef38c6c77e047be8627fb8b646f4484" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 38439 } } peers { permanent_uuid: "47b895e051fa4071b32415132bfcd49d" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 36247 } }
I20260808 04:44:18.602872 12272 leader_election.cc:288] T bfa78b9b63a54511aa131c073141799c P bb996c652c43417295f04135ae2ce566 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ef38c6c77e047be8627fb8b646f4484 (127.12.148.65:38439), 47b895e051fa4071b32415132bfcd49d (127.12.148.66:36247)
I20260808 04:44:18.606325 12239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:18.603072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:38439 (local address 127.12.148.67:36773)
0808 04:44:18.603215 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:18.603230 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:18.603308 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:18.603648 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:18.603651 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:18.603668 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:18.603780 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:18.603787 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.604485 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.604488 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:18.605262 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:18.605271 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.605936 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.605947 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:18.606042 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:18.606060 (+ 18us) client_negotiation.cc:769] Sending connection context
0808 04:44:18.606127 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 04:44:18.606196 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260808 04:44:18.606325 12258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:18.603277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:36773 (local address 127.12.148.65:38439)
0808 04:44:18.603408 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:18.603412 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:18.603428 (+ 16us) server_negotiation.cc:407] Connection header received
0808 04:44:18.603496 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:18.603499 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:18.603549 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:18.603634 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:18.603896 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.604375 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.605392 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.605822 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.605934 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:18.605984 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:18.606157 (+ 173us) server_negotiation.cc:299] Negotiation successful
0808 04:44:18.606224 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 04:44:18.606745 12274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:18.603072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.66:36247 (local address 127.12.148.67:43937)
0808 04:44:18.603670 (+ 598us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:18.603681 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:18.603771 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:18.603989 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:18.603992 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:18.604006 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 04:44:18.604118 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:18.604123 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.604872 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.604875 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:18.605626 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:18.605635 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.606290 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.606294 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:18.606388 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:18.606411 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 04:44:18.606526 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 04:44:18.606588 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":532,"mutex_wait_us":220,"thread_start_us":150,"threads_started":1}
I20260808 04:44:18.606758 12259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:18.603244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.148.67:43937 (local address 127.12.148.66:36247)
0808 04:44:18.603381 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:18.603385 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:18.603751 (+ 366us) server_negotiation.cc:407] Connection header received
0808 04:44:18.603852 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:18.603855 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:18.603900 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:18.603969 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 04:44:18.604233 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.604770 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.605755 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.606176 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.606283 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:18.606328 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:18.606563 (+ 235us) server_negotiation.cc:299] Negotiation successful
0808 04:44:18.606644 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 04:44:18.606961 11713 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfa78b9b63a54511aa131c073141799c" candidate_uuid: "bb996c652c43417295f04135ae2ce566" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ef38c6c77e047be8627fb8b646f4484" is_pre_election: true
I20260808 04:44:18.607276 11713 raft_consensus.cc:2454] T bfa78b9b63a54511aa131c073141799c P 6ef38c6c77e047be8627fb8b646f4484 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb996c652c43417295f04135ae2ce566 in term 0.
I20260808 04:44:18.607355 11938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfa78b9b63a54511aa131c073141799c" candidate_uuid: "bb996c652c43417295f04135ae2ce566" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b895e051fa4071b32415132bfcd49d" is_pre_election: true
I20260808 04:44:18.607645 11938 raft_consensus.cc:2454] T bfa78b9b63a54511aa131c073141799c P 47b895e051fa4071b32415132bfcd49d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb996c652c43417295f04135ae2ce566 in term 0.
I20260808 04:44:18.607769 12048 leader_election.cc:302] T bfa78b9b63a54511aa131c073141799c P bb996c652c43417295f04135ae2ce566 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ef38c6c77e047be8627fb8b646f4484, bb996c652c43417295f04135ae2ce566; no voters:
I20260808 04:44:18.608043 12272 raft_consensus.cc:2781] T bfa78b9b63a54511aa131c073141799c P bb996c652c43417295f04135ae2ce566 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 04:44:18.608127 12272 raft_consensus.cc:482] T bfa78b9b63a54511aa131c073141799c P bb996c652c43417295f04135ae2ce566 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 04:44:18.608178 12272 raft_consensus.cc:3037] T bfa78b9b63a54511aa131c073141799c P bb996c652c43417295f04135ae2ce566 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:18.609148 12272 raft_consensus.cc:504] T bfa78b9b63a54511aa131c073141799c P bb996c652c43417295f04135ae2ce566 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb996c652c43417295f04135ae2ce566" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 41089 } } peers { permanent_uuid: "6ef38c6c77e047be8627fb8b646f4484" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 38439 } } peers { permanent_uuid: "47b895e051fa4071b32415132bfcd49d" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 36247 } }
I20260808 04:44:18.609457 12272 leader_election.cc:288] T bfa78b9b63a54511aa131c073141799c P bb996c652c43417295f04135ae2ce566 [CANDIDATE]: Term 1 election: Requested vote from peers 6ef38c6c77e047be8627fb8b646f4484 (127.12.148.65:38439), 47b895e051fa4071b32415132bfcd49d (127.12.148.66:36247)
I20260808 04:44:18.609792 11713 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfa78b9b63a54511aa131c073141799c" candidate_uuid: "bb996c652c43417295f04135ae2ce566" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ef38c6c77e047be8627fb8b646f4484"
I20260808 04:44:18.609838 11938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfa78b9b63a54511aa131c073141799c" candidate_uuid: "bb996c652c43417295f04135ae2ce566" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b895e051fa4071b32415132bfcd49d"
I20260808 04:44:18.609930 11713 raft_consensus.cc:3037] T bfa78b9b63a54511aa131c073141799c P 6ef38c6c77e047be8627fb8b646f4484 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:18.609956 11938 raft_consensus.cc:3037] T bfa78b9b63a54511aa131c073141799c P 47b895e051fa4071b32415132bfcd49d [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:18.610934 11713 raft_consensus.cc:2454] T bfa78b9b63a54511aa131c073141799c P 6ef38c6c77e047be8627fb8b646f4484 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb996c652c43417295f04135ae2ce566 in term 1.
I20260808 04:44:18.611001 11938 raft_consensus.cc:2454] T bfa78b9b63a54511aa131c073141799c P 47b895e051fa4071b32415132bfcd49d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb996c652c43417295f04135ae2ce566 in term 1.
I20260808 04:44:18.611223 12048 leader_election.cc:302] T bfa78b9b63a54511aa131c073141799c P bb996c652c43417295f04135ae2ce566 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ef38c6c77e047be8627fb8b646f4484, bb996c652c43417295f04135ae2ce566; no voters:
I20260808 04:44:18.611387 12272 raft_consensus.cc:2781] T bfa78b9b63a54511aa131c073141799c P bb996c652c43417295f04135ae2ce566 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:18.611598 12272 raft_consensus.cc:686] T bfa78b9b63a54511aa131c073141799c P bb996c652c43417295f04135ae2ce566 [term 1 LEADER]: Becoming Leader. State: Replica: bb996c652c43417295f04135ae2ce566, State: Running, Role: LEADER
I20260808 04:44:18.611892 12272 consensus_queue.cc:237] T bfa78b9b63a54511aa131c073141799c P bb996c652c43417295f04135ae2ce566 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb996c652c43417295f04135ae2ce566" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 41089 } } peers { permanent_uuid: "6ef38c6c77e047be8627fb8b646f4484" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 38439 } } peers { permanent_uuid: "47b895e051fa4071b32415132bfcd49d" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 36247 } }
I20260808 04:44:18.614938 11469 catalog_manager.cc:5495] T bfa78b9b63a54511aa131c073141799c P bb996c652c43417295f04135ae2ce566 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb996c652c43417295f04135ae2ce566 (127.12.148.67). New cstate: current_term: 1 leader_uuid: "bb996c652c43417295f04135ae2ce566" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb996c652c43417295f04135ae2ce566" member_type: VOTER last_known_addr { host: "127.12.148.67" port: 41089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ef38c6c77e047be8627fb8b646f4484" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 38439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b895e051fa4071b32415132bfcd49d" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 36247 } health_report { overall_health: UNKNOWN } } }
I20260808 04:44:18.639382 12255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:18.635942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36896 (local address 127.12.148.67:41089)
0808 04:44:18.636077 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:18.636082 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:18.636098 (+ 16us) server_negotiation.cc:407] Connection header received
0808 04:44:18.636182 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:18.636184 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:18.636240 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:18.636333 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:44:18.636572 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.637070 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.637965 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:18.638178 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:18.638266 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:18.638564 (+ 298us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:44:18.638991 (+ 427us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:44:18.639104 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:18.639170 (+ 66us) server_negotiation.cc:299] Negotiation successful
0808 04:44:18.639224 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 04:44:18.645448 11938 raft_consensus.cc:1261] T bfa78b9b63a54511aa131c073141799c P 47b895e051fa4071b32415132bfcd49d [term 1 FOLLOWER]: Refusing update from remote peer bb996c652c43417295f04135ae2ce566: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:44:18.645454 11713 raft_consensus.cc:1261] T bfa78b9b63a54511aa131c073141799c P 6ef38c6c77e047be8627fb8b646f4484 [term 1 FOLLOWER]: Refusing update from remote peer bb996c652c43417295f04135ae2ce566: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:44:18.646281 12280 consensus_queue.cc:1035] T bfa78b9b63a54511aa131c073141799c P bb996c652c43417295f04135ae2ce566 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ef38c6c77e047be8627fb8b646f4484" member_type: VOTER last_known_addr { host: "127.12.148.65" port: 38439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:44:18.646508 12272 consensus_queue.cc:1035] T bfa78b9b63a54511aa131c073141799c P bb996c652c43417295f04135ae2ce566 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b895e051fa4071b32415132bfcd49d" member_type: VOTER last_known_addr { host: "127.12.148.66" port: 36247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:44:18.664203 11471 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37624:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:44:18.664381 11471 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37624:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 04:44:18.666725 11471 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 428270e9b0ca41bf86cab0f2971b9fc6: Sending DeleteTablet for 3 replicas of tablet bfa78b9b63a54511aa131c073141799c
I20260808 04:44:18.667563 12111 tablet_service.cc:1514] Processing DeleteTablet for tablet bfa78b9b63a54511aa131c073141799c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:44:18 UTC) from {username='slave'} at 127.0.0.1:36890
I20260808 04:44:18.667603 11906 tablet_service.cc:1514] Processing DeleteTablet for tablet bfa78b9b63a54511aa131c073141799c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:44:18 UTC) from {username='slave'} at 127.0.0.1:51794
I20260808 04:44:18.668140 11675 tablet_service.cc:1514] Processing DeleteTablet for tablet bfa78b9b63a54511aa131c073141799c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 04:44:18 UTC) from {username='slave'} at 127.0.0.1:36414
I20260808 04:44:18.668226 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 11574
I20260808 04:44:18.668883 12300 tablet_replica.cc:330] T bfa78b9b63a54511aa131c073141799c P 47b895e051fa4071b32415132bfcd49d: stopping tablet replica
I20260808 04:44:18.669313 12300 raft_consensus.cc:2229] T bfa78b9b63a54511aa131c073141799c P 47b895e051fa4071b32415132bfcd49d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 04:44:18.671057 12300 raft_consensus.cc:2258] T bfa78b9b63a54511aa131c073141799c P 47b895e051fa4071b32415132bfcd49d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:44:18.671530 12299 tablet_replica.cc:330] T bfa78b9b63a54511aa131c073141799c P bb996c652c43417295f04135ae2ce566: stopping tablet replica
I20260808 04:44:18.671900 12299 raft_consensus.cc:2229] T bfa78b9b63a54511aa131c073141799c P bb996c652c43417295f04135ae2ce566 [term 1 LEADER]: Raft consensus shutting down.
I20260808 04:44:18.672391 12299 raft_consensus.cc:2258] T bfa78b9b63a54511aa131c073141799c P bb996c652c43417295f04135ae2ce566 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 04:44:18.676434 12300 ts_tablet_manager.cc:1905] T bfa78b9b63a54511aa131c073141799c P 47b895e051fa4071b32415132bfcd49d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:44:18.679230 12300 ts_tablet_manager.cc:1918] T bfa78b9b63a54511aa131c073141799c P 47b895e051fa4071b32415132bfcd49d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:44:18.679333 12300 log.cc:1196] T bfa78b9b63a54511aa131c073141799c P 47b895e051fa4071b32415132bfcd49d: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-1/wal/wals/bfa78b9b63a54511aa131c073141799c
I20260808 04:44:18.679567 12300 ts_tablet_manager.cc:1939] T bfa78b9b63a54511aa131c073141799c P 47b895e051fa4071b32415132bfcd49d: Deleting consensus metadata
I20260808 04:44:18.682026 11446 catalog_manager.cc:4841] TS 47b895e051fa4071b32415132bfcd49d (127.12.148.66:36247): tablet bfa78b9b63a54511aa131c073141799c (table test-table [id=b0b3c363e01e4ee0aeb3f7954aec509e]) successfully deleted
I20260808 04:44:18.682179 12299 ts_tablet_manager.cc:1905] T bfa78b9b63a54511aa131c073141799c P bb996c652c43417295f04135ae2ce566: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 04:44:18.684906 12299 ts_tablet_manager.cc:1918] T bfa78b9b63a54511aa131c073141799c P bb996c652c43417295f04135ae2ce566: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 04:44:18.685045 12299 log.cc:1196] T bfa78b9b63a54511aa131c073141799c P bb996c652c43417295f04135ae2ce566: Deleting WAL directory at /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786164004017495-12881-0/minicluster-data/ts-2/wal/wals/bfa78b9b63a54511aa131c073141799c
I20260808 04:44:18.685341 12299 ts_tablet_manager.cc:1939] T bfa78b9b63a54511aa131c073141799c P bb996c652c43417295f04135ae2ce566: Deleting consensus metadata
I20260808 04:44:18.686683 11446 catalog_manager.cc:4841] TS bb996c652c43417295f04135ae2ce566 (127.12.148.67:41089): tablet bfa78b9b63a54511aa131c073141799c (table test-table [id=b0b3c363e01e4ee0aeb3f7954aec509e]) successfully deleted
W20260808 04:44:18.688799 11449 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.148.65:38439 (error 108)
I20260808 04:44:18.689606 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 11799
I20260808 04:44:18.689919 12254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:18.689612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.65:38439 (local address 127.0.0.1:36426)
0808 04:44:18.689766 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:18.689836 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.65:38439: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260808 04:44:18.702205 11449 catalog_manager.cc:4584] TS 6ef38c6c77e047be8627fb8b646f4484 (127.12.148.65:38439): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet bfa78b9b63a54511aa131c073141799c: Network error: Client connection negotiation failed: client connection to 127.12.148.65:38439: connect: Connection refused (error 111)
I20260808 04:44:18.720507 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 12013
I20260808 04:44:18.734767 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 11418
2026-08-08T04:44:18Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1099 ms)
[----------] 6 tests from EncryptionPolicyTest (10736 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164004017495-12881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:18 dist-test-slave-t7g5 krb5kdc[12307](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:18 dist-test-slave-t7g5 krb5kdc[12307](info): set up 2 sockets
Aug 08 04:44:18 dist-test-slave-t7g5 krb5kdc[12307](info): commencing operation
krb5kdc: starting...
W20260808 04:44:19.919234 12881 mini_kdc.cc:121] Time spent starting KDC: real 1.154s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Aug 08 04:44:20 dist-test-slave-t7g5 krb5kdc[12307](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164260, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 04:44:20.049319 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38959
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38959
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:20.162459 12330 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:20.162727 12330 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:20.162784 12330 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:20.166723 12330 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:20.166782 12330 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:20.166810 12330 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:20.166831 12330 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:20.166857 12330 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:20.171942 12330 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38959
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38959
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12330
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:20.172986 12330 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:20.174064 12330 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:20.182392 12341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:20.182405 12343 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:20.182405 12340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:20.182950 12330 server_base.cc:1034] running on GCE node
I20260808 04:44:20.183559 12330 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:20.184705 12330 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:20.185864 12330 hybrid_clock.cc:648] HybridClock initialized: now 1786164260185840 us; error 40 us; skew 500 ppm
Aug 08 04:44:20 dist-test-slave-t7g5 krb5kdc[12307](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164260, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:20.188696 12330 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 04:44:20.189884 12330 webserver.cc:460] Webserver started at http://127.0.0.1:35163/ using document root <none> and password file <none>
I20260808 04:44:20.190588 12330 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:20.190680 12330 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:20.190929 12330 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:20.193733 12330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "eddeceff7ee14ed29ccfad59e5e975ce"
format_stamp: "Formatted at 2026-08-08 04:44:20 on dist-test-slave-t7g5"
server_key: "0d4996dfb35ccca5ef82f63774465011"
server_key_iv: "7d9b5e071f5d6de09acccf39043386b0"
server_key_version: "encryptionkey@0"
I20260808 04:44:20.194370 12330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "eddeceff7ee14ed29ccfad59e5e975ce"
format_stamp: "Formatted at 2026-08-08 04:44:20 on dist-test-slave-t7g5"
server_key: "0d4996dfb35ccca5ef82f63774465011"
server_key_iv: "7d9b5e071f5d6de09acccf39043386b0"
server_key_version: "encryptionkey@0"
I20260808 04:44:20.198314 12330 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 04:44:20.200762 12355 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:20.202150 12330 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:44:20.202266 12330 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "eddeceff7ee14ed29ccfad59e5e975ce"
format_stamp: "Formatted at 2026-08-08 04:44:20 on dist-test-slave-t7g5"
server_key: "0d4996dfb35ccca5ef82f63774465011"
server_key_iv: "7d9b5e071f5d6de09acccf39043386b0"
server_key_version: "encryptionkey@0"
I20260808 04:44:20.202379 12330 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:20.232767 12330 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:20.236058 12330 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:20.236250 12330 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:20.243252 12330 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38959
I20260808 04:44:20.243269 12436 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38959 every 8 connection(s)
I20260808 04:44:20.244230 12330 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:20.246721 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 12330
I20260808 04:44:20.246858 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:44:20.247150 12881 external_mini_cluster.cc:1428] Setting key 2763bcf59976e68fc5a8dc1d5e6c7a3b
I20260808 04:44:20.247359 12439 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:20.254841 12439 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eddeceff7ee14ed29ccfad59e5e975ce: Bootstrap starting.
Aug 08 04:44:20 dist-test-slave-t7g5 krb5kdc[12307](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164260, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 04:44:20.257369 12439 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eddeceff7ee14ed29ccfad59e5e975ce: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:20.258380 12439 log.cc:824] T 00000000000000000000000000000000 P eddeceff7ee14ed29ccfad59e5e975ce: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:20.260828 12439 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eddeceff7ee14ed29ccfad59e5e975ce: No bootstrap required, opened a new log
I20260808 04:44:20.262930 12443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:20.248642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52215 (local address 127.0.0.1:38959)
0808 04:44:20.249089 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:20.249113 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:20.249156 (+ 43us) server_negotiation.cc:407] Connection header received
0808 04:44:20.250131 (+ 975us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:20.250157 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:20.250611 (+ 454us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:20.251004 (+ 393us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:20.251690 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:20.253171 (+ 1481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:20.254065 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:20.254750 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:20.254925 (+ 175us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:20.257512 (+ 2587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:20.257518 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:20.257535 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:20.257570 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:20.259455 (+ 1885us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:20.259979 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:20.259985 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:20.259990 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:20.260136 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:20.260407 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:20.260410 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:20.260411 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:20.260959 (+ 548us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:20.261174 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:20.261412 (+ 238us) server_negotiation.cc:299] Negotiation successful
0808 04:44:20.261690 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":120,"threads_started":1}
I20260808 04:44:20.264559 12439 raft_consensus.cc:348] T 00000000000000000000000000000000 P eddeceff7ee14ed29ccfad59e5e975ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eddeceff7ee14ed29ccfad59e5e975ce" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38959 } }
I20260808 04:44:20.264833 12439 raft_consensus.cc:374] T 00000000000000000000000000000000 P eddeceff7ee14ed29ccfad59e5e975ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:20.264940 12439 raft_consensus.cc:729] T 00000000000000000000000000000000 P eddeceff7ee14ed29ccfad59e5e975ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eddeceff7ee14ed29ccfad59e5e975ce, State: Initialized, Role: FOLLOWER
I20260808 04:44:20.265416 12439 consensus_queue.cc:260] T 00000000000000000000000000000000 P eddeceff7ee14ed29ccfad59e5e975ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eddeceff7ee14ed29ccfad59e5e975ce" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38959 } }
I20260808 04:44:20.265563 12439 raft_consensus.cc:388] T 00000000000000000000000000000000 P eddeceff7ee14ed29ccfad59e5e975ce [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:20.265628 12439 raft_consensus.cc:482] T 00000000000000000000000000000000 P eddeceff7ee14ed29ccfad59e5e975ce [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:20.265753 12439 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eddeceff7ee14ed29ccfad59e5e975ce [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:20.265923 12881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:44:20.266955 12439 raft_consensus.cc:504] T 00000000000000000000000000000000 P eddeceff7ee14ed29ccfad59e5e975ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eddeceff7ee14ed29ccfad59e5e975ce" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38959 } }
I20260808 04:44:20.267355 12439 leader_election.cc:302] T 00000000000000000000000000000000 P eddeceff7ee14ed29ccfad59e5e975ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eddeceff7ee14ed29ccfad59e5e975ce; no voters:
I20260808 04:44:20.267725 12439 leader_election.cc:288] T 00000000000000000000000000000000 P eddeceff7ee14ed29ccfad59e5e975ce [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:20.267804 12452 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eddeceff7ee14ed29ccfad59e5e975ce [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:20.268028 12452 raft_consensus.cc:686] T 00000000000000000000000000000000 P eddeceff7ee14ed29ccfad59e5e975ce [term 1 LEADER]: Becoming Leader. State: Replica: eddeceff7ee14ed29ccfad59e5e975ce, State: Running, Role: LEADER
I20260808 04:44:20.268355 12452 consensus_queue.cc:237] T 00000000000000000000000000000000 P eddeceff7ee14ed29ccfad59e5e975ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eddeceff7ee14ed29ccfad59e5e975ce" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38959 } }
I20260808 04:44:20.269099 12439 sys_catalog.cc:564] T 00000000000000000000000000000000 P eddeceff7ee14ed29ccfad59e5e975ce [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:20.269604 12452 sys_catalog.cc:455] T 00000000000000000000000000000000 P eddeceff7ee14ed29ccfad59e5e975ce [sys.catalog]: SysCatalogTable state changed. Reason: New leader eddeceff7ee14ed29ccfad59e5e975ce. Latest consensus state: current_term: 1 leader_uuid: "eddeceff7ee14ed29ccfad59e5e975ce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eddeceff7ee14ed29ccfad59e5e975ce" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38959 } } }
I20260808 04:44:20.269865 12452 sys_catalog.cc:458] T 00000000000000000000000000000000 P eddeceff7ee14ed29ccfad59e5e975ce [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:20.270037 12453 sys_catalog.cc:455] T 00000000000000000000000000000000 P eddeceff7ee14ed29ccfad59e5e975ce [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eddeceff7ee14ed29ccfad59e5e975ce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eddeceff7ee14ed29ccfad59e5e975ce" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38959 } } }
I20260808 04:44:20.270205 12453 sys_catalog.cc:458] T 00000000000000000000000000000000 P eddeceff7ee14ed29ccfad59e5e975ce [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:20.270673 12465 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:20.274087 12465 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:20.278267 12443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:20.268521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46193 (local address 127.0.0.1:38959)
0808 04:44:20.268619 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:20.268623 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:20.268635 (+ 12us) server_negotiation.cc:407] Connection header received
0808 04:44:20.268669 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:20.268671 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:20.268712 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:20.268788 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:20.270455 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:20.271257 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:20.272350 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:20.272677 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:20.272781 (+ 104us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:20.274515 (+ 1734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:20.274519 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:20.274521 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:20.274548 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:20.276296 (+ 1748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:20.276834 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:20.276837 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:20.276839 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:20.276930 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:20.277281 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:20.277284 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:20.277286 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:20.277532 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:20.277723 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:20.278020 (+ 297us) server_negotiation.cc:299] Negotiation successful
0808 04:44:20.278112 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":37}
I20260808 04:44:20.279856 12465 catalog_manager.cc:1347] Generated new cluster ID: 2a57c39cd0c043249bb6a36ab6444a2f
I20260808 04:44:20.279909 12465 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:20.292935 12465 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:20.293926 12465 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:20.299145 12465 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eddeceff7ee14ed29ccfad59e5e975ce: Generated new TSK 0
I20260808 04:44:20.299801 12465 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:44:20.304754 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 12330
W20260808 04:44:20.322912 12305 connection.cc:535] client connection to 127.0.0.1:38959 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38959): Connection reset by peer (error 104)
2026-08-08T04:44:20Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1571 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164004017495-12881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:20 dist-test-slave-t7g5 krb5kdc[12492](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:20 dist-test-slave-t7g5 krb5kdc[12492](info): set up 2 sockets
Aug 08 04:44:20 dist-test-slave-t7g5 krb5kdc[12492](info): commencing operation
krb5kdc: starting...
W20260808 04:44:21.463943 12881 mini_kdc.cc:121] Time spent starting KDC: real 1.127s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Aug 08 04:44:21 dist-test-slave-t7g5 krb5kdc[12492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164261, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 04:44:21.588573 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33439
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33439
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:21.701514 12515 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:21.701876 12515 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:21.701956 12515 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:21.705996 12515 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:21.706063 12515 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:21.706089 12515 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:21.706108 12515 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:21.706130 12515 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:21.711535 12515 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33439
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33439
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12515
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:21.712604 12515 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:21.713617 12515 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:21.722048 12524 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:21.722096 12530 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:21.722014 12523 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:21.722361 12515 server_base.cc:1034] running on GCE node
I20260808 04:44:21.722946 12515 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:21.724099 12515 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:21.725302 12515 hybrid_clock.cc:648] HybridClock initialized: now 1786164261725264 us; error 54 us; skew 500 ppm
Aug 08 04:44:21 dist-test-slave-t7g5 krb5kdc[12492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164261, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:21.728174 12515 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 04:44:21.729125 12515 webserver.cc:460] Webserver started at http://127.0.0.1:36897/ using document root <none> and password file <none>
I20260808 04:44:21.729727 12515 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:21.729813 12515 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:21.730034 12515 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:21.732095 12515 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "3b045723b7024259b1f5b514cafbe69b"
format_stamp: "Formatted at 2026-08-08 04:44:21 on dist-test-slave-t7g5"
server_key: "f1ccd917535ef2ddbeb47788e08c9970"
server_key_iv: "79c9d408b0be12b502b0b02d3c60b4b3"
server_key_version: "encryptionkey@0"
I20260808 04:44:21.732657 12515 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "3b045723b7024259b1f5b514cafbe69b"
format_stamp: "Formatted at 2026-08-08 04:44:21 on dist-test-slave-t7g5"
server_key: "f1ccd917535ef2ddbeb47788e08c9970"
server_key_iv: "79c9d408b0be12b502b0b02d3c60b4b3"
server_key_version: "encryptionkey@0"
I20260808 04:44:21.736479 12515 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 04:44:21.739005 12538 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:21.740255 12515 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 04:44:21.740394 12515 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "3b045723b7024259b1f5b514cafbe69b"
format_stamp: "Formatted at 2026-08-08 04:44:21 on dist-test-slave-t7g5"
server_key: "f1ccd917535ef2ddbeb47788e08c9970"
server_key_iv: "79c9d408b0be12b502b0b02d3c60b4b3"
server_key_version: "encryptionkey@0"
I20260808 04:44:21.740499 12515 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:21.756073 12515 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:21.758936 12515 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:21.759122 12515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:21.765856 12515 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33439
I20260808 04:44:21.765892 12621 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33439 every 8 connection(s)
I20260808 04:44:21.766794 12515 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:21.769503 12623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:21.775295 12623 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b045723b7024259b1f5b514cafbe69b: Bootstrap starting.
I20260808 04:44:21.775345 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 12515
I20260808 04:44:21.775489 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:44:21.775794 12881 external_mini_cluster.cc:1428] Setting key dbe6f33d7974d8f7949e5da2caa6b35a
I20260808 04:44:21.778041 12623 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3b045723b7024259b1f5b514cafbe69b: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:21.778766 12623 log.cc:824] T 00000000000000000000000000000000 P 3b045723b7024259b1f5b514cafbe69b: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:21.780617 12623 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b045723b7024259b1f5b514cafbe69b: No bootstrap required, opened a new log
I20260808 04:44:21.784322 12623 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3b045723b7024259b1f5b514cafbe69b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b045723b7024259b1f5b514cafbe69b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33439 } }
I20260808 04:44:21.784559 12626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:21.777198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56603 (local address 127.0.0.1:33439)
0808 04:44:21.777641 (+ 443us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:21.777676 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:21.777718 (+ 42us) server_negotiation.cc:407] Connection header received
0808 04:44:21.778388 (+ 670us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:21.778407 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:21.778759 (+ 352us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:21.779083 (+ 324us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:21.779498 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:21.780457 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:21.781352 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:21.781876 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:21.782029 (+ 153us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:21.782917 (+ 888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:21.782923 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:21.782935 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:21.783316 (+ 381us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:21.783373 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:21.783396 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:21.783515 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:21.783700 (+ 185us) server_negotiation.cc:299] Negotiation successful
0808 04:44:21.783841 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":297,"thread_start_us":140,"threads_started":1}
I20260808 04:44:21.784564 12623 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3b045723b7024259b1f5b514cafbe69b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:21.784688 12623 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3b045723b7024259b1f5b514cafbe69b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b045723b7024259b1f5b514cafbe69b, State: Initialized, Role: FOLLOWER
I20260808 04:44:21.785168 12623 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3b045723b7024259b1f5b514cafbe69b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b045723b7024259b1f5b514cafbe69b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33439 } }
I20260808 04:44:21.785346 12623 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3b045723b7024259b1f5b514cafbe69b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:21.785413 12623 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3b045723b7024259b1f5b514cafbe69b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:21.785509 12623 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3b045723b7024259b1f5b514cafbe69b [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:21.786499 12623 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3b045723b7024259b1f5b514cafbe69b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b045723b7024259b1f5b514cafbe69b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33439 } }
I20260808 04:44:21.786844 12623 leader_election.cc:302] T 00000000000000000000000000000000 P 3b045723b7024259b1f5b514cafbe69b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3b045723b7024259b1f5b514cafbe69b; no voters:
I20260808 04:44:21.787186 12623 leader_election.cc:288] T 00000000000000000000000000000000 P 3b045723b7024259b1f5b514cafbe69b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:21.787282 12628 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3b045723b7024259b1f5b514cafbe69b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:21.787508 12628 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3b045723b7024259b1f5b514cafbe69b [term 1 LEADER]: Becoming Leader. State: Replica: 3b045723b7024259b1f5b514cafbe69b, State: Running, Role: LEADER
I20260808 04:44:21.787537 12881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:44:21.787874 12628 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3b045723b7024259b1f5b514cafbe69b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b045723b7024259b1f5b514cafbe69b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33439 } }
I20260808 04:44:21.788520 12623 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3b045723b7024259b1f5b514cafbe69b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:21.788990 12628 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b045723b7024259b1f5b514cafbe69b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3b045723b7024259b1f5b514cafbe69b. Latest consensus state: current_term: 1 leader_uuid: "3b045723b7024259b1f5b514cafbe69b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b045723b7024259b1f5b514cafbe69b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33439 } } }
I20260808 04:44:21.789182 12628 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b045723b7024259b1f5b514cafbe69b [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:21.789395 12629 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b045723b7024259b1f5b514cafbe69b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3b045723b7024259b1f5b514cafbe69b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b045723b7024259b1f5b514cafbe69b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33439 } } }
I20260808 04:44:21.789633 12629 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b045723b7024259b1f5b514cafbe69b [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:21.789633 12644 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:21.793684 12644 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:21.795145 12626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:21.790048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57887 (local address 127.0.0.1:33439)
0808 04:44:21.790157 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:21.790161 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:21.790783 (+ 622us) server_negotiation.cc:407] Connection header received
0808 04:44:21.790961 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:21.790964 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:21.791016 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:21.791096 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:21.791409 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:21.792164 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:21.793204 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:21.793534 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:21.793630 (+ 96us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:21.794516 (+ 886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:21.794520 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:21.794523 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:21.794537 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:21.794567 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:21.794580 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:21.794658 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:21.795000 (+ 342us) server_negotiation.cc:299] Negotiation successful
0808 04:44:21.795036 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 04:44:21.799180 12644 catalog_manager.cc:1347] Generated new cluster ID: ff5756833bb8443ab4d45f51df2811e8
I20260808 04:44:21.799257 12644 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:21.844194 12644 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:21.845515 12644 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:21.854050 12644 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3b045723b7024259b1f5b514cafbe69b: Generated new TSK 0
I20260808 04:44:21.854734 12644 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:44:21.859052 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 12515
W20260808 04:44:21.875487 12490 connection.cc:535] client connection to 127.0.0.1:33439 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33439): Connection reset by peer (error 104)
2026-08-08T04:44:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1552 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164004017495-12881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:21 dist-test-slave-t7g5 krb5kdc[12669](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:21 dist-test-slave-t7g5 krb5kdc[12669](info): set up 2 sockets
Aug 08 04:44:21 dist-test-slave-t7g5 krb5kdc[12669](info): commencing operation
krb5kdc: starting...
W20260808 04:44:23.032279 12881 mini_kdc.cc:121] Time spent starting KDC: real 1.143s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Aug 08 04:44:23 dist-test-slave-t7g5 krb5kdc[12669](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164263, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 04:44:23.158622 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35431
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35431
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:23.271682 12692 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:23.271956 12692 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:23.272017 12692 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:23.275936 12692 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:23.275993 12692 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:23.276021 12692 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:23.276043 12692 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:23.276072 12692 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:23.281073 12692 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35431
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35431
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12692
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:23.282123 12692 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:23.283106 12692 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:23.291316 12699 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:23.291324 12698 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:23.291312 12701 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:23.291553 12692 server_base.cc:1034] running on GCE node
I20260808 04:44:23.292323 12692 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:23.293421 12692 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:23.294586 12692 hybrid_clock.cc:648] HybridClock initialized: now 1786164263294558 us; error 39 us; skew 500 ppm
Aug 08 04:44:23 dist-test-slave-t7g5 krb5kdc[12669](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164263, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:23.300920 12692 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 04:44:23.302029 12692 webserver.cc:460] Webserver started at http://127.0.0.1:36761/ using document root <none> and password file <none>
I20260808 04:44:23.302675 12692 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:23.302753 12692 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:23.302963 12692 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:23.305200 12692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "16b936f47ccc4c79b4bb97e7677d265e"
format_stamp: "Formatted at 2026-08-08 04:44:23 on dist-test-slave-t7g5"
server_key: "9221a26d2dc318a51718dc6927cb2af7"
server_key_iv: "e864991cab3234d0cfc0e0b5fc5af14b"
server_key_version: "encryptionkey@0"
I20260808 04:44:23.305824 12692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "16b936f47ccc4c79b4bb97e7677d265e"
format_stamp: "Formatted at 2026-08-08 04:44:23 on dist-test-slave-t7g5"
server_key: "9221a26d2dc318a51718dc6927cb2af7"
server_key_iv: "e864991cab3234d0cfc0e0b5fc5af14b"
server_key_version: "encryptionkey@0"
I20260808 04:44:23.309824 12692 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 04:44:23.312446 12711 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:23.313758 12692 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:44:23.313889 12692 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "16b936f47ccc4c79b4bb97e7677d265e"
format_stamp: "Formatted at 2026-08-08 04:44:23 on dist-test-slave-t7g5"
server_key: "9221a26d2dc318a51718dc6927cb2af7"
server_key_iv: "e864991cab3234d0cfc0e0b5fc5af14b"
server_key_version: "encryptionkey@0"
I20260808 04:44:23.313999 12692 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:23.318758 12692 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:23.322017 12692 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:23.322193 12692 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:23.329196 12692 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35431
I20260808 04:44:23.329263 12783 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35431 every 8 connection(s)
I20260808 04:44:23.330224 12692 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:23.332993 12784 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:23.335495 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 12692
I20260808 04:44:23.335624 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:44:23.335877 12881 external_mini_cluster.cc:1428] Setting key b80b884707e9328f3d32f6430de100dd
I20260808 04:44:23.339365 12784 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16b936f47ccc4c79b4bb97e7677d265e: Bootstrap starting.
I20260808 04:44:23.341475 12788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:23.337295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59795 (local address 127.0.0.1:35431)
0808 04:44:23.337790 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:23.337810 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:23.337852 (+ 42us) server_negotiation.cc:407] Connection header received
0808 04:44:23.338664 (+ 812us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:23.338687 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:23.339059 (+ 372us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:23.339420 (+ 361us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:23.340108 (+ 688us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:23.340114 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:23.340128 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:23.340139 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:23.340198 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:23.340223 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:23.340348 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:23.340418 (+ 70us) server_negotiation.cc:299] Negotiation successful
0808 04:44:23.340576 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":137,"threads_started":1}
I20260808 04:44:23.342072 12784 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 16b936f47ccc4c79b4bb97e7677d265e: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:23.342902 12784 log.cc:824] T 00000000000000000000000000000000 P 16b936f47ccc4c79b4bb97e7677d265e: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:23.344295 12881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:44:23.344990 12784 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16b936f47ccc4c79b4bb97e7677d265e: No bootstrap required, opened a new log
I20260808 04:44:23.347833 12788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:23.346313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55253 (local address 127.0.0.1:35431)
0808 04:44:23.346418 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:23.346423 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:23.346616 (+ 193us) server_negotiation.cc:407] Connection header received
0808 04:44:23.346739 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:23.346742 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:23.346774 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:23.346832 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:23.347477 (+ 645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:23.347480 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:23.347483 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:23.347495 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:23.347524 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:23.347535 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:23.347604 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:23.347680 (+ 76us) server_negotiation.cc:299] Negotiation successful
0808 04:44:23.347720 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 04:44:23.348978 12784 raft_consensus.cc:348] T 00000000000000000000000000000000 P 16b936f47ccc4c79b4bb97e7677d265e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16b936f47ccc4c79b4bb97e7677d265e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35431 } }
I20260808 04:44:23.349200 12784 raft_consensus.cc:374] T 00000000000000000000000000000000 P 16b936f47ccc4c79b4bb97e7677d265e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:23.349251 12784 raft_consensus.cc:729] T 00000000000000000000000000000000 P 16b936f47ccc4c79b4bb97e7677d265e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16b936f47ccc4c79b4bb97e7677d265e, State: Initialized, Role: FOLLOWER
I20260808 04:44:23.349675 12784 consensus_queue.cc:260] T 00000000000000000000000000000000 P 16b936f47ccc4c79b4bb97e7677d265e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16b936f47ccc4c79b4bb97e7677d265e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35431 } }
I20260808 04:44:23.349817 12784 raft_consensus.cc:388] T 00000000000000000000000000000000 P 16b936f47ccc4c79b4bb97e7677d265e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:23.349879 12784 raft_consensus.cc:482] T 00000000000000000000000000000000 P 16b936f47ccc4c79b4bb97e7677d265e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:23.349980 12784 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 16b936f47ccc4c79b4bb97e7677d265e [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:23.351013 12784 raft_consensus.cc:504] T 00000000000000000000000000000000 P 16b936f47ccc4c79b4bb97e7677d265e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16b936f47ccc4c79b4bb97e7677d265e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35431 } }
I20260808 04:44:23.351310 12784 leader_election.cc:302] T 00000000000000000000000000000000 P 16b936f47ccc4c79b4bb97e7677d265e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 16b936f47ccc4c79b4bb97e7677d265e; no voters:
I20260808 04:44:23.351562 12784 leader_election.cc:288] T 00000000000000000000000000000000 P 16b936f47ccc4c79b4bb97e7677d265e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:23.351668 12806 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 16b936f47ccc4c79b4bb97e7677d265e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:23.351881 12806 raft_consensus.cc:686] T 00000000000000000000000000000000 P 16b936f47ccc4c79b4bb97e7677d265e [term 1 LEADER]: Becoming Leader. State: Replica: 16b936f47ccc4c79b4bb97e7677d265e, State: Running, Role: LEADER
I20260808 04:44:23.352218 12806 consensus_queue.cc:237] T 00000000000000000000000000000000 P 16b936f47ccc4c79b4bb97e7677d265e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16b936f47ccc4c79b4bb97e7677d265e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35431 } }
I20260808 04:44:23.352720 12784 sys_catalog.cc:564] T 00000000000000000000000000000000 P 16b936f47ccc4c79b4bb97e7677d265e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:23.353969 12810 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16b936f47ccc4c79b4bb97e7677d265e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 16b936f47ccc4c79b4bb97e7677d265e. Latest consensus state: current_term: 1 leader_uuid: "16b936f47ccc4c79b4bb97e7677d265e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16b936f47ccc4c79b4bb97e7677d265e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35431 } } }
I20260808 04:44:23.353969 12809 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16b936f47ccc4c79b4bb97e7677d265e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "16b936f47ccc4c79b4bb97e7677d265e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16b936f47ccc4c79b4bb97e7677d265e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35431 } } }
I20260808 04:44:23.354113 12810 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16b936f47ccc4c79b4bb97e7677d265e [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:23.354113 12809 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16b936f47ccc4c79b4bb97e7677d265e [sys.catalog]: This master's current role is: LEADER
W20260808 04:44:23.357519 12830 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 16b936f47ccc4c79b4bb97e7677d265e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 04:44:23.357605 12830 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 04:44:23.357685 12821 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:23.358368 12821 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:23.363739 12821 catalog_manager.cc:1347] Generated new cluster ID: 2f2275c103bc4428a99f3cd96113d048
I20260808 04:44:23.363809 12821 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:23.374868 12821 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:23.375139 12821 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:23.386884 12821 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 16b936f47ccc4c79b4bb97e7677d265e: Generated new TSK 0
I20260808 04:44:23.387526 12821 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:44:23.392977 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 12692
2026-08-08T04:44:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1533 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164004017495-12881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:23 dist-test-slave-t7g5 krb5kdc[12838](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:23 dist-test-slave-t7g5 krb5kdc[12838](info): set up 2 sockets
Aug 08 04:44:23 dist-test-slave-t7g5 krb5kdc[12838](info): commencing operation
krb5kdc: starting...
W20260808 04:44:24.557771 12881 mini_kdc.cc:121] Time spent starting KDC: real 1.135s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Aug 08 04:44:24 dist-test-slave-t7g5 krb5kdc[12838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164264, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 04:44:24.682700 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42117
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42117
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:24.796169 12857 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:24.796468 12857 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:24.796517 12857 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:24.800650 12857 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:24.800725 12857 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:24.800743 12857 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:24.800762 12857 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:24.800792 12857 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:24.806190 12857 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42117
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42117
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12857
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:24.807253 12857 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:24.808283 12857 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:24.816684 12868 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:24.816677 12865 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:24.816677 12866 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:24.816872 12857 server_base.cc:1034] running on GCE node
I20260808 04:44:24.817548 12857 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:24.818693 12857 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:24.819872 12857 hybrid_clock.cc:648] HybridClock initialized: now 1786164264819854 us; error 34 us; skew 500 ppm
Aug 08 04:44:24 dist-test-slave-t7g5 krb5kdc[12838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164264, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:24.822597 12857 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 04:44:24.823458 12857 webserver.cc:460] Webserver started at http://127.0.0.1:40589/ using document root <none> and password file <none>
I20260808 04:44:24.823971 12857 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:24.824028 12857 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:24.824198 12857 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:24.826223 12857 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "e7e64954e7af4cc4a89570ff8e58d16d"
format_stamp: "Formatted at 2026-08-08 04:44:24 on dist-test-slave-t7g5"
server_key: "38ac1b0b4921fce67683a6ecd84cc287"
server_key_iv: "dcfebafaebd4789148897af9798b8bad"
server_key_version: "encryptionkey@0"
I20260808 04:44:24.826736 12857 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "e7e64954e7af4cc4a89570ff8e58d16d"
format_stamp: "Formatted at 2026-08-08 04:44:24 on dist-test-slave-t7g5"
server_key: "38ac1b0b4921fce67683a6ecd84cc287"
server_key_iv: "dcfebafaebd4789148897af9798b8bad"
server_key_version: "encryptionkey@0"
I20260808 04:44:24.830318 12857 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 04:44:24.832605 12879 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:24.833837 12857 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:44:24.833971 12857 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "e7e64954e7af4cc4a89570ff8e58d16d"
format_stamp: "Formatted at 2026-08-08 04:44:24 on dist-test-slave-t7g5"
server_key: "38ac1b0b4921fce67683a6ecd84cc287"
server_key_iv: "dcfebafaebd4789148897af9798b8bad"
server_key_version: "encryptionkey@0"
I20260808 04:44:24.834065 12857 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:24.847440 12857 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:24.850297 12857 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:24.850493 12857 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:24.857196 12857 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42117
I20260808 04:44:24.857206 12982 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42117 every 8 connection(s)
I20260808 04:44:24.858131 12857 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:24.858736 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 12857
I20260808 04:44:24.858873 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:44:24.859175 12881 external_mini_cluster.cc:1428] Setting key 12863121630bd6cc5ca98cc6f266e8ad
I20260808 04:44:24.861233 12983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:24.867542 12983 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7e64954e7af4cc4a89570ff8e58d16d: Bootstrap starting.
Aug 08 04:44:24 dist-test-slave-t7g5 krb5kdc[12838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164264, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 04:44:24.869783 12983 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e7e64954e7af4cc4a89570ff8e58d16d: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:24.870545 12983 log.cc:824] T 00000000000000000000000000000000 P e7e64954e7af4cc4a89570ff8e58d16d: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:24.872382 12983 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7e64954e7af4cc4a89570ff8e58d16d: No bootstrap required, opened a new log
I20260808 04:44:24.872740 12988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:24.860480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44743 (local address 127.0.0.1:42117)
0808 04:44:24.860863 (+ 383us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:24.860878 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:24.860913 (+ 35us) server_negotiation.cc:407] Connection header received
0808 04:44:24.861577 (+ 664us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:24.861595 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:24.861954 (+ 359us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:24.862220 (+ 266us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:24.863049 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:24.864040 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:24.865166 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:24.865609 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:24.865773 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:24.868456 (+ 2683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:24.868462 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:24.868473 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:24.868499 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:24.870126 (+ 1627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:24.870533 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:24.870539 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:24.870545 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:24.870659 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:24.870914 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:24.870918 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:24.870920 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:24.871296 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:24.871465 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:24.871771 (+ 306us) server_negotiation.cc:299] Negotiation successful
0808 04:44:24.872049 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":253,"thread_start_us":114,"threads_started":1}
I20260808 04:44:24.875514 12881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:44:24.876194 12983 raft_consensus.cc:348] T 00000000000000000000000000000000 P e7e64954e7af4cc4a89570ff8e58d16d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7e64954e7af4cc4a89570ff8e58d16d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42117 } }
I20260808 04:44:24.876407 12983 raft_consensus.cc:374] T 00000000000000000000000000000000 P e7e64954e7af4cc4a89570ff8e58d16d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:24.876475 12983 raft_consensus.cc:729] T 00000000000000000000000000000000 P e7e64954e7af4cc4a89570ff8e58d16d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7e64954e7af4cc4a89570ff8e58d16d, State: Initialized, Role: FOLLOWER
I20260808 04:44:24.876899 12983 consensus_queue.cc:260] T 00000000000000000000000000000000 P e7e64954e7af4cc4a89570ff8e58d16d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7e64954e7af4cc4a89570ff8e58d16d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42117 } }
I20260808 04:44:24.877030 12983 raft_consensus.cc:388] T 00000000000000000000000000000000 P e7e64954e7af4cc4a89570ff8e58d16d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:24.877091 12983 raft_consensus.cc:482] T 00000000000000000000000000000000 P e7e64954e7af4cc4a89570ff8e58d16d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:24.877182 12983 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e7e64954e7af4cc4a89570ff8e58d16d [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:24.878104 12983 raft_consensus.cc:504] T 00000000000000000000000000000000 P e7e64954e7af4cc4a89570ff8e58d16d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7e64954e7af4cc4a89570ff8e58d16d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42117 } }
I20260808 04:44:24.878422 12983 leader_election.cc:302] T 00000000000000000000000000000000 P e7e64954e7af4cc4a89570ff8e58d16d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e7e64954e7af4cc4a89570ff8e58d16d; no voters:
I20260808 04:44:24.878715 12983 leader_election.cc:288] T 00000000000000000000000000000000 P e7e64954e7af4cc4a89570ff8e58d16d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:24.878778 12998 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e7e64954e7af4cc4a89570ff8e58d16d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:24.879004 12998 raft_consensus.cc:686] T 00000000000000000000000000000000 P e7e64954e7af4cc4a89570ff8e58d16d [term 1 LEADER]: Becoming Leader. State: Replica: e7e64954e7af4cc4a89570ff8e58d16d, State: Running, Role: LEADER
I20260808 04:44:24.879315 12998 consensus_queue.cc:237] T 00000000000000000000000000000000 P e7e64954e7af4cc4a89570ff8e58d16d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7e64954e7af4cc4a89570ff8e58d16d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42117 } }
I20260808 04:44:24.879963 12983 sys_catalog.cc:564] T 00000000000000000000000000000000 P e7e64954e7af4cc4a89570ff8e58d16d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:24.880837 13001 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7e64954e7af4cc4a89570ff8e58d16d [sys.catalog]: SysCatalogTable state changed. Reason: New leader e7e64954e7af4cc4a89570ff8e58d16d. Latest consensus state: current_term: 1 leader_uuid: "e7e64954e7af4cc4a89570ff8e58d16d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7e64954e7af4cc4a89570ff8e58d16d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42117 } } }
I20260808 04:44:24.880837 12999 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7e64954e7af4cc4a89570ff8e58d16d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e7e64954e7af4cc4a89570ff8e58d16d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7e64954e7af4cc4a89570ff8e58d16d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42117 } } }
I20260808 04:44:24.880971 12999 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7e64954e7af4cc4a89570ff8e58d16d [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:24.880970 13001 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7e64954e7af4cc4a89570ff8e58d16d [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:24.881467 13015 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:24.885116 13015 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:24.886394 12988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:24.877358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40687 (local address 127.0.0.1:42117)
0808 04:44:24.877462 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:24.877466 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:24.877805 (+ 339us) server_negotiation.cc:407] Connection header received
0808 04:44:24.877894 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:24.877897 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:24.877943 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:24.878025 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:24.878642 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:24.879363 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:24.880480 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:24.880813 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:24.880912 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:24.882638 (+ 1726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:24.882642 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:24.882644 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:24.882668 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:24.884228 (+ 1560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:24.884693 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:24.884696 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:24.884698 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:24.884793 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:24.885086 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:24.885089 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:24.885091 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:24.885308 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:24.886046 (+ 738us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:24.886128 (+ 82us) server_negotiation.cc:299] Negotiation successful
0808 04:44:24.886242 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 04:44:24.890736 13015 catalog_manager.cc:1347] Generated new cluster ID: dd870bad117b46c29e56989fd215413b
I20260808 04:44:24.890791 13015 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:24.900561 13015 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:24.901420 13015 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:24.907820 13015 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e7e64954e7af4cc4a89570ff8e58d16d: Generated new TSK 0
I20260808 04:44:24.908459 13015 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:44:24.912899 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 12857
2026-08-08T04:44:24Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1516 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164004017495-12881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:24 dist-test-slave-t7g5 krb5kdc[13035](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:24 dist-test-slave-t7g5 krb5kdc[13035](info): set up 2 sockets
Aug 08 04:44:24 dist-test-slave-t7g5 krb5kdc[13035](info): commencing operation
krb5kdc: starting...
W20260808 04:44:26.057531 12881 mini_kdc.cc:121] Time spent starting KDC: real 1.118s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Aug 08 04:44:26 dist-test-slave-t7g5 krb5kdc[13035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164266, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 04:44:26.180841 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43777
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43777
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:26.293697 13054 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:26.293968 13054 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:26.294008 13054 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:26.297977 13054 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:26.298035 13054 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:26.298053 13054 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:26.298069 13054 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:26.298089 13054 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:26.303261 13054 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43777
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43777
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13054
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:26.304229 13054 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:26.305225 13054 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:26.313570 13063 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:26.313709 13054 server_base.cc:1034] running on GCE node
W20260808 04:44:26.313565 13070 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:26.313570 13066 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:26.314366 13054 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:26.315572 13054 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:26.316749 13054 hybrid_clock.cc:648] HybridClock initialized: now 1786164266316721 us; error 44 us; skew 500 ppm
Aug 08 04:44:26 dist-test-slave-t7g5 krb5kdc[13035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164266, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:26.319697 13054 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 04:44:26.320694 13054 webserver.cc:460] Webserver started at http://127.0.0.1:32823/ using document root <none> and password file <none>
I20260808 04:44:26.321264 13054 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:26.321333 13054 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:26.321534 13054 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:26.323674 13054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "a12df2dd39ed4305aeef5af2c9068ed5"
format_stamp: "Formatted at 2026-08-08 04:44:26 on dist-test-slave-t7g5"
server_key: "00417b72e9d2dc70c53410314eb7527e"
server_key_iv: "8ba700077918a084eafc5da575e9d612"
server_key_version: "encryptionkey@0"
I20260808 04:44:26.324249 13054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "a12df2dd39ed4305aeef5af2c9068ed5"
format_stamp: "Formatted at 2026-08-08 04:44:26 on dist-test-slave-t7g5"
server_key: "00417b72e9d2dc70c53410314eb7527e"
server_key_iv: "8ba700077918a084eafc5da575e9d612"
server_key_version: "encryptionkey@0"
I20260808 04:44:26.328017 13054 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 04:44:26.330475 13083 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:26.331743 13054 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:44:26.331888 13054 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "a12df2dd39ed4305aeef5af2c9068ed5"
format_stamp: "Formatted at 2026-08-08 04:44:26 on dist-test-slave-t7g5"
server_key: "00417b72e9d2dc70c53410314eb7527e"
server_key_iv: "8ba700077918a084eafc5da575e9d612"
server_key_version: "encryptionkey@0"
I20260808 04:44:26.331987 13054 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:26.347096 13054 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:26.350071 13054 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:26.350277 13054 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:26.357573 13054 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43777
I20260808 04:44:26.357587 13162 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43777 every 8 connection(s)
I20260808 04:44:26.358570 13054 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:26.361534 13165 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:26.367237 13165 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a12df2dd39ed4305aeef5af2c9068ed5: Bootstrap starting.
I20260808 04:44:26.367493 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 13054
I20260808 04:44:26.367635 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:44:26.367924 12881 external_mini_cluster.cc:1428] Setting key 2a6b5158c3f8f65aef1e3a1b649d7854
I20260808 04:44:26.369974 13165 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a12df2dd39ed4305aeef5af2c9068ed5: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:26.370678 13165 log.cc:824] T 00000000000000000000000000000000 P a12df2dd39ed4305aeef5af2c9068ed5: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:26.372532 13165 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a12df2dd39ed4305aeef5af2c9068ed5: No bootstrap required, opened a new log
I20260808 04:44:26.376258 13165 raft_consensus.cc:348] T 00000000000000000000000000000000 P a12df2dd39ed4305aeef5af2c9068ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a12df2dd39ed4305aeef5af2c9068ed5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43777 } }
I20260808 04:44:26.376494 13165 raft_consensus.cc:374] T 00000000000000000000000000000000 P a12df2dd39ed4305aeef5af2c9068ed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:26.376555 13165 raft_consensus.cc:729] T 00000000000000000000000000000000 P a12df2dd39ed4305aeef5af2c9068ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a12df2dd39ed4305aeef5af2c9068ed5, State: Initialized, Role: FOLLOWER
I20260808 04:44:26.376914 13169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:26.369291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51817 (local address 127.0.0.1:43777)
0808 04:44:26.369754 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:26.369770 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:26.369806 (+ 36us) server_negotiation.cc:407] Connection header received
0808 04:44:26.370485 (+ 679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:26.370505 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:26.370876 (+ 371us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:26.371212 (+ 336us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:26.371645 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:26.372621 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:26.373586 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:26.374118 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:26.374271 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:26.375111 (+ 840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:26.375116 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:26.375129 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:26.375534 (+ 405us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:26.375589 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:26.375613 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:26.375704 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:26.375847 (+ 143us) server_negotiation.cc:299] Negotiation successful
0808 04:44:26.376061 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":132,"threads_started":1}
I20260808 04:44:26.376973 13165 consensus_queue.cc:260] T 00000000000000000000000000000000 P a12df2dd39ed4305aeef5af2c9068ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a12df2dd39ed4305aeef5af2c9068ed5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43777 } }
I20260808 04:44:26.377157 13165 raft_consensus.cc:388] T 00000000000000000000000000000000 P a12df2dd39ed4305aeef5af2c9068ed5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:26.377229 13165 raft_consensus.cc:482] T 00000000000000000000000000000000 P a12df2dd39ed4305aeef5af2c9068ed5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:26.377326 13165 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a12df2dd39ed4305aeef5af2c9068ed5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:26.378358 13165 raft_consensus.cc:504] T 00000000000000000000000000000000 P a12df2dd39ed4305aeef5af2c9068ed5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a12df2dd39ed4305aeef5af2c9068ed5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43777 } }
I20260808 04:44:26.378690 13165 leader_election.cc:302] T 00000000000000000000000000000000 P a12df2dd39ed4305aeef5af2c9068ed5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a12df2dd39ed4305aeef5af2c9068ed5; no voters:
I20260808 04:44:26.379065 13165 leader_election.cc:288] T 00000000000000000000000000000000 P a12df2dd39ed4305aeef5af2c9068ed5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:26.379128 13172 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a12df2dd39ed4305aeef5af2c9068ed5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:26.379374 13172 raft_consensus.cc:686] T 00000000000000000000000000000000 P a12df2dd39ed4305aeef5af2c9068ed5 [term 1 LEADER]: Becoming Leader. State: Replica: a12df2dd39ed4305aeef5af2c9068ed5, State: Running, Role: LEADER
I20260808 04:44:26.379719 13172 consensus_queue.cc:237] T 00000000000000000000000000000000 P a12df2dd39ed4305aeef5af2c9068ed5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a12df2dd39ed4305aeef5af2c9068ed5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43777 } }
I20260808 04:44:26.379909 12881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:44:26.380318 13165 sys_catalog.cc:564] T 00000000000000000000000000000000 P a12df2dd39ed4305aeef5af2c9068ed5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:26.381474 13174 sys_catalog.cc:455] T 00000000000000000000000000000000 P a12df2dd39ed4305aeef5af2c9068ed5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a12df2dd39ed4305aeef5af2c9068ed5. Latest consensus state: current_term: 1 leader_uuid: "a12df2dd39ed4305aeef5af2c9068ed5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a12df2dd39ed4305aeef5af2c9068ed5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43777 } } }
I20260808 04:44:26.381610 13174 sys_catalog.cc:458] T 00000000000000000000000000000000 P a12df2dd39ed4305aeef5af2c9068ed5 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:26.381973 13175 sys_catalog.cc:455] T 00000000000000000000000000000000 P a12df2dd39ed4305aeef5af2c9068ed5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a12df2dd39ed4305aeef5af2c9068ed5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a12df2dd39ed4305aeef5af2c9068ed5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43777 } } }
I20260808 04:44:26.382061 13175 sys_catalog.cc:458] T 00000000000000000000000000000000 P a12df2dd39ed4305aeef5af2c9068ed5 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:26.382525 13190 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:26.386111 13190 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:26.386705 13169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:26.382242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47357 (local address 127.0.0.1:43777)
0808 04:44:26.382342 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:26.382346 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:26.383115 (+ 769us) server_negotiation.cc:407] Connection header received
0808 04:44:26.383245 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:26.383248 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:26.383290 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:26.383355 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:26.383636 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:26.384132 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:26.385125 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:26.385376 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:26.385466 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:26.386304 (+ 838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:26.386316 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:26.386319 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:26.386332 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:26.386360 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:26.386371 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:26.386430 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:26.386529 (+ 99us) server_negotiation.cc:299] Negotiation successful
0808 04:44:26.386579 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 04:44:26.392449 13190 catalog_manager.cc:1347] Generated new cluster ID: ce283d102da249a6b716663c8212fd22
I20260808 04:44:26.392520 13190 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:26.409157 13190 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:26.410180 13190 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:26.422286 13190 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a12df2dd39ed4305aeef5af2c9068ed5: Generated new TSK 0
I20260808 04:44:26.423094 13190 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:44:26.431604 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 13054
2026-08-08T04:44:26Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1518 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164004017495-12881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:26 dist-test-slave-t7g5 krb5kdc[13216](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:26 dist-test-slave-t7g5 krb5kdc[13216](info): set up 2 sockets
Aug 08 04:44:26 dist-test-slave-t7g5 krb5kdc[13216](info): commencing operation
krb5kdc: starting...
W20260808 04:44:27.576118 12881 mini_kdc.cc:121] Time spent starting KDC: real 1.118s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Aug 08 04:44:27 dist-test-slave-t7g5 krb5kdc[13216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164267, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 04:44:27.698985 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36073
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35139
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36073
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:27.810563 13237 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:27.810842 13237 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:27.810904 13237 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:27.814870 13237 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:27.814934 13237 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:27.814960 13237 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:27.814980 13237 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:27.814999 13237 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:27.820241 13237 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35139
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36073
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36073
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13237
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:27.821267 13237 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:27.822273 13237 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:27.830704 13244 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:27.830747 13243 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:27.830709 13247 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:27.830917 13237 server_base.cc:1034] running on GCE node
I20260808 04:44:27.831619 13237 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:27.832731 13237 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:27.833879 13237 hybrid_clock.cc:648] HybridClock initialized: now 1786164267833850 us; error 47 us; skew 500 ppm
Aug 08 04:44:27 dist-test-slave-t7g5 krb5kdc[13216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164267, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:27.836541 13237 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 04:44:27.837446 13237 webserver.cc:460] Webserver started at http://127.0.0.1:40101/ using document root <none> and password file <none>
I20260808 04:44:27.838032 13237 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:27.838104 13237 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:27.838305 13237 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:27.840312 13237 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "f3b818870d114118bcedcb0b806fce9d"
format_stamp: "Formatted at 2026-08-08 04:44:27 on dist-test-slave-t7g5"
server_key: "d9e7c4cdd481524da9b6bf63a732f6c8"
server_key_iv: "d733e31ef0ec089418c75d407828d920"
server_key_version: "encryptionkey@0"
I20260808 04:44:27.840972 13237 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "f3b818870d114118bcedcb0b806fce9d"
format_stamp: "Formatted at 2026-08-08 04:44:27 on dist-test-slave-t7g5"
server_key: "d9e7c4cdd481524da9b6bf63a732f6c8"
server_key_iv: "d733e31ef0ec089418c75d407828d920"
server_key_version: "encryptionkey@0"
I20260808 04:44:27.844728 13237 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 04:44:27.847157 13258 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:27.848335 13237 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 04:44:27.848454 13237 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "f3b818870d114118bcedcb0b806fce9d"
format_stamp: "Formatted at 2026-08-08 04:44:27 on dist-test-slave-t7g5"
server_key: "d9e7c4cdd481524da9b6bf63a732f6c8"
server_key_iv: "d733e31ef0ec089418c75d407828d920"
server_key_version: "encryptionkey@0"
I20260808 04:44:27.848551 13237 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:27.853091 13237 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:27.856060 13237 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:27.856235 13237 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:27.863154 13237 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36073
I20260808 04:44:27.863162 13337 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36073 every 8 connection(s)
I20260808 04:44:27.864105 13237 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:27.865301 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 13237
I20260808 04:44:27.865439 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:44:27.865782 12881 external_mini_cluster.cc:1428] Setting key f3cdeee7feab7867839c95498d18dce2
I20260808 04:44:27.867340 13338 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:27.870790 13342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:27.867125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56291 (local address 127.0.0.1:36073)
0808 04:44:27.867529 (+ 404us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:27.867546 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:27.867584 (+ 38us) server_negotiation.cc:407] Connection header received
0808 04:44:27.868217 (+ 633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:27.868232 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:27.868514 (+ 282us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:27.868793 (+ 279us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:27.869598 (+ 805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:27.869602 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:27.869613 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:27.869623 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:27.869707 (+ 84us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:27.869730 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:27.869841 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:27.869948 (+ 107us) server_negotiation.cc:299] Negotiation successful
0808 04:44:27.870087 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":111,"threads_started":1}
I20260808 04:44:27.873502 12881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:44:27.873678 13338 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3b818870d114118bcedcb0b806fce9d: Bootstrap starting.
I20260808 04:44:27.876327 13338 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f3b818870d114118bcedcb0b806fce9d: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:27.877112 13338 log.cc:824] T 00000000000000000000000000000000 P f3b818870d114118bcedcb0b806fce9d: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:27.877243 13342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:27.875743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38465 (local address 127.0.0.1:36073)
0808 04:44:27.875854 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:27.875858 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:27.876065 (+ 207us) server_negotiation.cc:407] Connection header received
0808 04:44:27.876143 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:27.876146 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:27.876180 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:27.876262 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:27.876893 (+ 631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:27.876897 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:27.876900 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:27.876913 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:27.876950 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:27.876964 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:27.877047 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:27.877101 (+ 54us) server_negotiation.cc:299] Negotiation successful
0808 04:44:27.877139 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 04:44:27.879199 13338 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3b818870d114118bcedcb0b806fce9d: No bootstrap required, opened a new log
I20260808 04:44:27.882674 13338 raft_consensus.cc:348] T 00000000000000000000000000000000 P f3b818870d114118bcedcb0b806fce9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3b818870d114118bcedcb0b806fce9d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36073 } }
I20260808 04:44:27.882891 13338 raft_consensus.cc:374] T 00000000000000000000000000000000 P f3b818870d114118bcedcb0b806fce9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:27.882961 13338 raft_consensus.cc:729] T 00000000000000000000000000000000 P f3b818870d114118bcedcb0b806fce9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3b818870d114118bcedcb0b806fce9d, State: Initialized, Role: FOLLOWER
I20260808 04:44:27.883378 13338 consensus_queue.cc:260] T 00000000000000000000000000000000 P f3b818870d114118bcedcb0b806fce9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3b818870d114118bcedcb0b806fce9d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36073 } }
I20260808 04:44:27.883517 13338 raft_consensus.cc:388] T 00000000000000000000000000000000 P f3b818870d114118bcedcb0b806fce9d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:27.883582 13338 raft_consensus.cc:482] T 00000000000000000000000000000000 P f3b818870d114118bcedcb0b806fce9d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:27.883677 13338 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f3b818870d114118bcedcb0b806fce9d [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:27.884573 13338 raft_consensus.cc:504] T 00000000000000000000000000000000 P f3b818870d114118bcedcb0b806fce9d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3b818870d114118bcedcb0b806fce9d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36073 } }
I20260808 04:44:27.884953 13338 leader_election.cc:302] T 00000000000000000000000000000000 P f3b818870d114118bcedcb0b806fce9d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f3b818870d114118bcedcb0b806fce9d; no voters:
I20260808 04:44:27.885257 13338 leader_election.cc:288] T 00000000000000000000000000000000 P f3b818870d114118bcedcb0b806fce9d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:27.885346 13356 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f3b818870d114118bcedcb0b806fce9d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:27.885582 13356 raft_consensus.cc:686] T 00000000000000000000000000000000 P f3b818870d114118bcedcb0b806fce9d [term 1 LEADER]: Becoming Leader. State: Replica: f3b818870d114118bcedcb0b806fce9d, State: Running, Role: LEADER
I20260808 04:44:27.885885 13356 consensus_queue.cc:237] T 00000000000000000000000000000000 P f3b818870d114118bcedcb0b806fce9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3b818870d114118bcedcb0b806fce9d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36073 } }
I20260808 04:44:27.886418 13338 sys_catalog.cc:564] T 00000000000000000000000000000000 P f3b818870d114118bcedcb0b806fce9d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:27.887483 13358 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3b818870d114118bcedcb0b806fce9d [sys.catalog]: SysCatalogTable state changed. Reason: New leader f3b818870d114118bcedcb0b806fce9d. Latest consensus state: current_term: 1 leader_uuid: "f3b818870d114118bcedcb0b806fce9d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3b818870d114118bcedcb0b806fce9d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36073 } } }
I20260808 04:44:27.887506 13357 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3b818870d114118bcedcb0b806fce9d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f3b818870d114118bcedcb0b806fce9d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3b818870d114118bcedcb0b806fce9d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36073 } } }
I20260808 04:44:27.887610 13358 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3b818870d114118bcedcb0b806fce9d [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:27.887610 13357 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3b818870d114118bcedcb0b806fce9d [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:27.888048 13370 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:27.891247 13370 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:27.896749 13370 catalog_manager.cc:1347] Generated new cluster ID: 8f2c055b09dd489d93f46dbb849fcc3f
I20260808 04:44:27.896826 13370 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:27.922784 13370 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:27.923139 13370 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:27.929463 13370 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f3b818870d114118bcedcb0b806fce9d: Generated new TSK 0
I20260808 04:44:27.930308 13370 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:44:27.936836 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 13237
2026-08-08T04:44:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1503 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164004017495-12881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:27 dist-test-slave-t7g5 krb5kdc[13391](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:27 dist-test-slave-t7g5 krb5kdc[13391](info): set up 2 sockets
Aug 08 04:44:27 dist-test-slave-t7g5 krb5kdc[13391](info): commencing operation
krb5kdc: starting...
W20260808 04:44:29.091316 12881 mini_kdc.cc:121] Time spent starting KDC: real 1.129s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Aug 08 04:44:29 dist-test-slave-t7g5 krb5kdc[13391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164269, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 04:44:29.222297 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37183
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37183
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:29.333155 13415 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:29.333416 13415 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:29.333463 13415 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:29.337373 13415 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:29.337437 13415 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:29.337457 13415 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:29.337487 13415 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:29.337507 13415 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:29.342597 13415 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37183
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37183
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13415
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:29.343580 13415 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:29.344558 13415 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:29.353029 13430 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:29.353014 13436 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:29.353089 13431 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:29.353233 13415 server_base.cc:1034] running on GCE node
I20260808 04:44:29.354024 13415 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:29.355129 13415 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:29.356328 13415 hybrid_clock.cc:648] HybridClock initialized: now 1786164269356313 us; error 30 us; skew 500 ppm
Aug 08 04:44:29 dist-test-slave-t7g5 krb5kdc[13391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164269, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:29.359134 13415 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 04:44:29.360023 13415 webserver.cc:460] Webserver started at http://127.0.0.1:40031/ using document root <none> and password file <none>
I20260808 04:44:29.360566 13415 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:29.360633 13415 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:29.360818 13415 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:29.362915 13415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "fc749b13605044398b422b591b635fe0"
format_stamp: "Formatted at 2026-08-08 04:44:29 on dist-test-slave-t7g5"
server_key: "a5547a3190577cae58e5fb005904b8a2"
server_key_iv: "189f891ceb5ef8b11f09b5d50b92ec52"
server_key_version: "encryptionkey@0"
I20260808 04:44:29.363498 13415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "fc749b13605044398b422b591b635fe0"
format_stamp: "Formatted at 2026-08-08 04:44:29 on dist-test-slave-t7g5"
server_key: "a5547a3190577cae58e5fb005904b8a2"
server_key_iv: "189f891ceb5ef8b11f09b5d50b92ec52"
server_key_version: "encryptionkey@0"
I20260808 04:44:29.367118 13415 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 04:44:29.369452 13447 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:29.370680 13415 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:44:29.370795 13415 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "fc749b13605044398b422b591b635fe0"
format_stamp: "Formatted at 2026-08-08 04:44:29 on dist-test-slave-t7g5"
server_key: "a5547a3190577cae58e5fb005904b8a2"
server_key_iv: "189f891ceb5ef8b11f09b5d50b92ec52"
server_key_version: "encryptionkey@0"
I20260808 04:44:29.370886 13415 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:29.381866 13415 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:29.384408 13415 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:29.384586 13415 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:29.391315 13415 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37183
I20260808 04:44:29.391361 13527 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37183 every 8 connection(s)
I20260808 04:44:29.392212 13415 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:29.395007 13528 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:29.398550 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 13415
I20260808 04:44:29.398684 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:44:29.398937 12881 external_mini_cluster.cc:1428] Setting key 8f7e501bba7d568472cfd12a732e9288
I20260808 04:44:29.400703 13528 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc749b13605044398b422b591b635fe0: Bootstrap starting.
I20260808 04:44:29.403162 13528 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fc749b13605044398b422b591b635fe0: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:29.403923 13528 log.cc:824] T 00000000000000000000000000000000 P fc749b13605044398b422b591b635fe0: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:29.406360 13528 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc749b13605044398b422b591b635fe0: No bootstrap required, opened a new log
Aug 08 04:44:29 dist-test-slave-t7g5 krb5kdc[13391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164269, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 04:44:29.410969 13528 raft_consensus.cc:348] T 00000000000000000000000000000000 P fc749b13605044398b422b591b635fe0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc749b13605044398b422b591b635fe0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37183 } }
I20260808 04:44:29.411214 13528 raft_consensus.cc:374] T 00000000000000000000000000000000 P fc749b13605044398b422b591b635fe0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:29.411259 13528 raft_consensus.cc:729] T 00000000000000000000000000000000 P fc749b13605044398b422b591b635fe0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc749b13605044398b422b591b635fe0, State: Initialized, Role: FOLLOWER
I20260808 04:44:29.411729 13528 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc749b13605044398b422b591b635fe0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc749b13605044398b422b591b635fe0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37183 } }
I20260808 04:44:29.411845 13528 raft_consensus.cc:388] T 00000000000000000000000000000000 P fc749b13605044398b422b591b635fe0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:29.411886 13528 raft_consensus.cc:482] T 00000000000000000000000000000000 P fc749b13605044398b422b591b635fe0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:29.411958 13528 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fc749b13605044398b422b591b635fe0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:29.412885 13528 raft_consensus.cc:504] T 00000000000000000000000000000000 P fc749b13605044398b422b591b635fe0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc749b13605044398b422b591b635fe0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37183 } }
I20260808 04:44:29.413231 13528 leader_election.cc:302] T 00000000000000000000000000000000 P fc749b13605044398b422b591b635fe0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fc749b13605044398b422b591b635fe0; no voters:
I20260808 04:44:29.414546 13528 leader_election.cc:288] T 00000000000000000000000000000000 P fc749b13605044398b422b591b635fe0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:29.414626 13534 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fc749b13605044398b422b591b635fe0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:29.414817 13534 raft_consensus.cc:686] T 00000000000000000000000000000000 P fc749b13605044398b422b591b635fe0 [term 1 LEADER]: Becoming Leader. State: Replica: fc749b13605044398b422b591b635fe0, State: Running, Role: LEADER
I20260808 04:44:29.415162 13534 consensus_queue.cc:237] T 00000000000000000000000000000000 P fc749b13605044398b422b591b635fe0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc749b13605044398b422b591b635fe0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37183 } }
I20260808 04:44:29.415934 13528 sys_catalog.cc:564] T 00000000000000000000000000000000 P fc749b13605044398b422b591b635fe0 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:29.416092 13532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:29.400282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.70:42139 (local address 127.0.0.1:37183)
0808 04:44:29.400675 (+ 393us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:29.400691 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:29.400728 (+ 37us) server_negotiation.cc:407] Connection header received
0808 04:44:29.401361 (+ 633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:29.401378 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:29.401769 (+ 391us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:29.402049 (+ 280us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:29.402929 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:29.403987 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:29.405166 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:29.405866 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:29.406043 (+ 177us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:29.409090 (+ 3047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:29.409096 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:29.409114 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:29.409148 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:29.411629 (+ 2481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:29.412369 (+ 740us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:29.412376 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:29.412383 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:29.412580 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:29.413037 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:29.413041 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:29.413043 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:29.413777 (+ 734us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:29.414023 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:29.414872 (+ 849us) server_negotiation.cc:299] Negotiation successful
0808 04:44:29.415111 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":261,"thread_start_us":111,"threads_started":1}
I20260808 04:44:29.416857 13537 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc749b13605044398b422b591b635fe0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fc749b13605044398b422b591b635fe0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc749b13605044398b422b591b635fe0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37183 } } }
I20260808 04:44:29.417073 13537 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc749b13605044398b422b591b635fe0 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:29.418290 13535 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc749b13605044398b422b591b635fe0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc749b13605044398b422b591b635fe0. Latest consensus state: current_term: 1 leader_uuid: "fc749b13605044398b422b591b635fe0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc749b13605044398b422b591b635fe0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37183 } } }
I20260808 04:44:29.418648 13535 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc749b13605044398b422b591b635fe0 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:29.419894 12881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260808 04:44:29.421097 13559 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fc749b13605044398b422b591b635fe0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 04:44:29.421171 13559 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 04:44:29.421687 13560 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:29.422392 13560 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:29.427553 13560 catalog_manager.cc:1347] Generated new cluster ID: d92ac167591b4bd6adfd042ff6ef2fc9
I20260808 04:44:29.427621 13560 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:29.438728 13532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:29.426455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.70:48223 (local address 127.0.0.1:37183)
0808 04:44:29.426563 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:29.426567 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:29.429979 (+ 3412us) server_negotiation.cc:407] Connection header received
0808 04:44:29.430111 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:29.430114 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:29.430164 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:29.430243 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:29.431093 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:29.431869 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:29.433036 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:29.433357 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:29.433458 (+ 101us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:29.435087 (+ 1629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:29.435090 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:29.435094 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:29.435117 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:29.436679 (+ 1562us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:29.437204 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:29.437208 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:29.437209 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:29.437288 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:29.437691 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:29.437695 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:29.437697 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:29.437919 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:29.438040 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:29.438460 (+ 420us) server_negotiation.cc:299] Negotiation successful
0808 04:44:29.438564 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 04:44:29.441668 13560 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:29.442881 13560 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:29.450347 13560 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fc749b13605044398b422b591b635fe0: Generated new TSK 0
I20260808 04:44:29.451000 13560 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:44:29.457500 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 13415
W20260808 04:44:29.471098 13388 connection.cc:535] client connection to 127.0.0.1:37183 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37183): Connection reset by peer (error 104)
2026-08-08T04:44:29Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1522 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164004017495-12881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:29 dist-test-slave-t7g5 krb5kdc[13573](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:29 dist-test-slave-t7g5 krb5kdc[13573](info): set up 2 sockets
Aug 08 04:44:29 dist-test-slave-t7g5 krb5kdc[13573](info): commencing operation
krb5kdc: starting...
W20260808 04:44:30.612910 12881 mini_kdc.cc:121] Time spent starting KDC: real 1.128s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Aug 08 04:44:30 dist-test-slave-t7g5 krb5kdc[13573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164270, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 04:44:30.736181 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35225
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35225
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:30.849006 13596 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:30.849275 13596 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:30.849315 13596 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:30.853288 13596 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:30.853345 13596 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:30.853364 13596 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:30.853379 13596 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:30.853395 13596 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:30.858662 13596 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35225
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35225
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13596
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:30.859658 13596 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:30.860652 13596 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:30.869132 13606 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:30.869210 13602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:30.869132 13603 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:30.869328 13596 server_base.cc:1034] running on GCE node
I20260808 04:44:30.870078 13596 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:30.871212 13596 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:30.872394 13596 hybrid_clock.cc:648] HybridClock initialized: now 1786164270872368 us; error 42 us; skew 500 ppm
Aug 08 04:44:30 dist-test-slave-t7g5 krb5kdc[13573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164270, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:30.875144 13596 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 04:44:30.876072 13596 webserver.cc:460] Webserver started at http://127.0.0.1:34673/ using document root <none> and password file <none>
I20260808 04:44:30.876628 13596 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:30.876698 13596 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:30.876911 13596 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:30.879096 13596 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "34ab8dbc15ae43558c6a721ac67386f7"
format_stamp: "Formatted at 2026-08-08 04:44:30 on dist-test-slave-t7g5"
server_key: "2ca72675838c05e23f2e399587830778"
server_key_iv: "8d8a00afc36461bbf892b6da65e4e620"
server_key_version: "encryptionkey@0"
I20260808 04:44:30.879670 13596 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "34ab8dbc15ae43558c6a721ac67386f7"
format_stamp: "Formatted at 2026-08-08 04:44:30 on dist-test-slave-t7g5"
server_key: "2ca72675838c05e23f2e399587830778"
server_key_iv: "8d8a00afc36461bbf892b6da65e4e620"
server_key_version: "encryptionkey@0"
I20260808 04:44:30.883510 13596 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 04:44:30.886194 13615 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:30.887449 13596 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:44:30.887557 13596 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "34ab8dbc15ae43558c6a721ac67386f7"
format_stamp: "Formatted at 2026-08-08 04:44:30 on dist-test-slave-t7g5"
server_key: "2ca72675838c05e23f2e399587830778"
server_key_iv: "8d8a00afc36461bbf892b6da65e4e620"
server_key_version: "encryptionkey@0"
I20260808 04:44:30.887646 13596 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:30.901314 13596 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:30.904500 13596 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:30.904659 13596 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:30.911369 13596 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35225
I20260808 04:44:30.911433 13704 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35225 every 8 connection(s)
I20260808 04:44:30.912348 13596 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:30.913020 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 13596
I20260808 04:44:30.913142 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:44:30.913421 12881 external_mini_cluster.cc:1428] Setting key 068d0c5fa9a62fc8150413bfada92d52
I20260808 04:44:30.915591 13707 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:30.922473 13707 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34ab8dbc15ae43558c6a721ac67386f7: Bootstrap starting.
I20260808 04:44:30.923642 13712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:30.914727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.70:43561 (local address 127.0.0.1:35225)
0808 04:44:30.915166 (+ 439us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:30.915184 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:30.915327 (+ 143us) server_negotiation.cc:407] Connection header received
0808 04:44:30.916247 (+ 920us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:30.916269 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:30.916706 (+ 437us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:30.917075 (+ 369us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:30.917483 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:30.919028 (+ 1545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:30.919932 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:30.920619 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:30.920775 (+ 156us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:30.921690 (+ 915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:30.921698 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:30.921714 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:30.922190 (+ 476us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:30.922258 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:30.922288 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:30.922432 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:30.922586 (+ 154us) server_negotiation.cc:299] Negotiation successful
0808 04:44:30.922719 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286,"thread_start_us":106,"threads_started":1}
I20260808 04:44:30.925086 13707 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 34ab8dbc15ae43558c6a721ac67386f7: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:30.925921 13707 log.cc:824] T 00000000000000000000000000000000 P 34ab8dbc15ae43558c6a721ac67386f7: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:30.926707 12881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:44:30.927884 13707 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34ab8dbc15ae43558c6a721ac67386f7: No bootstrap required, opened a new log
I20260808 04:44:30.931010 13707 raft_consensus.cc:348] T 00000000000000000000000000000000 P 34ab8dbc15ae43558c6a721ac67386f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34ab8dbc15ae43558c6a721ac67386f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35225 } }
I20260808 04:44:30.931226 13707 raft_consensus.cc:374] T 00000000000000000000000000000000 P 34ab8dbc15ae43558c6a721ac67386f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:30.931281 13707 raft_consensus.cc:729] T 00000000000000000000000000000000 P 34ab8dbc15ae43558c6a721ac67386f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34ab8dbc15ae43558c6a721ac67386f7, State: Initialized, Role: FOLLOWER
I20260808 04:44:30.931708 13707 consensus_queue.cc:260] T 00000000000000000000000000000000 P 34ab8dbc15ae43558c6a721ac67386f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34ab8dbc15ae43558c6a721ac67386f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35225 } }
I20260808 04:44:30.931874 13707 raft_consensus.cc:388] T 00000000000000000000000000000000 P 34ab8dbc15ae43558c6a721ac67386f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:30.931954 13707 raft_consensus.cc:482] T 00000000000000000000000000000000 P 34ab8dbc15ae43558c6a721ac67386f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:30.932068 13707 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 34ab8dbc15ae43558c6a721ac67386f7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:30.932639 13712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:30.928588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.70:59083 (local address 127.0.0.1:35225)
0808 04:44:30.928680 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:30.928684 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:30.928897 (+ 213us) server_negotiation.cc:407] Connection header received
0808 04:44:30.929006 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:30.929009 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:30.929048 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:30.929110 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:30.929383 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:30.930254 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:30.931051 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:30.931332 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:30.931429 (+ 97us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:30.932203 (+ 774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:30.932207 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:30.932209 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:30.932222 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:30.932249 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:30.932260 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:30.932333 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:30.932474 (+ 141us) server_negotiation.cc:299] Negotiation successful
0808 04:44:30.932509 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 04:44:30.933069 13707 raft_consensus.cc:504] T 00000000000000000000000000000000 P 34ab8dbc15ae43558c6a721ac67386f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34ab8dbc15ae43558c6a721ac67386f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35225 } }
I20260808 04:44:30.933426 13707 leader_election.cc:302] T 00000000000000000000000000000000 P 34ab8dbc15ae43558c6a721ac67386f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 34ab8dbc15ae43558c6a721ac67386f7; no voters:
I20260808 04:44:30.933786 13707 leader_election.cc:288] T 00000000000000000000000000000000 P 34ab8dbc15ae43558c6a721ac67386f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:30.933862 13727 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 34ab8dbc15ae43558c6a721ac67386f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:30.934053 13727 raft_consensus.cc:686] T 00000000000000000000000000000000 P 34ab8dbc15ae43558c6a721ac67386f7 [term 1 LEADER]: Becoming Leader. State: Replica: 34ab8dbc15ae43558c6a721ac67386f7, State: Running, Role: LEADER
I20260808 04:44:30.934337 13727 consensus_queue.cc:237] T 00000000000000000000000000000000 P 34ab8dbc15ae43558c6a721ac67386f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34ab8dbc15ae43558c6a721ac67386f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35225 } }
I20260808 04:44:30.934938 13707 sys_catalog.cc:564] T 00000000000000000000000000000000 P 34ab8dbc15ae43558c6a721ac67386f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:30.935938 13728 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34ab8dbc15ae43558c6a721ac67386f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "34ab8dbc15ae43558c6a721ac67386f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34ab8dbc15ae43558c6a721ac67386f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35225 } } }
I20260808 04:44:30.935938 13729 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34ab8dbc15ae43558c6a721ac67386f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 34ab8dbc15ae43558c6a721ac67386f7. Latest consensus state: current_term: 1 leader_uuid: "34ab8dbc15ae43558c6a721ac67386f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34ab8dbc15ae43558c6a721ac67386f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35225 } } }
I20260808 04:44:30.936085 13728 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34ab8dbc15ae43558c6a721ac67386f7 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:30.936106 13729 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34ab8dbc15ae43558c6a721ac67386f7 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:30.937614 13738 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:30.940196 13738 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:30.945304 13738 catalog_manager.cc:1347] Generated new cluster ID: 2c4c13a22c0f4bbdb9de4f61478e6772
I20260808 04:44:30.945374 13738 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:30.955080 13738 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:30.956311 13738 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:30.973246 13738 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 34ab8dbc15ae43558c6a721ac67386f7: Generated new TSK 0
I20260808 04:44:30.974000 13738 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:44:30.977334 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 13596
W20260808 04:44:30.991364 13570 connection.cc:535] client connection to 127.0.0.1:35225 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35225): Connection reset by peer (error 104)
2026-08-08T04:44:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1520 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164004017495-12881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:31 dist-test-slave-t7g5 krb5kdc[13755](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:31 dist-test-slave-t7g5 krb5kdc[13755](info): set up 2 sockets
Aug 08 04:44:31 dist-test-slave-t7g5 krb5kdc[13755](info): commencing operation
krb5kdc: starting...
W20260808 04:44:32.122154 12881 mini_kdc.cc:121] Time spent starting KDC: real 1.117s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Aug 08 04:44:32 dist-test-slave-t7g5 krb5kdc[13755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164272, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 04:44:32.252106 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44429
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44429
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:32.363184 13781 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:32.363483 13781 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:32.363544 13781 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:32.367517 13781 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:32.367580 13781 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:32.367607 13781 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:32.367627 13781 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:32.367647 13781 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:32.372824 13781 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44429
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44429
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13781
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:32.373867 13781 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:32.374868 13781 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:32.383121 13792 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:32.383139 13790 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:32.383190 13781 server_base.cc:1034] running on GCE node
W20260808 04:44:32.383138 13789 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:32.383919 13781 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:32.385005 13781 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:32.386171 13781 hybrid_clock.cc:648] HybridClock initialized: now 1786164272386144 us; error 38 us; skew 500 ppm
Aug 08 04:44:32 dist-test-slave-t7g5 krb5kdc[13755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164272, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:32.388902 13781 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 04:44:32.389873 13781 webserver.cc:460] Webserver started at http://127.0.0.1:39553/ using document root <none> and password file <none>
I20260808 04:44:32.390432 13781 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:32.390502 13781 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:32.390718 13781 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:32.392788 13781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "0e6d846c7bd94131a9e9ea940213c8bb"
format_stamp: "Formatted at 2026-08-08 04:44:32 on dist-test-slave-t7g5"
server_key: "4fe673f96d801f1349e2f051beb9279a"
server_key_iv: "5ce9f96bf4a44f8cc0a6cd4e68e88ae2"
server_key_version: "encryptionkey@0"
I20260808 04:44:32.393347 13781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "0e6d846c7bd94131a9e9ea940213c8bb"
format_stamp: "Formatted at 2026-08-08 04:44:32 on dist-test-slave-t7g5"
server_key: "4fe673f96d801f1349e2f051beb9279a"
server_key_iv: "5ce9f96bf4a44f8cc0a6cd4e68e88ae2"
server_key_version: "encryptionkey@0"
I20260808 04:44:32.397078 13781 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 04:44:32.399521 13802 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:32.400722 13781 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:44:32.400846 13781 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "0e6d846c7bd94131a9e9ea940213c8bb"
format_stamp: "Formatted at 2026-08-08 04:44:32 on dist-test-slave-t7g5"
server_key: "4fe673f96d801f1349e2f051beb9279a"
server_key_iv: "5ce9f96bf4a44f8cc0a6cd4e68e88ae2"
server_key_version: "encryptionkey@0"
I20260808 04:44:32.400944 13781 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:32.405531 13781 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:32.408252 13781 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:32.408419 13781 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:32.415413 13892 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44429 every 8 connection(s)
I20260808 04:44:32.415511 13781 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44429
I20260808 04:44:32.416419 13781 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:32.418236 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 13781
I20260808 04:44:32.418375 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:44:32.418648 12881 external_mini_cluster.cc:1428] Setting key 65cc59d347aa353963c8da7b94930db0
I20260808 04:44:32.419329 13893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:32.424221 13897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:32.420023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.70:59327 (local address 127.0.0.1:44429)
0808 04:44:32.420450 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:32.420469 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:32.420513 (+ 44us) server_negotiation.cc:407] Connection header received
0808 04:44:32.421346 (+ 833us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:32.421371 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:32.421771 (+ 400us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:32.422160 (+ 389us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:32.422797 (+ 637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:32.422803 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:32.422818 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:32.422829 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:32.422892 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:32.422917 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:32.423075 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:32.423147 (+ 72us) server_negotiation.cc:299] Negotiation successful
0808 04:44:32.423305 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277,"thread_start_us":113,"threads_started":1}
I20260808 04:44:32.426187 13893 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e6d846c7bd94131a9e9ea940213c8bb: Bootstrap starting.
I20260808 04:44:32.426994 12881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:44:32.428534 13893 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0e6d846c7bd94131a9e9ea940213c8bb: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:32.429292 13893 log.cc:824] T 00000000000000000000000000000000 P 0e6d846c7bd94131a9e9ea940213c8bb: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:32.430549 13897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:32.428978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.70:35983 (local address 127.0.0.1:44429)
0808 04:44:32.429101 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:32.429105 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:32.429319 (+ 214us) server_negotiation.cc:407] Connection header received
0808 04:44:32.429409 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:32.429412 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:32.429451 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:32.429526 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:32.430206 (+ 680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:32.430209 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:32.430212 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:32.430225 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:32.430252 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:32.430264 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:32.430352 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:32.430399 (+ 47us) server_negotiation.cc:299] Negotiation successful
0808 04:44:32.430436 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 04:44:32.431545 13893 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e6d846c7bd94131a9e9ea940213c8bb: No bootstrap required, opened a new log
I20260808 04:44:32.434980 13893 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0e6d846c7bd94131a9e9ea940213c8bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e6d846c7bd94131a9e9ea940213c8bb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44429 } }
I20260808 04:44:32.435258 13893 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0e6d846c7bd94131a9e9ea940213c8bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:32.435328 13893 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0e6d846c7bd94131a9e9ea940213c8bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e6d846c7bd94131a9e9ea940213c8bb, State: Initialized, Role: FOLLOWER
I20260808 04:44:32.435788 13893 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0e6d846c7bd94131a9e9ea940213c8bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e6d846c7bd94131a9e9ea940213c8bb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44429 } }
I20260808 04:44:32.435918 13893 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0e6d846c7bd94131a9e9ea940213c8bb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:32.435968 13893 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0e6d846c7bd94131a9e9ea940213c8bb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:32.436039 13893 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0e6d846c7bd94131a9e9ea940213c8bb [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:32.436873 13893 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0e6d846c7bd94131a9e9ea940213c8bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e6d846c7bd94131a9e9ea940213c8bb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44429 } }
I20260808 04:44:32.437180 13893 leader_election.cc:302] T 00000000000000000000000000000000 P 0e6d846c7bd94131a9e9ea940213c8bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0e6d846c7bd94131a9e9ea940213c8bb; no voters:
I20260808 04:44:32.437441 13893 leader_election.cc:288] T 00000000000000000000000000000000 P 0e6d846c7bd94131a9e9ea940213c8bb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:32.437623 13917 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0e6d846c7bd94131a9e9ea940213c8bb [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:32.437932 13917 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0e6d846c7bd94131a9e9ea940213c8bb [term 1 LEADER]: Becoming Leader. State: Replica: 0e6d846c7bd94131a9e9ea940213c8bb, State: Running, Role: LEADER
I20260808 04:44:32.438244 13917 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0e6d846c7bd94131a9e9ea940213c8bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e6d846c7bd94131a9e9ea940213c8bb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44429 } }
I20260808 04:44:32.438634 13893 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0e6d846c7bd94131a9e9ea940213c8bb [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:32.439736 13918 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e6d846c7bd94131a9e9ea940213c8bb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0e6d846c7bd94131a9e9ea940213c8bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e6d846c7bd94131a9e9ea940213c8bb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44429 } } }
I20260808 04:44:32.439845 13918 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e6d846c7bd94131a9e9ea940213c8bb [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:32.440162 13919 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e6d846c7bd94131a9e9ea940213c8bb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0e6d846c7bd94131a9e9ea940213c8bb. Latest consensus state: current_term: 1 leader_uuid: "0e6d846c7bd94131a9e9ea940213c8bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e6d846c7bd94131a9e9ea940213c8bb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44429 } } }
I20260808 04:44:32.440254 13919 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e6d846c7bd94131a9e9ea940213c8bb [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:32.440325 13926 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:32.443130 13926 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:32.448377 13926 catalog_manager.cc:1347] Generated new cluster ID: 95b42dd7e76e4ae5afc682e3c806fa25
I20260808 04:44:32.448443 13926 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:32.462324 13926 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:32.462775 13926 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:32.472672 13926 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0e6d846c7bd94131a9e9ea940213c8bb: Generated new TSK 0
I20260808 04:44:32.473392 13926 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:44:32.479727 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 13781
2026-08-08T04:44:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1507 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164004017495-12881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:32 dist-test-slave-t7g5 krb5kdc[13949](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:32 dist-test-slave-t7g5 krb5kdc[13949](info): set up 2 sockets
Aug 08 04:44:32 dist-test-slave-t7g5 krb5kdc[13949](info): commencing operation
krb5kdc: starting...
W20260808 04:44:33.634279 12881 mini_kdc.cc:121] Time spent starting KDC: real 1.121s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Aug 08 04:44:33 dist-test-slave-t7g5 krb5kdc[13949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164273, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 04:44:33.760344 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35181
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35181
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:33.871600 13975 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:33.871912 13975 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:33.871986 13975 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:33.876317 13975 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:33.876400 13975 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:33.876430 13975 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:33.876452 13975 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:33.876483 13975 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:33.881922 13975 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35181
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35181
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13975
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:33.882953 13975 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:33.883944 13975 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:33.892215 13982 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:33.892211 13981 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:33.892211 13986 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:33.892495 13975 server_base.cc:1034] running on GCE node
I20260808 04:44:33.893079 13975 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:33.894230 13975 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:33.895397 13975 hybrid_clock.cc:648] HybridClock initialized: now 1786164273895380 us; error 30 us; skew 500 ppm
Aug 08 04:44:33 dist-test-slave-t7g5 krb5kdc[13949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164273, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:33.902235 13975 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 04:44:33.903205 13975 webserver.cc:460] Webserver started at http://127.0.0.1:36453/ using document root <none> and password file <none>
I20260808 04:44:33.903752 13975 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:33.903825 13975 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:33.904054 13975 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:33.906168 13975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "527bce508fb54f4f8a0bebad4f545e80"
format_stamp: "Formatted at 2026-08-08 04:44:33 on dist-test-slave-t7g5"
server_key: "ce1ee3748c6be31579ca8d8e7d451d9f"
server_key_iv: "ffa5dd160ff2e1061242b4b799e9a06d"
server_key_version: "encryptionkey@0"
I20260808 04:44:33.906713 13975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "527bce508fb54f4f8a0bebad4f545e80"
format_stamp: "Formatted at 2026-08-08 04:44:33 on dist-test-slave-t7g5"
server_key: "ce1ee3748c6be31579ca8d8e7d451d9f"
server_key_iv: "ffa5dd160ff2e1061242b4b799e9a06d"
server_key_version: "encryptionkey@0"
I20260808 04:44:33.910424 13975 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 04:44:33.912750 13997 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:33.913995 13975 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260808 04:44:33.914120 13975 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "527bce508fb54f4f8a0bebad4f545e80"
format_stamp: "Formatted at 2026-08-08 04:44:33 on dist-test-slave-t7g5"
server_key: "ce1ee3748c6be31579ca8d8e7d451d9f"
server_key_iv: "ffa5dd160ff2e1061242b4b799e9a06d"
server_key_version: "encryptionkey@0"
I20260808 04:44:33.914214 13975 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:33.928194 13975 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:33.931284 13975 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:33.931465 13975 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:33.938501 13975 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35181
I20260808 04:44:33.938540 14086 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35181 every 8 connection(s)
I20260808 04:44:33.939685 13975 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:33.942387 14090 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:33.946399 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 13975
I20260808 04:44:33.946527 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:44:33.946766 12881 external_mini_cluster.cc:1428] Setting key e434c95ea641c93f53e0a7a4576f37b5
I20260808 04:44:33.948101 14090 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 527bce508fb54f4f8a0bebad4f545e80: Bootstrap starting.
I20260808 04:44:33.950505 14090 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 527bce508fb54f4f8a0bebad4f545e80: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:33.951315 14090 log.cc:824] T 00000000000000000000000000000000 P 527bce508fb54f4f8a0bebad4f545e80: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:33.953505 14090 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 527bce508fb54f4f8a0bebad4f545e80: No bootstrap required, opened a new log
Aug 08 04:44:33 dist-test-slave-t7g5 krb5kdc[13949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164273, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 04:44:33.957872 14090 raft_consensus.cc:348] T 00000000000000000000000000000000 P 527bce508fb54f4f8a0bebad4f545e80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "527bce508fb54f4f8a0bebad4f545e80" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35181 } }
I20260808 04:44:33.958117 14090 raft_consensus.cc:374] T 00000000000000000000000000000000 P 527bce508fb54f4f8a0bebad4f545e80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:33.958164 14090 raft_consensus.cc:729] T 00000000000000000000000000000000 P 527bce508fb54f4f8a0bebad4f545e80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 527bce508fb54f4f8a0bebad4f545e80, State: Initialized, Role: FOLLOWER
I20260808 04:44:33.958607 14090 consensus_queue.cc:260] T 00000000000000000000000000000000 P 527bce508fb54f4f8a0bebad4f545e80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "527bce508fb54f4f8a0bebad4f545e80" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35181 } }
I20260808 04:44:33.958778 14090 raft_consensus.cc:388] T 00000000000000000000000000000000 P 527bce508fb54f4f8a0bebad4f545e80 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:33.958851 14090 raft_consensus.cc:482] T 00000000000000000000000000000000 P 527bce508fb54f4f8a0bebad4f545e80 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:33.958969 14090 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 527bce508fb54f4f8a0bebad4f545e80 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:33.960171 14090 raft_consensus.cc:504] T 00000000000000000000000000000000 P 527bce508fb54f4f8a0bebad4f545e80 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "527bce508fb54f4f8a0bebad4f545e80" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35181 } }
I20260808 04:44:33.960556 14090 leader_election.cc:302] T 00000000000000000000000000000000 P 527bce508fb54f4f8a0bebad4f545e80 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 527bce508fb54f4f8a0bebad4f545e80; no voters:
I20260808 04:44:33.960861 14090 leader_election.cc:288] T 00000000000000000000000000000000 P 527bce508fb54f4f8a0bebad4f545e80 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:33.960994 14098 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 527bce508fb54f4f8a0bebad4f545e80 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:33.961256 14098 raft_consensus.cc:686] T 00000000000000000000000000000000 P 527bce508fb54f4f8a0bebad4f545e80 [term 1 LEADER]: Becoming Leader. State: Replica: 527bce508fb54f4f8a0bebad4f545e80, State: Running, Role: LEADER
I20260808 04:44:33.961687 14098 consensus_queue.cc:237] T 00000000000000000000000000000000 P 527bce508fb54f4f8a0bebad4f545e80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "527bce508fb54f4f8a0bebad4f545e80" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35181 } }
I20260808 04:44:33.962282 14090 sys_catalog.cc:564] T 00000000000000000000000000000000 P 527bce508fb54f4f8a0bebad4f545e80 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:33.962831 14096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:33.948151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.70:46081 (local address 127.0.0.1:35181)
0808 04:44:33.948566 (+ 415us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:33.948582 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:33.948619 (+ 37us) server_negotiation.cc:407] Connection header received
0808 04:44:33.949272 (+ 653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:33.949290 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:33.949646 (+ 356us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:33.949986 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:33.950869 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:33.952049 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:33.953181 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:33.953726 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:33.953845 (+ 119us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:33.956745 (+ 2900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:33.956750 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:33.956764 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:33.956794 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:33.958509 (+ 1715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:33.959087 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:33.959093 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:33.959099 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:33.959254 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:33.960457 (+ 1203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:33.960460 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:33.960461 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:33.960950 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:33.961170 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:33.961537 (+ 367us) server_negotiation.cc:299] Negotiation successful
0808 04:44:33.961821 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274,"thread_start_us":112,"threads_started":1}
I20260808 04:44:33.963480 14099 sys_catalog.cc:455] T 00000000000000000000000000000000 P 527bce508fb54f4f8a0bebad4f545e80 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 527bce508fb54f4f8a0bebad4f545e80. Latest consensus state: current_term: 1 leader_uuid: "527bce508fb54f4f8a0bebad4f545e80" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "527bce508fb54f4f8a0bebad4f545e80" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35181 } } }
I20260808 04:44:33.963596 14099 sys_catalog.cc:458] T 00000000000000000000000000000000 P 527bce508fb54f4f8a0bebad4f545e80 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:33.963976 14113 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:33.965131 14102 sys_catalog.cc:455] T 00000000000000000000000000000000 P 527bce508fb54f4f8a0bebad4f545e80 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "527bce508fb54f4f8a0bebad4f545e80" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "527bce508fb54f4f8a0bebad4f545e80" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35181 } } }
I20260808 04:44:33.965245 14102 sys_catalog.cc:458] T 00000000000000000000000000000000 P 527bce508fb54f4f8a0bebad4f545e80 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:33.966161 12881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:44:33.967271 14113 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:33.972958 14113 catalog_manager.cc:1347] Generated new cluster ID: 719da58ec04b4924990f59725fba559f
I20260808 04:44:33.973028 14113 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:33.977792 14096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:33.968446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.70:54315 (local address 127.0.0.1:35181)
0808 04:44:33.968572 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:33.968576 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:33.968809 (+ 233us) server_negotiation.cc:407] Connection header received
0808 04:44:33.968988 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:33.968991 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:33.969034 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:33.969096 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:33.969982 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:33.970737 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:33.971859 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:33.972235 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:33.972313 (+ 78us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:33.974235 (+ 1922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:33.974239 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:33.974241 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:33.974267 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:33.975854 (+ 1587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:33.976387 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:33.976390 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:33.976392 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:33.976474 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:33.976799 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:33.976802 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:33.976804 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:33.977009 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:33.977121 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:33.977493 (+ 372us) server_negotiation.cc:299] Negotiation successful
0808 04:44:33.977595 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 04:44:34.004596 14113 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:34.006016 14113 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:34.021042 14113 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 527bce508fb54f4f8a0bebad4f545e80: Generated new TSK 0
I20260808 04:44:34.021960 14113 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:44:34.026675 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 13975
W20260808 04:44:34.035203 13945 connection.cc:535] client connection to 127.0.0.1:35181 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35181): Connection reset by peer (error 104)
2026-08-08T04:44:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1536 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164004017495-12881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:34 dist-test-slave-t7g5 krb5kdc[14137](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:34 dist-test-slave-t7g5 krb5kdc[14137](info): set up 2 sockets
Aug 08 04:44:34 dist-test-slave-t7g5 krb5kdc[14137](info): commencing operation
krb5kdc: starting...
W20260808 04:44:35.175470 12881 mini_kdc.cc:121] Time spent starting KDC: real 1.126s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Aug 08 04:44:35 dist-test-slave-t7g5 krb5kdc[14137](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164275, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 04:44:35.296550 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35015
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35015
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:35.407599 14161 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:35.407878 14161 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:35.407920 14161 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:35.411931 14161 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:35.412000 14161 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:35.412019 14161 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:35.412035 14161 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:35.412055 14161 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:35.417275 14161 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35015
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35015
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14161
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:35.418329 14161 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:35.419294 14161 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:35.427582 14171 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:35.427587 14168 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:35.427667 14161 server_base.cc:1034] running on GCE node
W20260808 04:44:35.427588 14169 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:35.428406 14161 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:35.429405 14161 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:35.430565 14161 hybrid_clock.cc:648] HybridClock initialized: now 1786164275430547 us; error 29 us; skew 500 ppm
Aug 08 04:44:35 dist-test-slave-t7g5 krb5kdc[14137](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164275, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:35.433115 14161 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 04:44:35.433949 14161 webserver.cc:460] Webserver started at http://127.0.0.1:42049/ using document root <none> and password file <none>
I20260808 04:44:35.434449 14161 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:35.434506 14161 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:35.434666 14161 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:35.436568 14161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "a87dbc56f12345c6b6aa9c9ca35d7dd8"
format_stamp: "Formatted at 2026-08-08 04:44:35 on dist-test-slave-t7g5"
server_key: "7c772157f346815c0b3efb14238b28b4"
server_key_iv: "a8e39deb4e44badc52462eb866a54a0b"
server_key_version: "encryptionkey@0"
I20260808 04:44:35.437069 14161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "a87dbc56f12345c6b6aa9c9ca35d7dd8"
format_stamp: "Formatted at 2026-08-08 04:44:35 on dist-test-slave-t7g5"
server_key: "7c772157f346815c0b3efb14238b28b4"
server_key_iv: "a8e39deb4e44badc52462eb866a54a0b"
server_key_version: "encryptionkey@0"
I20260808 04:44:35.440574 14161 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 04:44:35.442858 14182 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:35.444017 14161 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 04:44:35.444116 14161 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "a87dbc56f12345c6b6aa9c9ca35d7dd8"
format_stamp: "Formatted at 2026-08-08 04:44:35 on dist-test-slave-t7g5"
server_key: "7c772157f346815c0b3efb14238b28b4"
server_key_iv: "a8e39deb4e44badc52462eb866a54a0b"
server_key_version: "encryptionkey@0"
I20260808 04:44:35.444197 14161 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:35.462833 14161 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:35.465436 14161 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:35.465588 14161 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:35.473088 14161 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35015
I20260808 04:44:35.473104 14253 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35015 every 8 connection(s)
I20260808 04:44:35.474072 14161 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:35.476784 14254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:35.482321 14254 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a87dbc56f12345c6b6aa9c9ca35d7dd8: Bootstrap starting.
I20260808 04:44:35.482632 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 14161
I20260808 04:44:35.482764 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:44:35.483019 12881 external_mini_cluster.cc:1428] Setting key 565d0b7dd96cab762114d13e09a1029e
I20260808 04:44:35.484840 14254 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a87dbc56f12345c6b6aa9c9ca35d7dd8: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:35.485549 14254 log.cc:824] T 00000000000000000000000000000000 P a87dbc56f12345c6b6aa9c9ca35d7dd8: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:35.487735 14254 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a87dbc56f12345c6b6aa9c9ca35d7dd8: No bootstrap required, opened a new log
I20260808 04:44:35.491896 14254 raft_consensus.cc:348] T 00000000000000000000000000000000 P a87dbc56f12345c6b6aa9c9ca35d7dd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a87dbc56f12345c6b6aa9c9ca35d7dd8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35015 } }
I20260808 04:44:35.492172 14254 raft_consensus.cc:374] T 00000000000000000000000000000000 P a87dbc56f12345c6b6aa9c9ca35d7dd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:35.492230 14254 raft_consensus.cc:729] T 00000000000000000000000000000000 P a87dbc56f12345c6b6aa9c9ca35d7dd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87dbc56f12345c6b6aa9c9ca35d7dd8, State: Initialized, Role: FOLLOWER
I20260808 04:44:35.492472 14258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:35.484326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.70:52501 (local address 127.0.0.1:35015)
0808 04:44:35.484747 (+ 421us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:35.484762 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:35.484797 (+ 35us) server_negotiation.cc:407] Connection header received
0808 04:44:35.485448 (+ 651us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:35.485466 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:35.485855 (+ 389us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:35.486143 (+ 288us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:35.486550 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:35.487953 (+ 1403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:35.488804 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:35.489529 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:35.489716 (+ 187us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:35.490496 (+ 780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:35.490503 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:35.490521 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:35.491023 (+ 502us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:35.491093 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:35.491123 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:35.491256 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:35.491368 (+ 112us) server_negotiation.cc:299] Negotiation successful
0808 04:44:35.491515 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281,"thread_start_us":134,"threads_started":1}
I20260808 04:44:35.492703 14254 consensus_queue.cc:260] T 00000000000000000000000000000000 P a87dbc56f12345c6b6aa9c9ca35d7dd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a87dbc56f12345c6b6aa9c9ca35d7dd8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35015 } }
I20260808 04:44:35.492861 14254 raft_consensus.cc:388] T 00000000000000000000000000000000 P a87dbc56f12345c6b6aa9c9ca35d7dd8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:35.492939 14254 raft_consensus.cc:482] T 00000000000000000000000000000000 P a87dbc56f12345c6b6aa9c9ca35d7dd8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:35.493038 14254 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a87dbc56f12345c6b6aa9c9ca35d7dd8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:35.493954 14254 raft_consensus.cc:504] T 00000000000000000000000000000000 P a87dbc56f12345c6b6aa9c9ca35d7dd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a87dbc56f12345c6b6aa9c9ca35d7dd8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35015 } }
I20260808 04:44:35.494275 14254 leader_election.cc:302] T 00000000000000000000000000000000 P a87dbc56f12345c6b6aa9c9ca35d7dd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a87dbc56f12345c6b6aa9c9ca35d7dd8; no voters:
I20260808 04:44:35.494635 14254 leader_election.cc:288] T 00000000000000000000000000000000 P a87dbc56f12345c6b6aa9c9ca35d7dd8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:35.494715 14261 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a87dbc56f12345c6b6aa9c9ca35d7dd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:35.494935 14261 raft_consensus.cc:686] T 00000000000000000000000000000000 P a87dbc56f12345c6b6aa9c9ca35d7dd8 [term 1 LEADER]: Becoming Leader. State: Replica: a87dbc56f12345c6b6aa9c9ca35d7dd8, State: Running, Role: LEADER
I20260808 04:44:35.495260 14261 consensus_queue.cc:237] T 00000000000000000000000000000000 P a87dbc56f12345c6b6aa9c9ca35d7dd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a87dbc56f12345c6b6aa9c9ca35d7dd8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35015 } }
I20260808 04:44:35.495416 12881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:44:35.495874 14254 sys_catalog.cc:564] T 00000000000000000000000000000000 P a87dbc56f12345c6b6aa9c9ca35d7dd8 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:35.497888 14268 sys_catalog.cc:455] T 00000000000000000000000000000000 P a87dbc56f12345c6b6aa9c9ca35d7dd8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a87dbc56f12345c6b6aa9c9ca35d7dd8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a87dbc56f12345c6b6aa9c9ca35d7dd8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35015 } } }
I20260808 04:44:35.498034 14268 sys_catalog.cc:458] T 00000000000000000000000000000000 P a87dbc56f12345c6b6aa9c9ca35d7dd8 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:35.498312 14263 sys_catalog.cc:455] T 00000000000000000000000000000000 P a87dbc56f12345c6b6aa9c9ca35d7dd8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a87dbc56f12345c6b6aa9c9ca35d7dd8. Latest consensus state: current_term: 1 leader_uuid: "a87dbc56f12345c6b6aa9c9ca35d7dd8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a87dbc56f12345c6b6aa9c9ca35d7dd8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35015 } } }
I20260808 04:44:35.498409 14263 sys_catalog.cc:458] T 00000000000000000000000000000000 P a87dbc56f12345c6b6aa9c9ca35d7dd8 [sys.catalog]: This master's current role is: LEADER
W20260808 04:44:35.500649 14287 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a87dbc56f12345c6b6aa9c9ca35d7dd8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 04:44:35.500717 14287 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 04:44:35.500798 14288 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:35.501569 14288 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:35.503132 14258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:35.498929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.70:54885 (local address 127.0.0.1:35015)
0808 04:44:35.499049 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:35.499054 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:35.499216 (+ 162us) server_negotiation.cc:407] Connection header received
0808 04:44:35.499352 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:35.499355 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:35.499401 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:35.499486 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:35.499714 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:35.500451 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:35.501291 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:35.501614 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:35.501743 (+ 129us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:35.502704 (+ 961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:35.502707 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:35.502710 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:35.502721 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:35.502748 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:35.502758 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:35.502827 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:35.502969 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 04:44:35.503000 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 04:44:35.507179 14288 catalog_manager.cc:1347] Generated new cluster ID: 96f5dc179f184e388fb36e8fff8ad885
I20260808 04:44:35.507248 14288 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:35.526484 14288 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:35.527453 14288 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:35.531401 14288 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a87dbc56f12345c6b6aa9c9ca35d7dd8: Generated new TSK 0
I20260808 04:44:35.532083 14288 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:44:35.543129 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 14161
W20260808 04:44:35.551398 14134 connection.cc:535] client connection to 127.0.0.1:35015 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35015): Connection reset by peer (error 104)
2026-08-08T04:44:35Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1516 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164004017495-12881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:35 dist-test-slave-t7g5 krb5kdc[14303](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:35 dist-test-slave-t7g5 krb5kdc[14303](info): set up 2 sockets
Aug 08 04:44:35 dist-test-slave-t7g5 krb5kdc[14303](info): commencing operation
krb5kdc: starting...
W20260808 04:44:36.689360 12881 mini_kdc.cc:121] Time spent starting KDC: real 1.124s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Aug 08 04:44:36 dist-test-slave-t7g5 krb5kdc[14303](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164276, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 04:44:36.812764 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43865
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43865
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:36.925256 14322 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:36.925555 14322 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:36.925619 14322 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:36.929572 14322 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:36.929632 14322 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:36.929683 14322 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:36.929708 14322 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:36.929737 14322 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:36.934926 14322 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43865
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164004017495-12881-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43865
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14322
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:36.935969 14322 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:36.936946 14322 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:36.945019 14337 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:36.945034 14334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:36.945079 14332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:36.945087 14322 server_base.cc:1034] running on GCE node
I20260808 04:44:36.945875 14322 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:36.946874 14322 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:36.948032 14322 hybrid_clock.cc:648] HybridClock initialized: now 1786164276948019 us; error 26 us; skew 500 ppm
Aug 08 04:44:36 dist-test-slave-t7g5 krb5kdc[14303](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164276, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:36.950832 14322 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 04:44:36.951681 14322 webserver.cc:460] Webserver started at http://127.0.0.1:39911/ using document root <none> and password file <none>
I20260808 04:44:36.952179 14322 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:36.952234 14322 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:36.952397 14322 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:36.954356 14322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "1014ca98b0d9489cbe6aa9529f565071"
format_stamp: "Formatted at 2026-08-08 04:44:36 on dist-test-slave-t7g5"
server_key: "cece1258e6444dcd5bbcc3da1856e462"
server_key_iv: "53f96e6ae8e5878d25b41f35d255beb2"
server_key_version: "encryptionkey@0"
I20260808 04:44:36.954849 14322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "1014ca98b0d9489cbe6aa9529f565071"
format_stamp: "Formatted at 2026-08-08 04:44:36 on dist-test-slave-t7g5"
server_key: "cece1258e6444dcd5bbcc3da1856e462"
server_key_iv: "53f96e6ae8e5878d25b41f35d255beb2"
server_key_version: "encryptionkey@0"
I20260808 04:44:36.958263 14322 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:44:36.960413 14344 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:36.961537 14322 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:44:36.961644 14322 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "1014ca98b0d9489cbe6aa9529f565071"
format_stamp: "Formatted at 2026-08-08 04:44:36 on dist-test-slave-t7g5"
server_key: "cece1258e6444dcd5bbcc3da1856e462"
server_key_iv: "53f96e6ae8e5878d25b41f35d255beb2"
server_key_version: "encryptionkey@0"
I20260808 04:44:36.961762 14322 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:36.966041 14322 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:36.968964 14322 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:36.969105 14322 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:36.975780 14322 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43865
I20260808 04:44:36.975795 14418 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43865 every 8 connection(s)
I20260808 04:44:36.976684 14322 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:36.979562 14419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:36.979555 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 14322
I20260808 04:44:36.979691 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:44:36.980022 12881 external_mini_cluster.cc:1428] Setting key e4e43872cc6e67e77196e9f0327cce48
I20260808 04:44:36.985046 14423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:36.981360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.70:52735 (local address 127.0.0.1:43865)
0808 04:44:36.981787 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:36.981803 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:36.981838 (+ 35us) server_negotiation.cc:407] Connection header received
0808 04:44:36.982442 (+ 604us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:36.982458 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:36.982733 (+ 275us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:36.983014 (+ 281us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:36.983837 (+ 823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:36.983842 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:36.983854 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:36.983864 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:36.983927 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:36.983947 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:36.984055 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:36.984167 (+ 112us) server_negotiation.cc:299] Negotiation successful
0808 04:44:36.984320 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":110,"threads_started":1}
I20260808 04:44:36.986613 14419 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1014ca98b0d9489cbe6aa9529f565071: Bootstrap starting.
I20260808 04:44:36.987877 12881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:44:36.989281 14419 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1014ca98b0d9489cbe6aa9529f565071: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:36.990206 14419 log.cc:824] T 00000000000000000000000000000000 P 1014ca98b0d9489cbe6aa9529f565071: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:36.991844 14423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:36.990242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.70:36801 (local address 127.0.0.1:43865)
0808 04:44:36.990369 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:36.990373 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:36.990583 (+ 210us) server_negotiation.cc:407] Connection header received
0808 04:44:36.990671 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:36.990674 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:36.990706 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:36.990770 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:36.991481 (+ 711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:36.991485 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:36.991487 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:36.991499 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:36.991527 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:36.991541 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:36.991622 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:36.991691 (+ 69us) server_negotiation.cc:299] Negotiation successful
0808 04:44:36.991732 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 04:44:36.992504 14419 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1014ca98b0d9489cbe6aa9529f565071: No bootstrap required, opened a new log
I20260808 04:44:36.996104 14419 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1014ca98b0d9489cbe6aa9529f565071 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1014ca98b0d9489cbe6aa9529f565071" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43865 } }
I20260808 04:44:36.996340 14419 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1014ca98b0d9489cbe6aa9529f565071 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:36.996408 14419 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1014ca98b0d9489cbe6aa9529f565071 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1014ca98b0d9489cbe6aa9529f565071, State: Initialized, Role: FOLLOWER
I20260808 04:44:36.996835 14419 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1014ca98b0d9489cbe6aa9529f565071 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1014ca98b0d9489cbe6aa9529f565071" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43865 } }
I20260808 04:44:36.996970 14419 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1014ca98b0d9489cbe6aa9529f565071 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:36.997017 14419 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1014ca98b0d9489cbe6aa9529f565071 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:36.997089 14419 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1014ca98b0d9489cbe6aa9529f565071 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:36.998034 14419 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1014ca98b0d9489cbe6aa9529f565071 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1014ca98b0d9489cbe6aa9529f565071" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43865 } }
I20260808 04:44:36.998353 14419 leader_election.cc:302] T 00000000000000000000000000000000 P 1014ca98b0d9489cbe6aa9529f565071 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1014ca98b0d9489cbe6aa9529f565071; no voters:
I20260808 04:44:36.998646 14419 leader_election.cc:288] T 00000000000000000000000000000000 P 1014ca98b0d9489cbe6aa9529f565071 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:36.998759 14431 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1014ca98b0d9489cbe6aa9529f565071 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:36.998987 14431 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1014ca98b0d9489cbe6aa9529f565071 [term 1 LEADER]: Becoming Leader. State: Replica: 1014ca98b0d9489cbe6aa9529f565071, State: Running, Role: LEADER
I20260808 04:44:36.999311 14431 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1014ca98b0d9489cbe6aa9529f565071 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1014ca98b0d9489cbe6aa9529f565071" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43865 } }
I20260808 04:44:36.999821 14419 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1014ca98b0d9489cbe6aa9529f565071 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:37.001048 14432 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1014ca98b0d9489cbe6aa9529f565071 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1014ca98b0d9489cbe6aa9529f565071" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1014ca98b0d9489cbe6aa9529f565071" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43865 } } }
I20260808 04:44:37.001086 14434 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1014ca98b0d9489cbe6aa9529f565071 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1014ca98b0d9489cbe6aa9529f565071. Latest consensus state: current_term: 1 leader_uuid: "1014ca98b0d9489cbe6aa9529f565071" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1014ca98b0d9489cbe6aa9529f565071" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43865 } } }
I20260808 04:44:37.001179 14432 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1014ca98b0d9489cbe6aa9529f565071 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:37.001186 14434 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1014ca98b0d9489cbe6aa9529f565071 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:37.001574 14444 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:37.005257 14444 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:37.010972 14444 catalog_manager.cc:1347] Generated new cluster ID: 9ec9d706c9bc4e10b5ae7d89cc0131a5
I20260808 04:44:37.011085 14444 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:37.019927 14444 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:37.020287 14444 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:37.025698 14444 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1014ca98b0d9489cbe6aa9529f565071: Generated new TSK 0
I20260808 04:44:37.026373 14444 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:44:37.029917 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 14322
2026-08-08T04:44:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1494 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164004017495-12881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:37 dist-test-slave-t7g5 krb5kdc[14465](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:37 dist-test-slave-t7g5 krb5kdc[14465](info): set up 2 sockets
Aug 08 04:44:37 dist-test-slave-t7g5 krb5kdc[14465](info): commencing operation
krb5kdc: starting...
W20260808 04:44:38.182487 12881 mini_kdc.cc:121] Time spent starting KDC: real 1.123s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Aug 08 04:44:38 dist-test-slave-t7g5 krb5kdc[14465](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164278, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.148.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
I20260808 04:44:38.309962 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:37743
--webserver_interface=127.12.148.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:34919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:37743
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:38.422497 14482 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:38.422762 14482 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:38.422803 14482 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:38.426709 14482 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:38.426771 14482 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:38.426789 14482 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:38.426805 14482 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:38.426818 14482 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:38.432044 14482 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:34919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:37743
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:37743
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14482
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:38.433009 14482 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:38.434039 14482 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:38.442301 14492 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:38.442291 14495 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:38.442291 14490 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:38.442346 14482 server_base.cc:1034] running on GCE node
I20260808 04:44:38.443181 14482 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:38.444264 14482 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:38.445441 14482 hybrid_clock.cc:648] HybridClock initialized: now 1786164278445409 us; error 34 us; skew 500 ppm
Aug 08 04:44:38 dist-test-slave-t7g5 krb5kdc[14465](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164278, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:38.448088 14482 init.cc:377] Logged in from keytab as kudu/127.12.148.126@KRBTEST.COM (short username kudu)
I20260808 04:44:38.448964 14482 webserver.cc:460] Webserver started at http://127.12.148.126:37855/ using document root <none> and password file <none>
I20260808 04:44:38.449512 14482 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:38.449577 14482 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:38.449805 14482 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:38.451826 14482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "6bb2c1a3fb6449129851dd417f46036c"
format_stamp: "Formatted at 2026-08-08 04:44:38 on dist-test-slave-t7g5"
server_key: "be87771084e2882b66eb7b3902e94525"
server_key_iv: "198cddb177548927e935583e8aa1a311"
server_key_version: "encryptionkey@0"
I20260808 04:44:38.452373 14482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "6bb2c1a3fb6449129851dd417f46036c"
format_stamp: "Formatted at 2026-08-08 04:44:38 on dist-test-slave-t7g5"
server_key: "be87771084e2882b66eb7b3902e94525"
server_key_iv: "198cddb177548927e935583e8aa1a311"
server_key_version: "encryptionkey@0"
I20260808 04:44:38.456041 14482 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260808 04:44:38.458364 14509 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:38.459599 14482 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 04:44:38.459710 14482 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "6bb2c1a3fb6449129851dd417f46036c"
format_stamp: "Formatted at 2026-08-08 04:44:38 on dist-test-slave-t7g5"
server_key: "be87771084e2882b66eb7b3902e94525"
server_key_iv: "198cddb177548927e935583e8aa1a311"
server_key_version: "encryptionkey@0"
I20260808 04:44:38.459802 14482 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:38.484586 14482 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:38.487504 14482 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:38.487694 14482 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:38.494472 14482 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:37743
I20260808 04:44:38.494503 14598 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:37743 every 8 connection(s)
I20260808 04:44:38.495401 14482 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:38.496366 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 14482
I20260808 04:44:38.496490 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:44:38.496748 12881 external_mini_cluster.cc:1428] Setting key 94ad5d3aaec8a2014cc1511328c36f0f
I20260808 04:44:38.498668 14599 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:38.505357 14599 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6bb2c1a3fb6449129851dd417f46036c: Bootstrap starting.
Aug 08 04:44:38 dist-test-slave-t7g5 krb5kdc[14465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164278, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:44:38.508111 14599 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6bb2c1a3fb6449129851dd417f46036c: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:38.508878 14599 log.cc:824] T 00000000000000000000000000000000 P 6bb2c1a3fb6449129851dd417f46036c: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:38.511317 14599 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6bb2c1a3fb6449129851dd417f46036c: No bootstrap required, opened a new log
I20260808 04:44:38.512293 14608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:38.498395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43987 (local address 127.12.148.126:37743)
0808 04:44:38.498952 (+ 557us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:38.498968 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:38.499006 (+ 38us) server_negotiation.cc:407] Connection header received
0808 04:44:38.499670 (+ 664us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:38.499687 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:38.500079 (+ 392us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:38.500371 (+ 292us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:38.501292 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:38.502411 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:38.503638 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:38.504218 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:38.504339 (+ 121us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:38.507246 (+ 2907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:38.507251 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:38.507264 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:38.507294 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:38.508960 (+ 1666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:38.509543 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:38.509548 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:38.509552 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:38.509698 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:38.510029 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:38.510032 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:38.510034 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:38.510560 (+ 526us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:38.510784 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:38.511059 (+ 275us) server_negotiation.cc:299] Negotiation successful
0808 04:44:38.511299 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":409,"thread_start_us":145,"threads_started":1}
I20260808 04:44:38.515471 12881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:44:38.515679 14599 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6bb2c1a3fb6449129851dd417f46036c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bb2c1a3fb6449129851dd417f46036c" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 37743 } }
I20260808 04:44:38.515967 14599 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6bb2c1a3fb6449129851dd417f46036c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:38.516031 14599 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6bb2c1a3fb6449129851dd417f46036c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bb2c1a3fb6449129851dd417f46036c, State: Initialized, Role: FOLLOWER
I20260808 04:44:38.516528 14599 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6bb2c1a3fb6449129851dd417f46036c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bb2c1a3fb6449129851dd417f46036c" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 37743 } }
I20260808 04:44:38.516706 14599 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6bb2c1a3fb6449129851dd417f46036c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:38.516781 14599 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6bb2c1a3fb6449129851dd417f46036c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:38.516898 14599 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6bb2c1a3fb6449129851dd417f46036c [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:38.518148 14599 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6bb2c1a3fb6449129851dd417f46036c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bb2c1a3fb6449129851dd417f46036c" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 37743 } }
I20260808 04:44:38.518524 14599 leader_election.cc:302] T 00000000000000000000000000000000 P 6bb2c1a3fb6449129851dd417f46036c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6bb2c1a3fb6449129851dd417f46036c; no voters:
I20260808 04:44:38.518842 14599 leader_election.cc:288] T 00000000000000000000000000000000 P 6bb2c1a3fb6449129851dd417f46036c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:38.518932 14619 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6bb2c1a3fb6449129851dd417f46036c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:38.519160 14619 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6bb2c1a3fb6449129851dd417f46036c [term 1 LEADER]: Becoming Leader. State: Replica: 6bb2c1a3fb6449129851dd417f46036c, State: Running, Role: LEADER
I20260808 04:44:38.519526 14619 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6bb2c1a3fb6449129851dd417f46036c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bb2c1a3fb6449129851dd417f46036c" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 37743 } }
I20260808 04:44:38.520188 14599 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6bb2c1a3fb6449129851dd417f46036c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:38.520761 14619 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6bb2c1a3fb6449129851dd417f46036c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6bb2c1a3fb6449129851dd417f46036c. Latest consensus state: current_term: 1 leader_uuid: "6bb2c1a3fb6449129851dd417f46036c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bb2c1a3fb6449129851dd417f46036c" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 37743 } } }
I20260808 04:44:38.521409 14620 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6bb2c1a3fb6449129851dd417f46036c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6bb2c1a3fb6449129851dd417f46036c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bb2c1a3fb6449129851dd417f46036c" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 37743 } } }
I20260808 04:44:38.521535 14619 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6bb2c1a3fb6449129851dd417f46036c [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:38.521587 14620 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6bb2c1a3fb6449129851dd417f46036c [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:38.523049 14638 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:38.526098 14608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:38.517824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56365 (local address 127.12.148.126:37743)
0808 04:44:38.517955 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:38.517959 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:38.518040 (+ 81us) server_negotiation.cc:407] Connection header received
0808 04:44:38.518128 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:38.518131 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:38.518179 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:38.518271 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:38.519023 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:38.519650 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:38.520578 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:38.520902 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:38.520998 (+ 96us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:38.522803 (+ 1805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:38.522806 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:38.522809 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:38.522835 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:38.524387 (+ 1552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:38.524920 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:38.524932 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:38.524934 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:38.525013 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:38.525317 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:38.525319 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:38.525321 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:38.525493 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:38.525603 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:38.525880 (+ 277us) server_negotiation.cc:299] Negotiation successful
0808 04:44:38.525970 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 04:44:38.528501 14638 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:38.534194 14638 catalog_manager.cc:1347] Generated new cluster ID: 4e948e067c5b49c39e1370fe1e07c6b3
I20260808 04:44:38.534267 14638 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:38.553285 14638 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:38.554257 14638 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:38.558251 14638 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6bb2c1a3fb6449129851dd417f46036c: Generated new TSK 0
I20260808 04:44:38.558880 14638 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:44:38.566438 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 14482
W20260808 04:44:38.579888 14462 connection.cc:535] client connection to 127.12.148.126:37743 recv error: Network error: failed to read from TLS socket (remote: 127.12.148.126:37743): Connection reset by peer (error 104)
2026-08-08T04:44:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1534 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164004017495-12881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:38 dist-test-slave-t7g5 krb5kdc[14658](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:38 dist-test-slave-t7g5 krb5kdc[14658](info): set up 2 sockets
Aug 08 04:44:38 dist-test-slave-t7g5 krb5kdc[14658](info): commencing operation
krb5kdc: starting...
W20260808 04:44:39.720870 12881 mini_kdc.cc:121] Time spent starting KDC: real 1.127s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Aug 08 04:44:39 dist-test-slave-t7g5 krb5kdc[14658](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164279, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.148.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
I20260808 04:44:39.844094 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:44121
--webserver_interface=127.12.148.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:36711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:44121
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:39.955260 14675 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:39.955550 14675 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:39.955610 14675 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:39.959950 14675 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:39.960033 14675 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:39.960069 14675 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:39.960094 14675 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:39.960126 14675 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:39.965453 14675 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:36711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:44121
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:44121
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14675
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:39.966485 14675 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:39.967510 14675 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:39.975606 14690 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:39.975606 14685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:39.975733 14686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:39.975979 14675 server_base.cc:1034] running on GCE node
I20260808 04:44:39.976553 14675 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:39.977634 14675 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:39.978847 14675 hybrid_clock.cc:648] HybridClock initialized: now 1786164279978815 us; error 42 us; skew 500 ppm
Aug 08 04:44:39 dist-test-slave-t7g5 krb5kdc[14658](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164279, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:39.985622 14675 init.cc:377] Logged in from keytab as kudu/127.12.148.126@KRBTEST.COM (short username kudu)
I20260808 04:44:39.986609 14675 webserver.cc:460] Webserver started at http://127.12.148.126:44553/ using document root <none> and password file <none>
I20260808 04:44:39.987159 14675 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:39.987228 14675 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:39.987421 14675 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:39.989530 14675 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "2dea8ec65fbe42fe81d8dbd1ca8a2ec4"
format_stamp: "Formatted at 2026-08-08 04:44:39 on dist-test-slave-t7g5"
server_key: "d586280ae86c696d0d0d3799a92cb760"
server_key_iv: "8517c8df3580053986d1e8c57888093c"
server_key_version: "encryptionkey@0"
I20260808 04:44:39.990116 14675 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "2dea8ec65fbe42fe81d8dbd1ca8a2ec4"
format_stamp: "Formatted at 2026-08-08 04:44:39 on dist-test-slave-t7g5"
server_key: "d586280ae86c696d0d0d3799a92cb760"
server_key_iv: "8517c8df3580053986d1e8c57888093c"
server_key_version: "encryptionkey@0"
I20260808 04:44:39.993739 14675 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 04:44:39.996078 14703 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:39.997274 14675 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:44:39.997396 14675 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "2dea8ec65fbe42fe81d8dbd1ca8a2ec4"
format_stamp: "Formatted at 2026-08-08 04:44:39 on dist-test-slave-t7g5"
server_key: "d586280ae86c696d0d0d3799a92cb760"
server_key_iv: "8517c8df3580053986d1e8c57888093c"
server_key_version: "encryptionkey@0"
I20260808 04:44:39.997519 14675 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:40.014649 14675 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:40.017598 14675 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:40.017848 14675 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:40.024791 14675 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:44121
I20260808 04:44:40.024828 14784 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:44121 every 8 connection(s)
I20260808 04:44:40.025780 14675 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:40.028505 14785 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:40.030594 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 14675
I20260808 04:44:40.030750 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:44:40.031039 12881 external_mini_cluster.cc:1428] Setting key ffac0220c246434727271db383069d4a
I20260808 04:44:40.034722 14785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2dea8ec65fbe42fe81d8dbd1ca8a2ec4: Bootstrap starting.
I20260808 04:44:40.036895 14785 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2dea8ec65fbe42fe81d8dbd1ca8a2ec4: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:40.037591 14785 log.cc:824] T 00000000000000000000000000000000 P 2dea8ec65fbe42fe81d8dbd1ca8a2ec4: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:40.039887 14785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2dea8ec65fbe42fe81d8dbd1ca8a2ec4: No bootstrap required, opened a new log
I20260808 04:44:40.040426 14788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:40.032485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43153 (local address 127.12.148.126:44121)
0808 04:44:40.032927 (+ 442us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:40.032943 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:40.032980 (+ 37us) server_negotiation.cc:407] Connection header received
0808 04:44:40.033847 (+ 867us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:40.033867 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:40.034216 (+ 349us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:40.034538 (+ 322us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:40.034954 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:40.035941 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:40.036818 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:40.037326 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:40.037484 (+ 158us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:40.038455 (+ 971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:40.038461 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:40.038478 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:40.038961 (+ 483us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:40.039030 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:40.039060 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:40.039211 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:40.039353 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 04:44:40.039485 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":141,"threads_started":1}
I20260808 04:44:40.043402 12881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:44:40.044085 14785 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2dea8ec65fbe42fe81d8dbd1ca8a2ec4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dea8ec65fbe42fe81d8dbd1ca8a2ec4" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 44121 } }
I20260808 04:44:40.044371 14785 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2dea8ec65fbe42fe81d8dbd1ca8a2ec4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:40.044443 14785 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2dea8ec65fbe42fe81d8dbd1ca8a2ec4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dea8ec65fbe42fe81d8dbd1ca8a2ec4, State: Initialized, Role: FOLLOWER
I20260808 04:44:40.044924 14785 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2dea8ec65fbe42fe81d8dbd1ca8a2ec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dea8ec65fbe42fe81d8dbd1ca8a2ec4" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 44121 } }
I20260808 04:44:40.045090 14785 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2dea8ec65fbe42fe81d8dbd1ca8a2ec4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:40.045163 14785 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2dea8ec65fbe42fe81d8dbd1ca8a2ec4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:40.045264 14785 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2dea8ec65fbe42fe81d8dbd1ca8a2ec4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:40.046331 14785 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2dea8ec65fbe42fe81d8dbd1ca8a2ec4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dea8ec65fbe42fe81d8dbd1ca8a2ec4" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 44121 } }
I20260808 04:44:40.046708 14785 leader_election.cc:302] T 00000000000000000000000000000000 P 2dea8ec65fbe42fe81d8dbd1ca8a2ec4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2dea8ec65fbe42fe81d8dbd1ca8a2ec4; no voters:
I20260808 04:44:40.047034 14785 leader_election.cc:288] T 00000000000000000000000000000000 P 2dea8ec65fbe42fe81d8dbd1ca8a2ec4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:40.047133 14798 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2dea8ec65fbe42fe81d8dbd1ca8a2ec4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:40.047411 14798 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2dea8ec65fbe42fe81d8dbd1ca8a2ec4 [term 1 LEADER]: Becoming Leader. State: Replica: 2dea8ec65fbe42fe81d8dbd1ca8a2ec4, State: Running, Role: LEADER
I20260808 04:44:40.047809 14798 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2dea8ec65fbe42fe81d8dbd1ca8a2ec4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dea8ec65fbe42fe81d8dbd1ca8a2ec4" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 44121 } }
I20260808 04:44:40.048215 14785 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2dea8ec65fbe42fe81d8dbd1ca8a2ec4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:40.049000 14799 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2dea8ec65fbe42fe81d8dbd1ca8a2ec4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2dea8ec65fbe42fe81d8dbd1ca8a2ec4. Latest consensus state: current_term: 1 leader_uuid: "2dea8ec65fbe42fe81d8dbd1ca8a2ec4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dea8ec65fbe42fe81d8dbd1ca8a2ec4" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 44121 } } }
I20260808 04:44:40.049129 14799 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2dea8ec65fbe42fe81d8dbd1ca8a2ec4 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:40.049683 14800 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2dea8ec65fbe42fe81d8dbd1ca8a2ec4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2dea8ec65fbe42fe81d8dbd1ca8a2ec4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dea8ec65fbe42fe81d8dbd1ca8a2ec4" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 44121 } } }
I20260808 04:44:40.050021 14800 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2dea8ec65fbe42fe81d8dbd1ca8a2ec4 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:40.050354 14816 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:40.050384 14788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:40.045607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42027 (local address 127.12.148.126:44121)
0808 04:44:40.045742 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:40.045746 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:40.045961 (+ 215us) server_negotiation.cc:407] Connection header received
0808 04:44:40.046051 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:40.046054 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:40.046099 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:40.046189 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:40.046388 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:40.047143 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:40.048223 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:40.048570 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:40.048678 (+ 108us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:40.049596 (+ 918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:40.049599 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:40.049602 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:40.049615 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:40.049643 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:40.049689 (+ 46us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:40.049773 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:40.050220 (+ 447us) server_negotiation.cc:299] Negotiation successful
0808 04:44:40.050253 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 04:44:40.053879 14816 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:40.059139 14816 catalog_manager.cc:1347] Generated new cluster ID: 70fdaaf47c68481e9eb2e2d46e9f01dd
I20260808 04:44:40.059206 14816 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:40.070315 14816 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:40.071513 14816 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:40.078943 14816 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2dea8ec65fbe42fe81d8dbd1ca8a2ec4: Generated new TSK 0
I20260808 04:44:40.079735 14816 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:44:40.085598 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 14675
W20260808 04:44:40.106246 14656 connection.cc:535] client connection to 127.12.148.126:44121 recv error: Network error: failed to read from TLS socket (remote: 127.12.148.126:44121): Connection reset by peer (error 104)
2026-08-08T04:44:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1526 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164004017495-12881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:40 dist-test-slave-t7g5 krb5kdc[14833](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:40 dist-test-slave-t7g5 krb5kdc[14833](info): set up 2 sockets
Aug 08 04:44:40 dist-test-slave-t7g5 krb5kdc[14833](info): commencing operation
krb5kdc: starting...
W20260808 04:44:41.235502 12881 mini_kdc.cc:121] Time spent starting KDC: real 1.115s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Aug 08 04:44:41 dist-test-slave-t7g5 krb5kdc[14833](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164281, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.148.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
I20260808 04:44:41.358711 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:42699
--webserver_interface=127.12.148.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:39549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:42699
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:41.467883 14850 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:41.468143 14850 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:41.468182 14850 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:41.472033 14850 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:41.472084 14850 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:41.472102 14850 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:41.472117 14850 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:41.472131 14850 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:41.477170 14850 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:39549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:42699
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:42699
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14850
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:41.478143 14850 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:41.479079 14850 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:41.487425 14860 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:41.487494 14850 server_base.cc:1034] running on GCE node
W20260808 04:44:41.487426 14856 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:41.487452 14857 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:41.488214 14850 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:41.489300 14850 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:41.490458 14850 hybrid_clock.cc:648] HybridClock initialized: now 1786164281490440 us; error 27 us; skew 500 ppm
Aug 08 04:44:41 dist-test-slave-t7g5 krb5kdc[14833](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164281, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:41.493114 14850 init.cc:377] Logged in from keytab as kudu/127.12.148.126@KRBTEST.COM (short username kudu)
I20260808 04:44:41.494024 14850 webserver.cc:460] Webserver started at http://127.12.148.126:45281/ using document root <none> and password file <none>
I20260808 04:44:41.494565 14850 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:41.494627 14850 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:41.494829 14850 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:41.496877 14850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "1271e7f678c44bf8a074fc040f007e14"
format_stamp: "Formatted at 2026-08-08 04:44:41 on dist-test-slave-t7g5"
server_key: "6c6e0c856c84ee5bf80d54610f269d0c"
server_key_iv: "7ffd37df766de143a903300b0376fe93"
server_key_version: "encryptionkey@0"
I20260808 04:44:41.497545 14850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "1271e7f678c44bf8a074fc040f007e14"
format_stamp: "Formatted at 2026-08-08 04:44:41 on dist-test-slave-t7g5"
server_key: "6c6e0c856c84ee5bf80d54610f269d0c"
server_key_iv: "7ffd37df766de143a903300b0376fe93"
server_key_version: "encryptionkey@0"
I20260808 04:44:41.501968 14850 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 04:44:41.504437 14869 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:41.505709 14850 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:44:41.505823 14850 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "1271e7f678c44bf8a074fc040f007e14"
format_stamp: "Formatted at 2026-08-08 04:44:41 on dist-test-slave-t7g5"
server_key: "6c6e0c856c84ee5bf80d54610f269d0c"
server_key_iv: "7ffd37df766de143a903300b0376fe93"
server_key_version: "encryptionkey@0"
I20260808 04:44:41.505919 14850 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:41.510577 14850 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:41.513361 14850 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:41.513517 14850 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:41.520382 14850 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:42699
I20260808 04:44:41.520427 14945 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:42699 every 8 connection(s)
I20260808 04:44:41.521324 14850 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:41.524135 14946 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:41.524276 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 14850
I20260808 04:44:41.524420 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:44:41.524703 12881 external_mini_cluster.cc:1428] Setting key 464426af46aec471d2277e4b250cb726
I20260808 04:44:41.530290 14949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:41.526192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38703 (local address 127.12.148.126:42699)
0808 04:44:41.526650 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:41.526669 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:41.526714 (+ 45us) server_negotiation.cc:407] Connection header received
0808 04:44:41.527453 (+ 739us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:41.527478 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:41.527853 (+ 375us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:41.528234 (+ 381us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:41.528881 (+ 647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:41.528886 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:41.528901 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:41.528912 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:41.528971 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:41.528997 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:41.529128 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:41.529194 (+ 66us) server_negotiation.cc:299] Negotiation successful
0808 04:44:41.529341 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":134,"threads_started":1}
I20260808 04:44:41.531306 14946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1271e7f678c44bf8a074fc040f007e14: Bootstrap starting.
I20260808 04:44:41.533205 12881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:44:41.533908 14946 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1271e7f678c44bf8a074fc040f007e14: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:41.534818 14946 log.cc:824] T 00000000000000000000000000000000 P 1271e7f678c44bf8a074fc040f007e14: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:41.537186 14946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1271e7f678c44bf8a074fc040f007e14: No bootstrap required, opened a new log
I20260808 04:44:41.537326 14949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:41.535641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37575 (local address 127.12.148.126:42699)
0808 04:44:41.535739 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:41.535743 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:41.536057 (+ 314us) server_negotiation.cc:407] Connection header received
0808 04:44:41.536165 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:41.536167 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:41.536197 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:41.536257 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:41.536922 (+ 665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:41.536925 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:41.536927 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:41.536938 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:41.536965 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:41.536974 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:41.537034 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:41.537137 (+ 103us) server_negotiation.cc:299] Negotiation successful
0808 04:44:41.537168 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 04:44:41.540953 14946 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1271e7f678c44bf8a074fc040f007e14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1271e7f678c44bf8a074fc040f007e14" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 42699 } }
I20260808 04:44:41.541213 14946 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1271e7f678c44bf8a074fc040f007e14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:41.541281 14946 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1271e7f678c44bf8a074fc040f007e14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1271e7f678c44bf8a074fc040f007e14, State: Initialized, Role: FOLLOWER
I20260808 04:44:41.541728 14946 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1271e7f678c44bf8a074fc040f007e14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1271e7f678c44bf8a074fc040f007e14" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 42699 } }
I20260808 04:44:41.541868 14946 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1271e7f678c44bf8a074fc040f007e14 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:41.541944 14946 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1271e7f678c44bf8a074fc040f007e14 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:41.542043 14946 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1271e7f678c44bf8a074fc040f007e14 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:41.542963 14946 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1271e7f678c44bf8a074fc040f007e14 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1271e7f678c44bf8a074fc040f007e14" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 42699 } }
I20260808 04:44:41.543285 14946 leader_election.cc:302] T 00000000000000000000000000000000 P 1271e7f678c44bf8a074fc040f007e14 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1271e7f678c44bf8a074fc040f007e14; no voters:
I20260808 04:44:41.543578 14946 leader_election.cc:288] T 00000000000000000000000000000000 P 1271e7f678c44bf8a074fc040f007e14 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:41.543671 14958 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1271e7f678c44bf8a074fc040f007e14 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:41.543875 14958 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1271e7f678c44bf8a074fc040f007e14 [term 1 LEADER]: Becoming Leader. State: Replica: 1271e7f678c44bf8a074fc040f007e14, State: Running, Role: LEADER
I20260808 04:44:41.544211 14958 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1271e7f678c44bf8a074fc040f007e14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1271e7f678c44bf8a074fc040f007e14" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 42699 } }
I20260808 04:44:41.544766 14946 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1271e7f678c44bf8a074fc040f007e14 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:41.545912 14960 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1271e7f678c44bf8a074fc040f007e14 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1271e7f678c44bf8a074fc040f007e14. Latest consensus state: current_term: 1 leader_uuid: "1271e7f678c44bf8a074fc040f007e14" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1271e7f678c44bf8a074fc040f007e14" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 42699 } } }
I20260808 04:44:41.545948 14959 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1271e7f678c44bf8a074fc040f007e14 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1271e7f678c44bf8a074fc040f007e14" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1271e7f678c44bf8a074fc040f007e14" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 42699 } } }
I20260808 04:44:41.546049 14959 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1271e7f678c44bf8a074fc040f007e14 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:41.546048 14960 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1271e7f678c44bf8a074fc040f007e14 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:41.546454 14973 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:41.549373 14973 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:41.554257 14973 catalog_manager.cc:1347] Generated new cluster ID: 2fb8b0f823b8415db1aad1a33e51cfc0
I20260808 04:44:41.554322 14973 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:41.593325 14973 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:41.593755 14973 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:41.599579 14973 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1271e7f678c44bf8a074fc040f007e14: Generated new TSK 0
I20260808 04:44:41.600379 14973 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:44:41.604971 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 14850
2026-08-08T04:44:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1516 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164004017495-12881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:41 dist-test-slave-t7g5 krb5kdc[14994](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:41 dist-test-slave-t7g5 krb5kdc[14994](info): set up 2 sockets
Aug 08 04:44:41 dist-test-slave-t7g5 krb5kdc[14994](info): commencing operation
krb5kdc: starting...
W20260808 04:44:42.770048 12881 mini_kdc.cc:121] Time spent starting KDC: real 1.133s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Aug 08 04:44:42 dist-test-slave-t7g5 krb5kdc[14994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164282, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.148.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
I20260808 04:44:42.907465 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:42171
--webserver_interface=127.12.148.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:41097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:42171
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:43.024533 15009 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:43.024843 15009 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:43.024914 15009 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:43.029009 15009 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:43.029095 15009 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:43.029124 15009 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:43.029147 15009 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:43.029173 15009 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:43.035033 15009 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:41097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:42171
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:42171
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15009
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:43.036213 15009 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:43.037295 15009 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:43.045935 15024 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:43.046123 15009 server_base.cc:1034] running on GCE node
W20260808 04:44:43.045943 15018 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:43.045996 15020 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:43.046903 15009 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:43.048049 15009 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:43.049240 15009 hybrid_clock.cc:648] HybridClock initialized: now 1786164283049210 us; error 42 us; skew 500 ppm
Aug 08 04:44:43 dist-test-slave-t7g5 krb5kdc[14994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164283, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:43.052368 15009 init.cc:377] Logged in from keytab as kudu/127.12.148.126@KRBTEST.COM (short username kudu)
I20260808 04:44:43.053318 15009 webserver.cc:460] Webserver started at http://127.12.148.126:40781/ using document root <none> and password file <none>
I20260808 04:44:43.053947 15009 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:43.054024 15009 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:43.054241 15009 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:43.056373 15009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "7f94427a95934ddf9201c1eb615b1d42"
format_stamp: "Formatted at 2026-08-08 04:44:43 on dist-test-slave-t7g5"
server_key: "581fb8b30d5e545511be03c722da5c5e"
server_key_iv: "dd98339b45b82664688249b5da8b4dd6"
server_key_version: "encryptionkey@0"
I20260808 04:44:43.056933 15009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "7f94427a95934ddf9201c1eb615b1d42"
format_stamp: "Formatted at 2026-08-08 04:44:43 on dist-test-slave-t7g5"
server_key: "581fb8b30d5e545511be03c722da5c5e"
server_key_iv: "dd98339b45b82664688249b5da8b4dd6"
server_key_version: "encryptionkey@0"
I20260808 04:44:43.060758 15009 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 04:44:43.063297 15035 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:43.064692 15009 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 04:44:43.064805 15009 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "7f94427a95934ddf9201c1eb615b1d42"
format_stamp: "Formatted at 2026-08-08 04:44:43 on dist-test-slave-t7g5"
server_key: "581fb8b30d5e545511be03c722da5c5e"
server_key_iv: "dd98339b45b82664688249b5da8b4dd6"
server_key_version: "encryptionkey@0"
I20260808 04:44:43.064922 15009 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:43.076856 15009 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:43.080403 15009 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:43.080618 15009 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:43.088411 15009 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:42171
I20260808 04:44:43.088423 15107 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:42171 every 8 connection(s)
I20260808 04:44:43.089504 15009 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:43.092626 15111 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:43.095389 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 15009
I20260808 04:44:43.095530 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:44:43.095803 12881 external_mini_cluster.cc:1428] Setting key 7235929927747e7f3b9429ed08f07674
I20260808 04:44:43.099629 15111 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f94427a95934ddf9201c1eb615b1d42: Bootstrap starting.
I20260808 04:44:43.102281 15111 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7f94427a95934ddf9201c1eb615b1d42: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:43.103178 15111 log.cc:824] T 00000000000000000000000000000000 P 7f94427a95934ddf9201c1eb615b1d42: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:43.105276 15111 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f94427a95934ddf9201c1eb615b1d42: No bootstrap required, opened a new log
Aug 08 04:44:43 dist-test-slave-t7g5 krb5kdc[14994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164282, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:44:43.108914 15111 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7f94427a95934ddf9201c1eb615b1d42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f94427a95934ddf9201c1eb615b1d42" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 42171 } }
I20260808 04:44:43.109169 15111 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7f94427a95934ddf9201c1eb615b1d42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:43.109232 15111 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7f94427a95934ddf9201c1eb615b1d42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f94427a95934ddf9201c1eb615b1d42, State: Initialized, Role: FOLLOWER
I20260808 04:44:43.109728 15111 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7f94427a95934ddf9201c1eb615b1d42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f94427a95934ddf9201c1eb615b1d42" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 42171 } }
I20260808 04:44:43.109876 15111 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7f94427a95934ddf9201c1eb615b1d42 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:43.109943 15111 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7f94427a95934ddf9201c1eb615b1d42 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:43.110049 15111 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7f94427a95934ddf9201c1eb615b1d42 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:43.110997 15111 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7f94427a95934ddf9201c1eb615b1d42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f94427a95934ddf9201c1eb615b1d42" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 42171 } }
I20260808 04:44:43.111356 15111 leader_election.cc:302] T 00000000000000000000000000000000 P 7f94427a95934ddf9201c1eb615b1d42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7f94427a95934ddf9201c1eb615b1d42; no voters:
I20260808 04:44:43.111753 15111 leader_election.cc:288] T 00000000000000000000000000000000 P 7f94427a95934ddf9201c1eb615b1d42 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:43.111851 15118 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7f94427a95934ddf9201c1eb615b1d42 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:43.112180 15118 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7f94427a95934ddf9201c1eb615b1d42 [term 1 LEADER]: Becoming Leader. State: Replica: 7f94427a95934ddf9201c1eb615b1d42, State: Running, Role: LEADER
I20260808 04:44:43.112771 15116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:43.097257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55273 (local address 127.12.148.126:42171)
0808 04:44:43.097731 (+ 474us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:43.097750 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:43.097789 (+ 39us) server_negotiation.cc:407] Connection header received
0808 04:44:43.098467 (+ 678us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:43.098485 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:43.098857 (+ 372us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:43.099289 (+ 432us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:43.100310 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:43.101562 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:43.102788 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:43.103358 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:43.103499 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:43.106630 (+ 3131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:43.106636 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:43.106651 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:43.106683 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:43.109043 (+ 2360us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:43.109736 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:43.109742 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:43.109747 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:43.109937 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:43.110246 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:43.110249 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:43.110251 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:43.110692 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:43.110908 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:43.111201 (+ 293us) server_negotiation.cc:299] Negotiation successful
0808 04:44:43.111539 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":134,"threads_started":1}
I20260808 04:44:43.112687 15118 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7f94427a95934ddf9201c1eb615b1d42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f94427a95934ddf9201c1eb615b1d42" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 42171 } }
I20260808 04:44:43.114162 15111 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7f94427a95934ddf9201c1eb615b1d42 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:43.115331 15119 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f94427a95934ddf9201c1eb615b1d42 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7f94427a95934ddf9201c1eb615b1d42" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f94427a95934ddf9201c1eb615b1d42" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 42171 } } }
I20260808 04:44:43.115515 15119 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f94427a95934ddf9201c1eb615b1d42 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:43.115949 15129 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:43.116055 15122 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f94427a95934ddf9201c1eb615b1d42 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f94427a95934ddf9201c1eb615b1d42. Latest consensus state: current_term: 1 leader_uuid: "7f94427a95934ddf9201c1eb615b1d42" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f94427a95934ddf9201c1eb615b1d42" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 42171 } } }
I20260808 04:44:43.116201 12881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:44:43.116236 15122 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f94427a95934ddf9201c1eb615b1d42 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:43.120189 15129 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:43.128551 15129 catalog_manager.cc:1347] Generated new cluster ID: 4e480172981b44f2949ab9d04245ad73
I20260808 04:44:43.128628 15129 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:43.132733 15116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:43.118682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40565 (local address 127.12.148.126:42171)
0808 04:44:43.118801 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:43.118806 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:43.122043 (+ 3237us) server_negotiation.cc:407] Connection header received
0808 04:44:43.122247 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:43.122251 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:43.122303 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:43.122360 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:43.123227 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:43.124003 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:43.125289 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:43.125731 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:43.125893 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:43.128006 (+ 2113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:43.128010 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:43.128013 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:43.128050 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:43.130960 (+ 2910us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:43.131509 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:43.131512 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:43.131514 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:43.131602 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:43.131863 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:43.131865 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:43.131867 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:43.132068 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:43.132180 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:43.132432 (+ 252us) server_negotiation.cc:299] Negotiation successful
0808 04:44:43.132565 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 04:44:43.140848 15129 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:43.142040 15129 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:43.154219 15129 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7f94427a95934ddf9201c1eb615b1d42: Generated new TSK 0
I20260808 04:44:43.154968 15129 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:44:43.160349 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 15009
2026-08-08T04:44:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1556 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164004017495-12881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:43 dist-test-slave-t7g5 krb5kdc[15158](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:43 dist-test-slave-t7g5 krb5kdc[15158](info): set up 2 sockets
Aug 08 04:44:43 dist-test-slave-t7g5 krb5kdc[15158](info): commencing operation
krb5kdc: starting...
W20260808 04:44:44.322466 12881 mini_kdc.cc:121] Time spent starting KDC: real 1.129s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Aug 08 04:44:44 dist-test-slave-t7g5 krb5kdc[15158](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164284, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.148.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
I20260808 04:44:44.443747 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:33779
--webserver_interface=127.12.148.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:33043
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:33779
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:44.558566 15175 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:44.558851 15175 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:44.558912 15175 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:44.562991 15175 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:44.563066 15175 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:44.563094 15175 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:44.563117 15175 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:44.563141 15175 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:44.568397 15175 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:33043
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:33779
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:33779
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15175
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:44.569425 15175 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:44.570493 15175 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:44.578943 15183 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:44.578966 15184 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:44.579028 15175 server_base.cc:1034] running on GCE node
W20260808 04:44:44.579010 15187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:44.579809 15175 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:44.580901 15175 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:44.582086 15175 hybrid_clock.cc:648] HybridClock initialized: now 1786164284582066 us; error 30 us; skew 500 ppm
Aug 08 04:44:44 dist-test-slave-t7g5 krb5kdc[15158](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164284, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:44.584975 15175 init.cc:377] Logged in from keytab as kudu/127.12.148.126@KRBTEST.COM (short username kudu)
I20260808 04:44:44.585891 15175 webserver.cc:460] Webserver started at http://127.12.148.126:43393/ using document root <none> and password file <none>
I20260808 04:44:44.586429 15175 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:44.586490 15175 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:44.586663 15175 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:44.588694 15175 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "eb11da51eefc47509914ae73ce0f42b1"
format_stamp: "Formatted at 2026-08-08 04:44:44 on dist-test-slave-t7g5"
server_key: "4fb27665428ab9dae5535d392583262c"
server_key_iv: "350f67e47cbbb368bff7a7b84c9723f1"
server_key_version: "encryptionkey@0"
I20260808 04:44:44.589227 15175 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "eb11da51eefc47509914ae73ce0f42b1"
format_stamp: "Formatted at 2026-08-08 04:44:44 on dist-test-slave-t7g5"
server_key: "4fb27665428ab9dae5535d392583262c"
server_key_iv: "350f67e47cbbb368bff7a7b84c9723f1"
server_key_version: "encryptionkey@0"
I20260808 04:44:44.592945 15175 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260808 04:44:44.595432 15194 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:44.596678 15175 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 04:44:44.596787 15175 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "eb11da51eefc47509914ae73ce0f42b1"
format_stamp: "Formatted at 2026-08-08 04:44:44 on dist-test-slave-t7g5"
server_key: "4fb27665428ab9dae5535d392583262c"
server_key_iv: "350f67e47cbbb368bff7a7b84c9723f1"
server_key_version: "encryptionkey@0"
I20260808 04:44:44.596889 15175 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:44.608165 15175 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:44.611263 15175 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:44.611439 15175 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:44.618217 15175 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:33779
I20260808 04:44:44.618258 15270 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:33779 every 8 connection(s)
I20260808 04:44:44.619156 15175 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:44.620963 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 15175
I20260808 04:44:44.621090 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:44:44.621336 12881 external_mini_cluster.cc:1428] Setting key 65985c4f68a093f0cf7977130fa90c06
I20260808 04:44:44.622153 15274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:44.629289 15274 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb11da51eefc47509914ae73ce0f42b1: Bootstrap starting.
I20260808 04:44:44.631497 15278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:44.622634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33627 (local address 127.12.148.126:33779)
0808 04:44:44.623054 (+ 420us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:44.623075 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:44.623120 (+ 45us) server_negotiation.cc:407] Connection header received
0808 04:44:44.624002 (+ 882us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:44.624026 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:44.624461 (+ 435us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:44.624845 (+ 384us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:44.625293 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:44.626845 (+ 1552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:44.627748 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:44.628470 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:44.628644 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:44.629414 (+ 770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:44.629422 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:44.629437 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:44.629979 (+ 542us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:44.630053 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:44.630087 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:44.630194 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:44.630293 (+ 99us) server_negotiation.cc:299] Negotiation successful
0808 04:44:44.630507 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":271,"thread_start_us":107,"threads_started":1}
I20260808 04:44:44.632133 15274 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eb11da51eefc47509914ae73ce0f42b1: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:44.632865 15274 log.cc:824] T 00000000000000000000000000000000 P eb11da51eefc47509914ae73ce0f42b1: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:44.634140 12881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:44:44.634886 15274 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb11da51eefc47509914ae73ce0f42b1: No bootstrap required, opened a new log
I20260808 04:44:44.638854 15274 raft_consensus.cc:348] T 00000000000000000000000000000000 P eb11da51eefc47509914ae73ce0f42b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb11da51eefc47509914ae73ce0f42b1" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 33779 } }
I20260808 04:44:44.639142 15274 raft_consensus.cc:374] T 00000000000000000000000000000000 P eb11da51eefc47509914ae73ce0f42b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:44.639220 15274 raft_consensus.cc:729] T 00000000000000000000000000000000 P eb11da51eefc47509914ae73ce0f42b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb11da51eefc47509914ae73ce0f42b1, State: Initialized, Role: FOLLOWER
I20260808 04:44:44.639701 15274 consensus_queue.cc:260] T 00000000000000000000000000000000 P eb11da51eefc47509914ae73ce0f42b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb11da51eefc47509914ae73ce0f42b1" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 33779 } }
I20260808 04:44:44.639863 15274 raft_consensus.cc:388] T 00000000000000000000000000000000 P eb11da51eefc47509914ae73ce0f42b1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:44.639941 15274 raft_consensus.cc:482] T 00000000000000000000000000000000 P eb11da51eefc47509914ae73ce0f42b1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:44.640057 15274 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eb11da51eefc47509914ae73ce0f42b1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:44.640625 15278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:44.636044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39591 (local address 127.12.148.126:33779)
0808 04:44:44.636163 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:44.636168 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:44.636294 (+ 126us) server_negotiation.cc:407] Connection header received
0808 04:44:44.636378 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:44.636381 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:44.636429 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:44.636523 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:44.636736 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:44.638189 (+ 1453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:44.638981 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:44.639300 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:44.639419 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:44.640238 (+ 819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:44.640242 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:44.640244 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:44.640255 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:44.640281 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:44.640291 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:44.640346 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:44.640475 (+ 129us) server_negotiation.cc:299] Negotiation successful
0808 04:44:44.640520 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 04:44:44.641285 15274 raft_consensus.cc:504] T 00000000000000000000000000000000 P eb11da51eefc47509914ae73ce0f42b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb11da51eefc47509914ae73ce0f42b1" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 33779 } }
I20260808 04:44:44.641692 15274 leader_election.cc:302] T 00000000000000000000000000000000 P eb11da51eefc47509914ae73ce0f42b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eb11da51eefc47509914ae73ce0f42b1; no voters:
I20260808 04:44:44.642048 15274 leader_election.cc:288] T 00000000000000000000000000000000 P eb11da51eefc47509914ae73ce0f42b1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:44.642148 15290 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eb11da51eefc47509914ae73ce0f42b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:44.642364 15290 raft_consensus.cc:686] T 00000000000000000000000000000000 P eb11da51eefc47509914ae73ce0f42b1 [term 1 LEADER]: Becoming Leader. State: Replica: eb11da51eefc47509914ae73ce0f42b1, State: Running, Role: LEADER
I20260808 04:44:44.642683 15290 consensus_queue.cc:237] T 00000000000000000000000000000000 P eb11da51eefc47509914ae73ce0f42b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb11da51eefc47509914ae73ce0f42b1" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 33779 } }
I20260808 04:44:44.643290 15274 sys_catalog.cc:564] T 00000000000000000000000000000000 P eb11da51eefc47509914ae73ce0f42b1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:44.644304 15291 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb11da51eefc47509914ae73ce0f42b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eb11da51eefc47509914ae73ce0f42b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb11da51eefc47509914ae73ce0f42b1" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 33779 } } }
I20260808 04:44:44.644443 15291 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb11da51eefc47509914ae73ce0f42b1 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:44.644716 15292 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb11da51eefc47509914ae73ce0f42b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eb11da51eefc47509914ae73ce0f42b1. Latest consensus state: current_term: 1 leader_uuid: "eb11da51eefc47509914ae73ce0f42b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb11da51eefc47509914ae73ce0f42b1" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 33779 } } }
I20260808 04:44:44.644804 15292 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb11da51eefc47509914ae73ce0f42b1 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:44.644949 15301 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:44.648067 15301 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:44.653884 15301 catalog_manager.cc:1347] Generated new cluster ID: f1a3c41c6afc4ed3a4aae35b44b7b090
I20260808 04:44:44.653967 15301 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:44.661003 15301 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:44.661947 15301 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:44.666987 15301 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eb11da51eefc47509914ae73ce0f42b1: Generated new TSK 0
I20260808 04:44:44.667689 15301 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:44:44.675171 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 15175
2026-08-08T04:44:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1508 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164004017495-12881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:44 dist-test-slave-t7g5 krb5kdc[15316](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:44 dist-test-slave-t7g5 krb5kdc[15316](info): set up 2 sockets
Aug 08 04:44:44 dist-test-slave-t7g5 krb5kdc[15316](info): commencing operation
krb5kdc: starting...
W20260808 04:44:45.820214 12881 mini_kdc.cc:121] Time spent starting KDC: real 1.118s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Aug 08 04:44:45 dist-test-slave-t7g5 krb5kdc[15316](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164285, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.148.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
I20260808 04:44:45.946825 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:42587
--webserver_interface=127.12.148.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:43061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:42587
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:46.057868 15343 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:46.058139 15343 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:46.058180 15343 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:46.062077 15343 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:46.062124 15343 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:46.062141 15343 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:46.062156 15343 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:46.062170 15343 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:46.067147 15343 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:43061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:42587
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:42587
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15343
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:46.068050 15343 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:46.068966 15343 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:46.077069 15349 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:46.077103 15351 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:46.077097 15348 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:46.077170 15343 server_base.cc:1034] running on GCE node
I20260808 04:44:46.077929 15343 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:46.078967 15343 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:46.080137 15343 hybrid_clock.cc:648] HybridClock initialized: now 1786164286080118 us; error 29 us; skew 500 ppm
Aug 08 04:44:46 dist-test-slave-t7g5 krb5kdc[15316](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164286, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:46.085867 15343 init.cc:377] Logged in from keytab as kudu/127.12.148.126@KRBTEST.COM (short username kudu)
I20260808 04:44:46.086755 15343 webserver.cc:460] Webserver started at http://127.12.148.126:40925/ using document root <none> and password file <none>
I20260808 04:44:46.087275 15343 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:46.087344 15343 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:46.087509 15343 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:46.089494 15343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "f4dc8836548c4ac18dcffbe9d9f0af0f"
format_stamp: "Formatted at 2026-08-08 04:44:46 on dist-test-slave-t7g5"
server_key: "14f8a3dd22479b4da2f7fa5094231511"
server_key_iv: "506ca6eddfa2fda1fa8954b73be4e305"
server_key_version: "encryptionkey@0"
I20260808 04:44:46.090093 15343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "f4dc8836548c4ac18dcffbe9d9f0af0f"
format_stamp: "Formatted at 2026-08-08 04:44:46 on dist-test-slave-t7g5"
server_key: "14f8a3dd22479b4da2f7fa5094231511"
server_key_iv: "506ca6eddfa2fda1fa8954b73be4e305"
server_key_version: "encryptionkey@0"
I20260808 04:44:46.093636 15343 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:44:46.096035 15359 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:46.097245 15343 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 04:44:46.097357 15343 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "f4dc8836548c4ac18dcffbe9d9f0af0f"
format_stamp: "Formatted at 2026-08-08 04:44:46 on dist-test-slave-t7g5"
server_key: "14f8a3dd22479b4da2f7fa5094231511"
server_key_iv: "506ca6eddfa2fda1fa8954b73be4e305"
server_key_version: "encryptionkey@0"
I20260808 04:44:46.097458 15343 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:46.101859 15343 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:46.104830 15343 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:46.104974 15343 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:46.111323 15343 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:42587
I20260808 04:44:46.111380 15435 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:42587 every 8 connection(s)
I20260808 04:44:46.112236 15343 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:46.113190 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 15343
I20260808 04:44:46.113329 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:44:46.113618 12881 external_mini_cluster.cc:1428] Setting key 3ed289f7086db16788ddd07abe093f3b
I20260808 04:44:46.115496 15438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:46.118999 15444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:46.114970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50689 (local address 127.12.148.126:42587)
0808 04:44:46.115382 (+ 412us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:46.115400 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:46.115441 (+ 41us) server_negotiation.cc:407] Connection header received
0808 04:44:46.116270 (+ 829us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:46.116292 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:46.116637 (+ 345us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:46.116997 (+ 360us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:46.117605 (+ 608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:46.117610 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:46.117625 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:46.117634 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:46.117715 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:46.117754 (+ 39us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:46.117891 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:46.117958 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 04:44:46.118113 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270,"thread_start_us":119,"threads_started":1}
I20260808 04:44:46.121800 12881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 04:44:46.122212 15438 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4dc8836548c4ac18dcffbe9d9f0af0f: Bootstrap starting.
I20260808 04:44:46.124891 15438 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f4dc8836548c4ac18dcffbe9d9f0af0f: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:46.125607 15438 log.cc:824] T 00000000000000000000000000000000 P f4dc8836548c4ac18dcffbe9d9f0af0f: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:46.125728 15444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:46.124094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56429 (local address 127.12.148.126:42587)
0808 04:44:46.124214 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:46.124218 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:46.124386 (+ 168us) server_negotiation.cc:407] Connection header received
0808 04:44:46.124496 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:46.124499 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:46.124528 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:46.124590 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:46.125298 (+ 708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:46.125302 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:46.125305 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 04:44:46.125316 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:46.125344 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 04:44:46.125354 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:46.125423 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:46.125507 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 04:44:46.125546 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 04:44:46.127624 15438 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4dc8836548c4ac18dcffbe9d9f0af0f: No bootstrap required, opened a new log
I20260808 04:44:46.131203 15438 raft_consensus.cc:348] T 00000000000000000000000000000000 P f4dc8836548c4ac18dcffbe9d9f0af0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4dc8836548c4ac18dcffbe9d9f0af0f" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 42587 } }
I20260808 04:44:46.131453 15438 raft_consensus.cc:374] T 00000000000000000000000000000000 P f4dc8836548c4ac18dcffbe9d9f0af0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 04:44:46.131496 15438 raft_consensus.cc:729] T 00000000000000000000000000000000 P f4dc8836548c4ac18dcffbe9d9f0af0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4dc8836548c4ac18dcffbe9d9f0af0f, State: Initialized, Role: FOLLOWER
I20260808 04:44:46.131896 15438 consensus_queue.cc:260] T 00000000000000000000000000000000 P f4dc8836548c4ac18dcffbe9d9f0af0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4dc8836548c4ac18dcffbe9d9f0af0f" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 42587 } }
I20260808 04:44:46.132030 15438 raft_consensus.cc:388] T 00000000000000000000000000000000 P f4dc8836548c4ac18dcffbe9d9f0af0f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 04:44:46.132077 15438 raft_consensus.cc:482] T 00000000000000000000000000000000 P f4dc8836548c4ac18dcffbe9d9f0af0f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 04:44:46.132150 15438 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f4dc8836548c4ac18dcffbe9d9f0af0f [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:46.133033 15438 raft_consensus.cc:504] T 00000000000000000000000000000000 P f4dc8836548c4ac18dcffbe9d9f0af0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4dc8836548c4ac18dcffbe9d9f0af0f" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 42587 } }
I20260808 04:44:46.133359 15438 leader_election.cc:302] T 00000000000000000000000000000000 P f4dc8836548c4ac18dcffbe9d9f0af0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f4dc8836548c4ac18dcffbe9d9f0af0f; no voters:
I20260808 04:44:46.133670 15438 leader_election.cc:288] T 00000000000000000000000000000000 P f4dc8836548c4ac18dcffbe9d9f0af0f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 04:44:46.133791 15451 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f4dc8836548c4ac18dcffbe9d9f0af0f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:46.134043 15451 raft_consensus.cc:686] T 00000000000000000000000000000000 P f4dc8836548c4ac18dcffbe9d9f0af0f [term 1 LEADER]: Becoming Leader. State: Replica: f4dc8836548c4ac18dcffbe9d9f0af0f, State: Running, Role: LEADER
I20260808 04:44:46.134398 15451 consensus_queue.cc:237] T 00000000000000000000000000000000 P f4dc8836548c4ac18dcffbe9d9f0af0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4dc8836548c4ac18dcffbe9d9f0af0f" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 42587 } }
I20260808 04:44:46.135010 15438 sys_catalog.cc:564] T 00000000000000000000000000000000 P f4dc8836548c4ac18dcffbe9d9f0af0f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:46.136058 15452 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4dc8836548c4ac18dcffbe9d9f0af0f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f4dc8836548c4ac18dcffbe9d9f0af0f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4dc8836548c4ac18dcffbe9d9f0af0f" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 42587 } } }
I20260808 04:44:46.136191 15452 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4dc8836548c4ac18dcffbe9d9f0af0f [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:46.136487 15454 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4dc8836548c4ac18dcffbe9d9f0af0f [sys.catalog]: SysCatalogTable state changed. Reason: New leader f4dc8836548c4ac18dcffbe9d9f0af0f. Latest consensus state: current_term: 1 leader_uuid: "f4dc8836548c4ac18dcffbe9d9f0af0f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4dc8836548c4ac18dcffbe9d9f0af0f" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 42587 } } }
I20260808 04:44:46.136581 15454 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4dc8836548c4ac18dcffbe9d9f0af0f [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:46.136668 15466 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:46.139957 15466 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:46.145577 15466 catalog_manager.cc:1347] Generated new cluster ID: dec0dac335ec4fa88328fd9144b522e5
I20260808 04:44:46.145670 15466 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:46.164739 15466 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:46.165057 15466 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:46.172212 15466 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f4dc8836548c4ac18dcffbe9d9f0af0f: Generated new TSK 0
I20260808 04:44:46.172820 15466 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 04:44:46.177973 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 15343
2026-08-08T04:44:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1504 ms)
[----------] 18 tests from AuthTokenIssuingTest (27441 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:46 dist-test-slave-t7g5 krb5kdc[15485](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:46 dist-test-slave-t7g5 krb5kdc[15485](info): set up 2 sockets
Aug 08 04:44:46 dist-test-slave-t7g5 krb5kdc[15485](info): commencing operation
krb5kdc: starting...
W20260808 04:44:47.323299 12881 mini_kdc.cc:121] Time spent starting KDC: real 1.117s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Aug 08 04:44:47 dist-test-slave-t7g5 krb5kdc[15485](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164287, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.148.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
I20260808 04:44:47.444439 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:35507
--webserver_interface=127.12.148.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:41125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:35507,127.12.148.125:39777,127.12.148.124:43469
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:47.554962 15502 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 04:44:47.555225 15502 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:47.555250 15502 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:47.555310 15502 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:47.559248 15502 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:47.559300 15502 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:47.559319 15502 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:47.559333 15502 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:47.559347 15502 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:47.564479 15502 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:41125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:35507,127.12.148.125:39777,127.12.148.124:43469
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:35507
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15502
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:47.565399 15502 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:47.566386 15502 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:47.574553 15509 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:47.574582 15514 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:47.574546 15510 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:47.574801 15502 server_base.cc:1034] running on GCE node
I20260808 04:44:47.575443 15502 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:47.576464 15502 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:47.577622 15502 hybrid_clock.cc:648] HybridClock initialized: now 1786164287577607 us; error 26 us; skew 500 ppm
Aug 08 04:44:47 dist-test-slave-t7g5 krb5kdc[15485](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164287, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:47.580340 15502 init.cc:377] Logged in from keytab as kudu/127.12.148.126@KRBTEST.COM (short username kudu)
I20260808 04:44:47.581216 15502 webserver.cc:460] Webserver started at http://127.12.148.126:41057/ using document root <none> and password file <none>
I20260808 04:44:47.581782 15502 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:47.581847 15502 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:47.582046 15502 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:47.583998 15502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "2629ca17b79348b9ad3f20ebeb90d1bf"
format_stamp: "Formatted at 2026-08-08 04:44:47 on dist-test-slave-t7g5"
server_key: "9ae1f263c10ac62cef2ebde6b4b03e22"
server_key_iv: "d99e4c99b24f4909296dd0727b85c72b"
server_key_version: "encryptionkey@0"
I20260808 04:44:47.584518 15502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "2629ca17b79348b9ad3f20ebeb90d1bf"
format_stamp: "Formatted at 2026-08-08 04:44:47 on dist-test-slave-t7g5"
server_key: "9ae1f263c10ac62cef2ebde6b4b03e22"
server_key_iv: "d99e4c99b24f4909296dd0727b85c72b"
server_key_version: "encryptionkey@0"
I20260808 04:44:47.588021 15502 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 04:44:47.590325 15527 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:47.591466 15502 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:44:47.591578 15502 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "2629ca17b79348b9ad3f20ebeb90d1bf"
format_stamp: "Formatted at 2026-08-08 04:44:47 on dist-test-slave-t7g5"
server_key: "9ae1f263c10ac62cef2ebde6b4b03e22"
server_key_iv: "d99e4c99b24f4909296dd0727b85c72b"
server_key_version: "encryptionkey@0"
I20260808 04:44:47.591668 15502 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:47.621155 15502 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:47.624254 15502 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:47.624456 15502 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:47.631337 15502 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:35507
I20260808 04:44:47.631610 15598 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:35507 every 8 connection(s)
I20260808 04:44:47.632290 15502 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:47.635046 15599 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:47.638770 15599 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.148.126" port: 35507 } has no permanent_uuid. Determining permanent_uuid...
I20260808 04:44:47.640744 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 15502
I20260808 04:44:47.640882 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:44:47.641175 12881 external_mini_cluster.cc:1428] Setting key b0cbd849eb20ec06c50497cc9e9a1408
Aug 08 04:44:47 dist-test-slave-t7g5 krb5kdc[15485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164287, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.148.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.125@KRBTEST.COM" created.
I20260808 04:44:47.653077 15603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:47.641031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:35507 (local address 127.0.0.1:34958)
0808 04:44:47.641582 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:47.641620 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:47.642468 (+ 848us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:47.643131 (+ 663us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:47.643136 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:47.643580 (+ 444us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:47.643835 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:47.643849 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:47.644965 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:47.644967 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:47.645748 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:47.645760 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:47.646380 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:47.646384 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:47.646476 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:47.647012 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:47.647029 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:47.648439 (+ 1410us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:47.650336 (+ 1897us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:47.650346 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:47.650356 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:47.650575 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:47.650866 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:47.650869 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:47.650871 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:47.650979 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:47.651576 (+ 597us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:47.651582 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:47.651717 (+ 135us) client_negotiation.cc:769] Sending connection context
0808 04:44:47.651873 (+ 156us) client_negotiation.cc:240] Negotiation successful
0808 04:44:47.652302 (+ 429us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":389,"mutex_wait_us":113,"spinlock_wait_cycles":20608,"thread_start_us":165,"threads_started":1}
I20260808 04:44:47.653079 15601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:47.641029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34958 (local address 127.12.148.126:35507)
0808 04:44:47.641478 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:47.641495 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:47.641742 (+ 247us) server_negotiation.cc:407] Connection header received
0808 04:44:47.642760 (+ 1018us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:47.642764 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:47.642947 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:47.643110 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:47.643974 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:47.644849 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:47.645870 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:47.646237 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:47.646392 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:47.648571 (+ 2179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:47.648577 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:47.648587 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:47.648608 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:47.650235 (+ 1627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:47.650673 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:47.650678 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:47.650679 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:47.650781 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:47.651061 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:47.651064 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:47.651066 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:47.651466 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:47.651595 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:47.651949 (+ 354us) server_negotiation.cc:299] Negotiation successful
0808 04:44:47.652218 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":306,"thread_start_us":116,"threads_started":1}
I20260808 04:44:47.655557 15599 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.148.125" port: 39777 } has no permanent_uuid. Determining permanent_uuid...
I20260808 04:44:47.656255 15603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:47.656020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.125:39777 (local address 127.0.0.1:50982)
0808 04:44:47.656130 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:47.656198 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.125:39777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260808 04:44:47.656435 15533 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.148.125:39777: connect: Connection refused (error 111)
I20260808 04:44:47.657181 15603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:47.656993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.125:39777 (local address 127.0.0.1:50984)
0808 04:44:47.657089 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:47.657132 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.125:39777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260808 04:44:47.657302 15599 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.148.125:39777: Network error: Client connection negotiation failed: client connection to 127.12.148.125:39777: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.125.keytab.
Entry for principal kudu/127.12.148.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.125.keytab.
I20260808 04:44:47.666879 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.125:39777
--webserver_interface=127.12.148.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.125.keytab
--principal=kudu/127.12.148.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:41125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:35507,127.12.148.125:39777,127.12.148.124:43469
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 04:44:47.706550 15599 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.148.125" port: 39777 } attempt: 1
I20260808 04:44:47.707366 15603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:47.707087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.125:39777 (local address 127.0.0.1:51000)
0808 04:44:47.707225 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:47.707282 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.125:39777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260808 04:44:47.708007 15603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:47.707807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.125:39777 (local address 127.0.0.1:51010)
0808 04:44:47.707904 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:47.707948 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.125:39777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260808 04:44:47.708127 15599 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.148.125:39777: Network error: Client connection negotiation failed: client connection to 127.12.148.125:39777: connect: Connection refused (error 111)
W20260808 04:44:47.775854 15608 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 04:44:47.776122 15608 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:47.776157 15608 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:47.776218 15608 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260808 04:44:47.776296 15599 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.148.125" port: 39777 } attempt: 2
I20260808 04:44:47.777181 15603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:47.776902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.125:39777 (local address 127.0.0.1:51024)
0808 04:44:47.777051 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:47.777108 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.125:39777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260808 04:44:47.777845 15603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:47.777622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.125:39777 (local address 127.0.0.1:51030)
0808 04:44:47.777734 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:47.777779 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.125:39777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260808 04:44:47.777956 15599 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.148.125:39777: Network error: Client connection negotiation failed: client connection to 127.12.148.125:39777: connect: Connection refused (error 111)
W20260808 04:44:47.780323 15608 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:47.780373 15608 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:47.780400 15608 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:47.780428 15608 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:47.780458 15608 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:47.785548 15608 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:41125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:35507,127.12.148.125:39777,127.12.148.124:43469
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.125.keytab
--principal=kudu/127.12.148.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.125:39777
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.148.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15608
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:47.786577 15608 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:47.787551 15608 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:47.795770 15623 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:47.795805 15620 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:47.795966 15608 server_base.cc:1034] running on GCE node
W20260808 04:44:47.795776 15618 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:47.796648 15608 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:47.797719 15608 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:47.798879 15608 hybrid_clock.cc:648] HybridClock initialized: now 1786164287798860 us; error 34 us; skew 500 ppm
Aug 08 04:44:47 dist-test-slave-t7g5 krb5kdc[15485](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164287, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:47.801543 15608 init.cc:377] Logged in from keytab as kudu/127.12.148.125@KRBTEST.COM (short username kudu)
I20260808 04:44:47.802475 15608 webserver.cc:460] Webserver started at http://127.12.148.125:38229/ using document root <none> and password file <none>
I20260808 04:44:47.803032 15608 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:47.803093 15608 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:47.803294 15608 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:47.805286 15608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-1/data/instance:
uuid: "7dc5a7c32f85427593fc2392ba83b04e"
format_stamp: "Formatted at 2026-08-08 04:44:47 on dist-test-slave-t7g5"
server_key: "929d7fdc9b9b6d1e536ed24b2d67b911"
server_key_iv: "e5e1d1318bf37d4432ee03cad4b6ee6c"
server_key_version: "encryptionkey@0"
I20260808 04:44:47.805842 15608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-1/wal/instance:
uuid: "7dc5a7c32f85427593fc2392ba83b04e"
format_stamp: "Formatted at 2026-08-08 04:44:47 on dist-test-slave-t7g5"
server_key: "929d7fdc9b9b6d1e536ed24b2d67b911"
server_key_iv: "e5e1d1318bf37d4432ee03cad4b6ee6c"
server_key_version: "encryptionkey@0"
I20260808 04:44:47.809326 15608 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260808 04:44:47.811640 15636 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:47.812808 15608 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:44:47.812924 15608 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-1/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-1/wal
uuid: "7dc5a7c32f85427593fc2392ba83b04e"
format_stamp: "Formatted at 2026-08-08 04:44:47 on dist-test-slave-t7g5"
server_key: "929d7fdc9b9b6d1e536ed24b2d67b911"
server_key_iv: "e5e1d1318bf37d4432ee03cad4b6ee6c"
server_key_version: "encryptionkey@0"
I20260808 04:44:47.813030 15608 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:47.836884 15608 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:47.840009 15608 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:47.840166 15608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:47.846854 15608 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.125:39777
I20260808 04:44:47.847124 15715 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.125:39777 every 8 connection(s)
I20260808 04:44:47.847788 15608 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-1/data/info.pb
I20260808 04:44:47.850622 15716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:47.853695 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 15608
I20260808 04:44:47.853809 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-1/wal/instance
I20260808 04:44:47.854061 12881 external_mini_cluster.cc:1428] Setting key b8b755f6b1b147347944f861074d933b
I20260808 04:44:47.854403 15716 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.148.126" port: 35507 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.12.148.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.124@KRBTEST.COM" created.
Aug 08 04:44:47 dist-test-slave-t7g5 krb5kdc[15485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164287, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.125@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:44:47.869117 15599 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.148.125" port: 39777 } attempt: 3
I20260808 04:44:47.871454 15601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:47.856241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34972 (local address 127.12.148.126:35507)
0808 04:44:47.856405 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:47.856410 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:47.857308 (+ 898us) server_negotiation.cc:407] Connection header received
0808 04:44:47.858459 (+ 1151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:47.858462 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:47.858511 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:47.858598 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:47.860195 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:47.860733 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:47.862407 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:47.862656 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:47.862755 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:47.867256 (+ 4501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:47.867260 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:47.867262 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:47.867288 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:47.868837 (+ 1549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:47.869455 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:47.869458 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:47.869460 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:47.869555 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:47.870205 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:47.870207 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:47.870209 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:47.870398 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:47.870485 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:47.871153 (+ 668us) server_negotiation.cc:299] Negotiation successful
0808 04:44:47.871278 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 04:44:47.872414 15726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:47.856615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:35507 (local address 127.0.0.1:34972)
0808 04:44:47.857123 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:47.857181 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:47.858205 (+ 1024us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:47.858786 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:47.858795 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:47.859344 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:47.860031 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:47.860052 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:47.860862 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:47.860866 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:47.862267 (+ 1401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:47.862279 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:47.862834 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:47.862838 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:47.863062 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:47.863648 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:47.863670 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:47.867078 (+ 3408us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:47.868963 (+ 1885us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:47.868968 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:47.868988 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:47.869349 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:47.869923 (+ 574us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:47.869926 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:47.869928 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:47.870100 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:47.870500 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:47.870506 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:47.870835 (+ 329us) client_negotiation.cc:769] Sending connection context
0808 04:44:47.871049 (+ 214us) client_negotiation.cc:240] Negotiation successful
0808 04:44:47.871418 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":125,"threads_started":1}
I20260808 04:44:47.873804 15716 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.148.125" port: 39777 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 04:44:47 dist-test-slave-t7g5 krb5kdc[15485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164287, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for kudu/127.12.148.125@KRBTEST.COM
Aug 08 04:44:47 dist-test-slave-t7g5 krb5kdc[15485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164287, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.125@KRBTEST.COM for kudu/127.12.148.125@KRBTEST.COM
I20260808 04:44:47.881752 15603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:47.869589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.125:39777 (local address 127.0.0.1:51046)
0808 04:44:47.869729 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:47.869744 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:47.869820 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:47.870562 (+ 742us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:47.870564 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:47.870730 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:47.871323 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:47.871334 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:47.872636 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:47.872639 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:47.873377 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:47.873386 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:47.874195 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:47.874199 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:47.874302 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:47.874723 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:47.874737 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:47.877451 (+ 2714us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:47.879347 (+ 1896us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:47.879350 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:47.879352 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:47.879569 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:47.880538 (+ 969us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:47.880541 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:47.880543 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:47.880639 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:47.881206 (+ 567us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:47.881209 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:47.881293 (+ 84us) client_negotiation.cc:769] Sending connection context
0808 04:44:47.881417 (+ 124us) client_negotiation.cc:240] Negotiation successful
0808 04:44:47.881590 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 04:44:47.881852 15732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:47.869735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51046 (local address 127.12.148.125:39777)
0808 04:44:47.870074 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:47.870085 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:47.870109 (+ 24us) server_negotiation.cc:407] Connection header received
0808 04:44:47.870152 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:47.870157 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:47.870392 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:47.870592 (+ 200us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:47.871455 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:47.872508 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:47.873495 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:47.874066 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:47.874174 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:47.877566 (+ 3392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:47.877577 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:47.877590 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:47.877613 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:47.879251 (+ 1638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:47.879680 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:47.879685 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:47.879686 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:47.880420 (+ 734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:47.880754 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:47.880757 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:47.880758 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:47.881104 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:47.881245 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:47.881505 (+ 260us) server_negotiation.cc:299] Negotiation successful
0808 04:44:47.881647 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":231,"thread_start_us":112,"threads_started":1}
I20260808 04:44:47.882565 15726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:47.874294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.125:39777 (local address 127.0.0.1:51048)
0808 04:44:47.874394 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:47.874408 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:47.874489 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:47.875255 (+ 766us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:47.875258 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:47.875399 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:47.875495 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:47.875499 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:47.876238 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:47.876241 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:47.876868 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:47.876879 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:47.877450 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:47.877453 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:47.877531 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:47.877935 (+ 404us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:47.877950 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:47.879267 (+ 1317us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:47.881021 (+ 1754us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:47.881024 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:47.881026 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:47.881252 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:47.881527 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:47.881529 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:47.881531 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:47.881618 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:47.882081 (+ 463us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:47.882085 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:47.882165 (+ 80us) client_negotiation.cc:769] Sending connection context
0808 04:44:47.882253 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 04:44:47.882390 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 04:44:47.882616 15734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:47.874734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51048 (local address 127.12.148.125:39777)
0808 04:44:47.875046 (+ 312us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:47.875054 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:47.875068 (+ 14us) server_negotiation.cc:407] Connection header received
0808 04:44:47.875100 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:47.875102 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:47.875141 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:47.875225 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:47.875592 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:47.876115 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:47.877001 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:47.877347 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:47.877450 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:47.879391 (+ 1941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:47.879394 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:47.879396 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:47.879422 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:47.880827 (+ 1405us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:47.881341 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:47.881344 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:47.881346 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:47.881441 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:47.881757 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:47.881760 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:47.881761 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:47.881967 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:47.882081 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:47.882310 (+ 229us) server_negotiation.cc:299] Negotiation successful
0808 04:44:47.882446 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":40,"server-negotiator.queue_time_us":245,"thread_start_us":100,"threads_started":1}
I20260808 04:44:47.883957 15599 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.148.124" port: 43469 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.124.keytab.
Entry for principal kudu/127.12.148.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.124.keytab.
I20260808 04:44:47.884052 15716 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.148.124" port: 43469 } has no permanent_uuid. Determining permanent_uuid...
I20260808 04:44:47.884637 15603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:47.884389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:43469 (local address 127.0.0.1:53654)
0808 04:44:47.884510 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:47.884566 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.124:43469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260808 04:44:47.884675 15726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:47.884422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:43469 (local address 127.0.0.1:53670)
0808 04:44:47.884555 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:47.884619 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.124:43469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
W20260808 04:44:47.884826 15638 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.148.124:43469: connect: Connection refused (error 111)
I20260808 04:44:47.885171 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.124:43469
--webserver_interface=127.12.148.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.124.keytab
--principal=kudu/127.12.148.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:41125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:35507,127.12.148.125:39777,127.12.148.124:43469
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 04:44:47.885376 15603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:47.885089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:43469 (local address 127.0.0.1:53682)
0808 04:44:47.885266 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:47.885314 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.124:43469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118}
W20260808 04:44:47.885495 15599 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.148.124:43469: Network error: Client connection negotiation failed: client connection to 127.12.148.124:43469: connect: Connection refused (error 111)
I20260808 04:44:47.885749 15726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:47.885395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:43469 (local address 127.0.0.1:53690)
0808 04:44:47.885614 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:47.885680 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.124:43469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":76,"threads_started":1}
W20260808 04:44:47.885875 15716 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.148.124:43469: Network error: Client connection negotiation failed: client connection to 127.12.148.124:43469: connect: Connection refused (error 111)
I20260808 04:44:47.916651 15599 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.148.124" port: 43469 } attempt: 1
I20260808 04:44:47.917590 15603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:47.917266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:43469 (local address 127.0.0.1:53696)
0808 04:44:47.917433 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:47.917509 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.124:43469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260808 04:44:47.918267 15603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:47.918047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:43469 (local address 127.0.0.1:53710)
0808 04:44:47.918152 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:47.918201 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.124:43469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260808 04:44:47.918412 15599 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.148.124:43469: Network error: Client connection negotiation failed: client connection to 127.12.148.124:43469: connect: Connection refused (error 111)
I20260808 04:44:47.935156 15716 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.148.124" port: 43469 } attempt: 1
I20260808 04:44:47.936070 15726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:47.935784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:43469 (local address 127.0.0.1:53722)
0808 04:44:47.935933 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:47.935992 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.124:43469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260808 04:44:47.936797 15726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:47.936588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:43469 (local address 127.0.0.1:53726)
0808 04:44:47.936686 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:47.936733 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.124:43469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260808 04:44:47.936950 15716 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.148.124:43469: Network error: Client connection negotiation failed: client connection to 127.12.148.124:43469: connect: Connection refused (error 111)
I20260808 04:44:47.993577 15599 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.148.124" port: 43469 } attempt: 2
I20260808 04:44:47.994481 15603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:47.994179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:43469 (local address 127.0.0.1:53728)
0808 04:44:47.994324 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:47.994390 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.124:43469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260808 04:44:47.995148 15603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:47.994948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:43469 (local address 127.0.0.1:53734)
0808 04:44:47.995045 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:47.995092 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.124:43469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260808 04:44:47.995299 15599 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.148.124:43469: Network error: Client connection negotiation failed: client connection to 127.12.148.124:43469: connect: Connection refused (error 111)
W20260808 04:44:47.996933 15737 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 04:44:47.997186 15737 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:47.997213 15737 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:47.997272 15737 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:48.001236 15737 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:48.001291 15737 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:48.001309 15737 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:48.001324 15737 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:48.001343 15737 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:48.005120 15716 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.148.124" port: 43469 } attempt: 2
I20260808 04:44:48.005990 15726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:48.005683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:43469 (local address 127.0.0.1:53740)
0808 04:44:48.005851 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:48.005915 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.124:43469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260808 04:44:48.006691 15726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:48.006485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:43469 (local address 127.0.0.1:53754)
0808 04:44:48.006588 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:48.006631 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.124:43469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260808 04:44:48.006807 15716 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.148.124:43469: Network error: Client connection negotiation failed: client connection to 127.12.148.124:43469: connect: Connection refused (error 111)
I20260808 04:44:48.006963 15737 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:41125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:35507,127.12.148.125:39777,127.12.148.124:43469
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.124.keytab
--principal=kudu/127.12.148.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.124:43469
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.148.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15737
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:48.008038 15737 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:48.009073 15737 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:48.017320 15744 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:48.017323 15749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:48.017323 15745 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:48.017634 15737 server_base.cc:1034] running on GCE node
I20260808 04:44:48.018400 15737 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:48.019533 15737 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:48.020723 15737 hybrid_clock.cc:648] HybridClock initialized: now 1786164288020685 us; error 46 us; skew 500 ppm
Aug 08 04:44:48 dist-test-slave-t7g5 krb5kdc[15485](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164288, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:48.023689 15737 init.cc:377] Logged in from keytab as kudu/127.12.148.124@KRBTEST.COM (short username kudu)
I20260808 04:44:48.024629 15737 webserver.cc:460] Webserver started at http://127.12.148.124:37679/ using document root <none> and password file <none>
I20260808 04:44:48.025177 15737 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:48.025269 15737 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:48.025477 15737 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:48.027611 15737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-2/data/instance:
uuid: "0c573857e3a444bf9b4b156337159c9b"
format_stamp: "Formatted at 2026-08-08 04:44:48 on dist-test-slave-t7g5"
server_key: "a833c3620ab6321c70ed0230c68e5ccc"
server_key_iv: "239e85b02fea7f7029217c8ffcbd257a"
server_key_version: "encryptionkey@0"
I20260808 04:44:48.028194 15737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-2/wal/instance:
uuid: "0c573857e3a444bf9b4b156337159c9b"
format_stamp: "Formatted at 2026-08-08 04:44:48 on dist-test-slave-t7g5"
server_key: "a833c3620ab6321c70ed0230c68e5ccc"
server_key_iv: "239e85b02fea7f7029217c8ffcbd257a"
server_key_version: "encryptionkey@0"
I20260808 04:44:48.032088 15737 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 04:44:48.034539 15759 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:48.035777 15737 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 04:44:48.035899 15737 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-2/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-2/wal
uuid: "0c573857e3a444bf9b4b156337159c9b"
format_stamp: "Formatted at 2026-08-08 04:44:48 on dist-test-slave-t7g5"
server_key: "a833c3620ab6321c70ed0230c68e5ccc"
server_key_iv: "239e85b02fea7f7029217c8ffcbd257a"
server_key_version: "encryptionkey@0"
I20260808 04:44:48.036000 15737 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:48.047262 15737 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:48.050474 15737 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:48.050652 15737 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:48.057087 15737 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.124:43469
I20260808 04:44:48.057332 15830 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.124:43469 every 8 connection(s)
I20260808 04:44:48.058168 15737 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-2/data/info.pb
I20260808 04:44:48.060798 15832 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:48.062150 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 15737
I20260808 04:44:48.062273 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786164004017495-12881-0/minicluster-data/master-2/wal/instance
I20260808 04:44:48.062525 12881 external_mini_cluster.cc:1428] Setting key 8219e948209c18365ac7281aeca476e6
I20260808 04:44:48.064980 15832 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.148.126" port: 35507 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 04:44:48 dist-test-slave-t7g5 krb5kdc[15485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164287, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.148.124@KRBTEST.COM
Aug 08 04:44:48 dist-test-slave-t7g5 krb5kdc[15485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164288, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.124@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:44:48.075711 15601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:48.066830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34974 (local address 127.12.148.126:35507)
0808 04:44:48.066973 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:48.066977 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:48.067277 (+ 300us) server_negotiation.cc:407] Connection header received
0808 04:44:48.067404 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:48.067407 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:48.067448 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:48.067511 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:48.068231 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:48.068703 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:48.069602 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:48.069942 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:48.070070 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:48.072338 (+ 2268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:48.072341 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:48.072343 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:48.072367 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:48.073863 (+ 1496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:48.074362 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:48.074366 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:48.074368 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:48.074442 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:48.074683 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:48.074685 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:48.074686 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:48.074906 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:48.074997 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:48.075494 (+ 497us) server_negotiation.cc:299] Negotiation successful
0808 04:44:48.075589 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 04:44:48.076481 15836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:48.066750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:35507 (local address 127.0.0.1:34974)
0808 04:44:48.067150 (+ 400us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:48.067197 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:48.067314 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:48.067566 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:48.067571 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:48.067998 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:48.068109 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:48.068114 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:48.068815 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:48.068817 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:48.069479 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:48.069489 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:48.070097 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:48.070100 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:48.070177 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:48.070613 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:48.070629 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:48.072203 (+ 1574us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:48.073961 (+ 1758us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:48.073968 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:48.073973 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:48.074271 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:48.074523 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:48.074526 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:48.074528 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:48.074608 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:48.075008 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:48.075014 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:48.075147 (+ 133us) client_negotiation.cc:769] Sending connection context
0808 04:44:48.075282 (+ 135us) client_negotiation.cc:240] Negotiation successful
0808 04:44:48.075558 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"mutex_wait_us":145,"thread_start_us":144,"threads_started":1}
I20260808 04:44:48.076481 15835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:48.063775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53762 (local address 127.12.148.124:43469)
0808 04:44:48.064168 (+ 393us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:48.064187 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:48.064227 (+ 40us) server_negotiation.cc:407] Connection header received
0808 04:44:48.065026 (+ 799us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:48.065047 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:48.065460 (+ 413us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:48.065827 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:48.066485 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:48.067809 (+ 1324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:48.068638 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:48.069131 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:48.069269 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:48.071841 (+ 2572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:48.071848 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:48.071860 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:48.071886 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:48.073443 (+ 1557us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:48.073942 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:48.073948 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:48.073953 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:48.074105 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:48.074368 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:48.074370 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:48.074371 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:48.074802 (+ 431us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:48.074977 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:48.075203 (+ 226us) server_negotiation.cc:299] Negotiation successful
0808 04:44:48.075498 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":254,"thread_start_us":98,"threads_started":1}
I20260808 04:44:48.077700 15832 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.148.125" port: 39777 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 04:44:48 dist-test-slave-t7g5 krb5kdc[15485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164288, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.124@KRBTEST.COM for kudu/127.12.148.125@KRBTEST.COM
Aug 08 04:44:48 dist-test-slave-t7g5 krb5kdc[15485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164287, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:44:48.085636 15836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:48.078168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.125:39777 (local address 127.0.0.1:51064)
0808 04:44:48.078314 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:48.078326 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:48.078388 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:48.078657 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:48.078660 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:48.078815 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:48.078923 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:48.078929 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:48.079659 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:48.079663 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:48.080168 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:48.080176 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:48.080613 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:48.080617 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:48.080707 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:48.081110 (+ 403us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:48.081123 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:48.082540 (+ 1417us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:48.084198 (+ 1658us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:48.084202 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:48.084204 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:48.084461 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:48.084730 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:48.084733 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:48.084735 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:48.084815 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:48.085170 (+ 355us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:48.085173 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:48.085267 (+ 94us) client_negotiation.cc:769] Sending connection context
0808 04:44:48.085352 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 04:44:48.085475 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":88}
I20260808 04:44:48.085685 15734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:48.078326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51064 (local address 127.12.148.125:39777)
0808 04:44:48.078444 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:48.078449 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:48.078462 (+ 13us) server_negotiation.cc:407] Connection header received
0808 04:44:48.078503 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:48.078505 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:48.078553 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:48.078623 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:48.079042 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:48.079562 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:48.080274 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:48.080520 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:48.080607 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:48.082680 (+ 2073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:48.082684 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:48.082687 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:48.082717 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:48.084098 (+ 1381us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:48.084557 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:48.084561 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:48.084563 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:48.084645 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:48.084895 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:48.084898 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:48.084900 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:48.085080 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:48.085166 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:48.085416 (+ 250us) server_negotiation.cc:299] Negotiation successful
0808 04:44:48.085530 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 04:44:48.086273 15832 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.148.124" port: 43469 } has no permanent_uuid. Determining permanent_uuid...
I20260808 04:44:48.086663 15601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:48.078770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34986 (local address 127.12.148.126:35507)
0808 04:44:48.078869 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:48.078872 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:48.078884 (+ 12us) server_negotiation.cc:407] Connection header received
0808 04:44:48.078995 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:48.078998 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:48.079036 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:48.079097 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:48.079645 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:48.080105 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:48.080804 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:48.081021 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:48.081102 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:48.083715 (+ 2613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:48.083718 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:48.083720 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:48.083742 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:48.085111 (+ 1369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:48.085483 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:48.085486 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:48.085488 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:48.085564 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:48.085877 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:48.085881 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:48.085882 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:48.086075 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:48.086291 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:48.086422 (+ 131us) server_negotiation.cc:299] Negotiation successful
0808 04:44:48.086523 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
Aug 08 04:44:48 dist-test-slave-t7g5 krb5kdc[15485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164288, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.124@KRBTEST.COM for kudu/127.12.148.124@KRBTEST.COM
Aug 08 04:44:48 dist-test-slave-t7g5 krb5kdc[15485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164287, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.148.125@KRBTEST.COM
I20260808 04:44:48.094311 15836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:48.086703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:43469 (local address 127.0.0.1:53764)
0808 04:44:48.086897 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:48.086907 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:48.086969 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:48.087256 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:48.087259 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:48.087392 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:48.087457 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:48.087462 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:48.088190 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:48.088193 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:48.088936 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:48.088948 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:48.089433 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:48.089436 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:48.089496 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:48.089980 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:48.089994 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:48.091345 (+ 1351us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:48.092920 (+ 1575us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:48.092924 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:48.092925 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:48.093139 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:48.093411 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:48.093422 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:48.093424 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:48.093489 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:48.093863 (+ 374us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:48.093866 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:48.093940 (+ 74us) client_negotiation.cc:769] Sending connection context
0808 04:44:48.094022 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 04:44:48.094149 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142}
I20260808 04:44:48.094374 15835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:48.086908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53764 (local address 127.12.148.124:43469)
0808 04:44:48.087090 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:48.087093 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:48.087103 (+ 10us) server_negotiation.cc:407] Connection header received
0808 04:44:48.087130 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:48.087132 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:48.087162 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:48.087227 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:48.087548 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:48.088097 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:48.089044 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:48.089326 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:48.089428 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:48.091471 (+ 2043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:48.091476 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:48.091478 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:48.091503 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:48.092809 (+ 1306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:48.093233 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:48.093236 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:48.093238 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:48.093328 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:48.093570 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:48.093573 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:48.093575 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:48.093782 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:48.093863 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:48.094073 (+ 210us) server_negotiation.cc:299] Negotiation successful
0808 04:44:48.094198 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":41,"server-negotiator.queue_time_us":128}
I20260808 04:44:48.094551 15599 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.148.124" port: 43469 } attempt: 3
I20260808 04:44:48.096962 15734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:48.087759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51076 (local address 127.12.148.125:39777)
0808 04:44:48.087853 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:48.087856 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:48.088336 (+ 480us) server_negotiation.cc:407] Connection header received
0808 04:44:48.088421 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:48.088423 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:48.088459 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:48.088518 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:48.089179 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:48.089882 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:48.090814 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:48.091144 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:48.091222 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:48.093516 (+ 2294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:48.093519 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:48.093522 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:48.093546 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:48.095232 (+ 1686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:48.095751 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:48.095754 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:48.095756 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:48.095841 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:48.096122 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:48.096125 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:48.096127 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:48.096352 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:48.096538 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:48.096701 (+ 163us) server_negotiation.cc:299] Negotiation successful
0808 04:44:48.096807 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 04:44:48.098359 15832 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c573857e3a444bf9b4b156337159c9b: Bootstrap starting.
I20260808 04:44:48.100138 12881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
Aug 08 04:44:48 dist-test-slave-t7g5 krb5kdc[15485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164287, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for kudu/127.12.148.124@KRBTEST.COM
I20260808 04:44:48.101202 15832 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0c573857e3a444bf9b4b156337159c9b: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:48.101735 15716 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.148.124" port: 43469 } attempt: 3
I20260808 04:44:48.102190 15832 log.cc:824] T 00000000000000000000000000000000 P 0c573857e3a444bf9b4b156337159c9b: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:48.101392 15563 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "2629ca17b79348b9ad3f20ebeb90d1bf"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34986
I20260808 04:44:48.104486 15603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:48.094933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:43469 (local address 127.0.0.1:53778)
0808 04:44:48.095057 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:48.095070 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:48.095144 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:48.095684 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:48.095687 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:48.095853 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:48.095951 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:48.095957 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:48.096960 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:48.096963 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:48.097624 (+ 661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:48.097635 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:48.098816 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:48.098820 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:48.098903 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:48.099338 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:48.099352 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:48.100598 (+ 1246us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:48.102827 (+ 2229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:48.102831 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:48.102833 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:48.103083 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:48.103394 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:48.103397 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:48.103399 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:48.103507 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:48.103971 (+ 464us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:48.103974 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:48.104081 (+ 107us) client_negotiation.cc:769] Sending connection context
0808 04:44:48.104192 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 04:44:48.104332 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260808 04:44:48.104537 15837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:48.095105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53778 (local address 127.12.148.124:43469)
0808 04:44:48.095463 (+ 358us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:48.095471 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:48.095484 (+ 13us) server_negotiation.cc:407] Connection header received
0808 04:44:48.095514 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:48.095516 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:48.095556 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:48.096039 (+ 483us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:48.096113 (+ 74us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:48.096837 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:48.098389 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:48.098696 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:48.098816 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:48.100742 (+ 1926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:48.100745 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:48.100748 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:48.100784 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:48.102725 (+ 1941us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:48.103198 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:48.103202 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:48.103204 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:48.103303 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:48.103592 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:48.103596 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:48.103598 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:48.103867 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:48.103964 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:48.104243 (+ 279us) server_negotiation.cc:299] Negotiation successful
0808 04:44:48.104357 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":22,"server-negotiator.queue_time_us":277,"thread_start_us":135,"threads_started":1}
I20260808 04:44:48.105049 15832 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c573857e3a444bf9b4b156337159c9b: No bootstrap required, opened a new log
Aug 08 04:44:48 dist-test-slave-t7g5 krb5kdc[15485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164287, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.125@KRBTEST.COM for kudu/127.12.148.124@KRBTEST.COM
I20260808 04:44:48.107590 15599 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2629ca17b79348b9ad3f20ebeb90d1bf: Bootstrap starting.
I20260808 04:44:48.109028 15832 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0c573857e3a444bf9b4b156337159c9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2629ca17b79348b9ad3f20ebeb90d1bf" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 35507 } } peers { permanent_uuid: "7dc5a7c32f85427593fc2392ba83b04e" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 39777 } } peers { permanent_uuid: "0c573857e3a444bf9b4b156337159c9b" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 43469 } }
I20260808 04:44:48.109217 15832 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0c573857e3a444bf9b4b156337159c9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c573857e3a444bf9b4b156337159c9b, State: Initialized, Role: FOLLOWER
I20260808 04:44:48.109483 15832 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0c573857e3a444bf9b4b156337159c9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2629ca17b79348b9ad3f20ebeb90d1bf" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 35507 } } peers { permanent_uuid: "7dc5a7c32f85427593fc2392ba83b04e" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 39777 } } peers { permanent_uuid: "0c573857e3a444bf9b4b156337159c9b" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 43469 } }
I20260808 04:44:48.109947 15839 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c573857e3a444bf9b4b156337159c9b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2629ca17b79348b9ad3f20ebeb90d1bf" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 35507 } } peers { permanent_uuid: "7dc5a7c32f85427593fc2392ba83b04e" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 39777 } } peers { permanent_uuid: "0c573857e3a444bf9b4b156337159c9b" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 43469 } } }
I20260808 04:44:48.110072 15839 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c573857e3a444bf9b4b156337159c9b [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:44:48.110409 15599 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2629ca17b79348b9ad3f20ebeb90d1bf: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:48.110728 15832 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0c573857e3a444bf9b4b156337159c9b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:48.111295 15726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:48.102084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:43469 (local address 127.0.0.1:53780)
0808 04:44:48.102237 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:48.102250 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:48.102317 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:48.103294 (+ 977us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:48.103297 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:48.103454 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:48.103548 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:48.103554 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:48.104400 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:48.104404 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:48.105148 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:48.105159 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:48.105799 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:48.105802 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:48.105884 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:48.106312 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:48.106326 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:48.107690 (+ 1364us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:48.109542 (+ 1852us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:48.109545 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:48.109547 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:48.109815 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:48.110161 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:48.110164 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:48.110166 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:48.110273 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:48.110781 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:48.110784 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:48.110894 (+ 110us) client_negotiation.cc:769] Sending connection context
0808 04:44:48.110999 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 04:44:48.111138 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":87}
I20260808 04:44:48.111275 15599 log.cc:824] T 00000000000000000000000000000000 P 2629ca17b79348b9ad3f20ebeb90d1bf: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:48.111850 15835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:48.102928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53780 (local address 127.12.148.124:43469)
0808 04:44:48.103030 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:48.103033 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:48.103045 (+ 12us) server_negotiation.cc:407] Connection header received
0808 04:44:48.103077 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:48.103080 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:48.103118 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:48.103182 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:48.103639 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:48.104279 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:48.105274 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:48.105573 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:48.105692 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:48.107832 (+ 2140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:48.107835 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:48.107838 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:48.107860 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:48.109407 (+ 1547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:48.109947 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:48.109964 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:48.109966 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:48.110049 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:48.110391 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:48.110395 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:48.110397 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:48.110626 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:48.110720 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:48.111588 (+ 868us) server_negotiation.cc:299] Negotiation successful
0808 04:44:48.111706 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 04:44:48.114163 15599 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2629ca17b79348b9ad3f20ebeb90d1bf: No bootstrap required, opened a new log
I20260808 04:44:48.114843 15716 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7dc5a7c32f85427593fc2392ba83b04e: Bootstrap starting.
W20260808 04:44:48.115813 15861 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0c573857e3a444bf9b4b156337159c9b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 04:44:48.116611 15861 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 04:44:48.117214 15599 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2629ca17b79348b9ad3f20ebeb90d1bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2629ca17b79348b9ad3f20ebeb90d1bf" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 35507 } } peers { permanent_uuid: "7dc5a7c32f85427593fc2392ba83b04e" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 39777 } } peers { permanent_uuid: "0c573857e3a444bf9b4b156337159c9b" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 43469 } }
I20260808 04:44:48.117478 15599 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2629ca17b79348b9ad3f20ebeb90d1bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2629ca17b79348b9ad3f20ebeb90d1bf, State: Initialized, Role: FOLLOWER
I20260808 04:44:48.117832 15599 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2629ca17b79348b9ad3f20ebeb90d1bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2629ca17b79348b9ad3f20ebeb90d1bf" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 35507 } } peers { permanent_uuid: "7dc5a7c32f85427593fc2392ba83b04e" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 39777 } } peers { permanent_uuid: "0c573857e3a444bf9b4b156337159c9b" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 43469 } }
I20260808 04:44:48.118875 15716 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7dc5a7c32f85427593fc2392ba83b04e: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:48.119225 15599 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2629ca17b79348b9ad3f20ebeb90d1bf [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:48.119791 15716 log.cc:824] T 00000000000000000000000000000000 P 7dc5a7c32f85427593fc2392ba83b04e: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:48.117596 15737 master_runner.cc:186] Error getting master registration for 127.12.148.126:35507: OK, instance_id { permanent_uuid: "2629ca17b79348b9ad3f20ebeb90d1bf" instance_seqno: 1786164287629347 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 04:44:48.120846 15737 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 04:44:48.121093 15563 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2629ca17b79348b9ad3f20ebeb90d1bf [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 04:44:48.121209 15563 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2629ca17b79348b9ad3f20ebeb90d1bf [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:48.122777 15563 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2629ca17b79348b9ad3f20ebeb90d1bf [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2629ca17b79348b9ad3f20ebeb90d1bf" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 35507 } } peers { permanent_uuid: "7dc5a7c32f85427593fc2392ba83b04e" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 39777 } } peers { permanent_uuid: "0c573857e3a444bf9b4b156337159c9b" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 43469 } }
I20260808 04:44:48.123198 15716 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7dc5a7c32f85427593fc2392ba83b04e: No bootstrap required, opened a new log
I20260808 04:44:48.123741 15563 leader_election.cc:288] T 00000000000000000000000000000000 P 2629ca17b79348b9ad3f20ebeb90d1bf [CANDIDATE]: Term 1 election: Requested vote from peers 7dc5a7c32f85427593fc2392ba83b04e (127.12.148.125:39777), 0c573857e3a444bf9b4b156337159c9b (127.12.148.124:43469)
I20260808 04:44:48.124776 15795 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2629ca17b79348b9ad3f20ebeb90d1bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "0c573857e3a444bf9b4b156337159c9b"
I20260808 04:44:48.124993 15795 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0c573857e3a444bf9b4b156337159c9b [term 0 FOLLOWER]: Advancing to term 1
W20260808 04:44:48.125952 15535 tablet.cc:2369] T 00000000000000000000000000000000 P 2629ca17b79348b9ad3f20ebeb90d1bf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 04:44:48.126282 15795 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0c573857e3a444bf9b4b156337159c9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2629ca17b79348b9ad3f20ebeb90d1bf in term 1.
I20260808 04:44:48.127710 15530 leader_election.cc:302] T 00000000000000000000000000000000 P 2629ca17b79348b9ad3f20ebeb90d1bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c573857e3a444bf9b4b156337159c9b, 2629ca17b79348b9ad3f20ebeb90d1bf; no voters:
I20260808 04:44:48.128319 15892 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2629ca17b79348b9ad3f20ebeb90d1bf [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:48.128710 15892 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2629ca17b79348b9ad3f20ebeb90d1bf [term 1 LEADER]: Becoming Leader. State: Replica: 2629ca17b79348b9ad3f20ebeb90d1bf, State: Running, Role: LEADER
I20260808 04:44:48.128919 15716 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7dc5a7c32f85427593fc2392ba83b04e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2629ca17b79348b9ad3f20ebeb90d1bf" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 35507 } } peers { permanent_uuid: "7dc5a7c32f85427593fc2392ba83b04e" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 39777 } } peers { permanent_uuid: "0c573857e3a444bf9b4b156337159c9b" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 43469 } }
I20260808 04:44:48.129143 15716 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7dc5a7c32f85427593fc2392ba83b04e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dc5a7c32f85427593fc2392ba83b04e, State: Initialized, Role: FOLLOWER
I20260808 04:44:48.129479 15716 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7dc5a7c32f85427593fc2392ba83b04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2629ca17b79348b9ad3f20ebeb90d1bf" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 35507 } } peers { permanent_uuid: "7dc5a7c32f85427593fc2392ba83b04e" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 39777 } } peers { permanent_uuid: "0c573857e3a444bf9b4b156337159c9b" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 43469 } }
I20260808 04:44:48.129462 15892 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2629ca17b79348b9ad3f20ebeb90d1bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2629ca17b79348b9ad3f20ebeb90d1bf" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 35507 } } peers { permanent_uuid: "7dc5a7c32f85427593fc2392ba83b04e" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 39777 } } peers { permanent_uuid: "0c573857e3a444bf9b4b156337159c9b" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 43469 } }
I20260808 04:44:48.130831 15716 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7dc5a7c32f85427593fc2392ba83b04e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:48.130909 15672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2629ca17b79348b9ad3f20ebeb90d1bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "7dc5a7c32f85427593fc2392ba83b04e"
I20260808 04:44:48.131124 15672 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7dc5a7c32f85427593fc2392ba83b04e [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:48.128371 15502 master_runner.cc:186] Error getting master registration for 127.12.148.125:39777: OK, instance_id { permanent_uuid: "7dc5a7c32f85427593fc2392ba83b04e" instance_seqno: 1786164287844957 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 04:44:48.131544 15502 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 04:44:48.132337 15672 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7dc5a7c32f85427593fc2392ba83b04e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2629ca17b79348b9ad3f20ebeb90d1bf in term 1.
I20260808 04:44:48.134116 15864 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2629ca17b79348b9ad3f20ebeb90d1bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2629ca17b79348b9ad3f20ebeb90d1bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2629ca17b79348b9ad3f20ebeb90d1bf" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 35507 } } peers { permanent_uuid: "7dc5a7c32f85427593fc2392ba83b04e" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 39777 } } peers { permanent_uuid: "0c573857e3a444bf9b4b156337159c9b" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 43469 } } }
I20260808 04:44:48.134187 15895 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7dc5a7c32f85427593fc2392ba83b04e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2629ca17b79348b9ad3f20ebeb90d1bf" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 35507 } } peers { permanent_uuid: "7dc5a7c32f85427593fc2392ba83b04e" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 39777 } } peers { permanent_uuid: "0c573857e3a444bf9b4b156337159c9b" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 43469 } } }
I20260808 04:44:48.134258 15864 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2629ca17b79348b9ad3f20ebeb90d1bf [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:48.134282 15895 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7dc5a7c32f85427593fc2392ba83b04e [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:44:48.134459 15864 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2629ca17b79348b9ad3f20ebeb90d1bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2629ca17b79348b9ad3f20ebeb90d1bf. Latest consensus state: current_term: 1 leader_uuid: "2629ca17b79348b9ad3f20ebeb90d1bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2629ca17b79348b9ad3f20ebeb90d1bf" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 35507 } } peers { permanent_uuid: "7dc5a7c32f85427593fc2392ba83b04e" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 39777 } } peers { permanent_uuid: "0c573857e3a444bf9b4b156337159c9b" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 43469 } } }
I20260808 04:44:48.134538 15864 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2629ca17b79348b9ad3f20ebeb90d1bf [sys.catalog]: This master's current role is: LEADER
W20260808 04:44:48.137502 15884 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2629ca17b79348b9ad3f20ebeb90d1bf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 04:44:48.137590 15910 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7dc5a7c32f85427593fc2392ba83b04e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 04:44:48.137684 15910 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260808 04:44:48.137624 15884 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 04:44:48.138024 15914 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:48.138859 15914 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:48.146833 15734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:48.132157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51086 (local address 127.12.148.125:39777)
0808 04:44:48.132266 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:48.132271 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:48.138042 (+ 5771us) server_negotiation.cc:407] Connection header received
0808 04:44:48.138416 (+ 374us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:48.138419 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:48.138467 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:48.138519 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:48.139550 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:48.140138 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:48.141020 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:48.141328 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:48.141427 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:48.143242 (+ 1815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:48.143247 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:48.143249 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:48.143275 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:48.144923 (+ 1648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:48.145391 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:48.145395 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:48.145397 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:48.145486 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:48.145834 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:48.145837 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:48.145839 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:48.146062 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:48.146176 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:48.146537 (+ 361us) server_negotiation.cc:299] Negotiation successful
0808 04:44:48.146657 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 04:44:48.156364 15835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:48.133005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53786 (local address 127.12.148.124:43469)
0808 04:44:48.133124 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:48.133128 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:48.141431 (+ 8303us) server_negotiation.cc:407] Connection header received
0808 04:44:48.141598 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:48.141601 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:48.141646 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:48.141723 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:48.144005 (+ 2282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:48.144767 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:48.149870 (+ 5103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:48.150211 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:48.150304 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:48.152191 (+ 1887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:48.152195 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:48.152198 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:48.152227 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:48.153932 (+ 1705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:48.154853 (+ 921us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:48.154857 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:48.154859 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:48.154962 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:48.155304 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:48.155308 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:48.155310 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:48.155557 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:48.155676 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:48.156056 (+ 380us) server_negotiation.cc:299] Negotiation successful
0808 04:44:48.156183 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 04:44:48.157347 15601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:48.133930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34992 (local address 127.12.148.126:35507)
0808 04:44:48.134048 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:48.134052 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:48.142909 (+ 8857us) server_negotiation.cc:407] Connection header received
0808 04:44:48.143075 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:48.143078 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:48.143126 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:48.143176 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:48.149834 (+ 6658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:48.150530 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:48.151654 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:48.151991 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:48.152063 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:48.153886 (+ 1823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:48.153890 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:48.153893 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:48.153919 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:48.155535 (+ 1616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:48.156014 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:48.156017 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:48.156019 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:48.156105 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:48.156402 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:48.156406 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:48.156407 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:48.156621 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:48.156743 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:48.157084 (+ 341us) server_negotiation.cc:299] Negotiation successful
0808 04:44:48.157208 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 04:44:48.158180 15795 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0c573857e3a444bf9b4b156337159c9b [term 1 FOLLOWER]: Refusing update from remote peer 2629ca17b79348b9ad3f20ebeb90d1bf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:44:48.158954 15672 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7dc5a7c32f85427593fc2392ba83b04e [term 1 FOLLOWER]: Refusing update from remote peer 2629ca17b79348b9ad3f20ebeb90d1bf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:44:48.159628 15892 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2629ca17b79348b9ad3f20ebeb90d1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dc5a7c32f85427593fc2392ba83b04e" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 39777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:44:48.165246 15895 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7dc5a7c32f85427593fc2392ba83b04e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2629ca17b79348b9ad3f20ebeb90d1bf. Latest consensus state: current_term: 1 leader_uuid: "2629ca17b79348b9ad3f20ebeb90d1bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2629ca17b79348b9ad3f20ebeb90d1bf" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 35507 } } peers { permanent_uuid: "7dc5a7c32f85427593fc2392ba83b04e" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 39777 } } peers { permanent_uuid: "0c573857e3a444bf9b4b156337159c9b" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 43469 } } }
I20260808 04:44:48.165373 15895 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7dc5a7c32f85427593fc2392ba83b04e [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:44:48.165956 15864 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2629ca17b79348b9ad3f20ebeb90d1bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c573857e3a444bf9b4b156337159c9b" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 43469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:44:48.169745 15839 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c573857e3a444bf9b4b156337159c9b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2629ca17b79348b9ad3f20ebeb90d1bf. Latest consensus state: current_term: 1 leader_uuid: "2629ca17b79348b9ad3f20ebeb90d1bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2629ca17b79348b9ad3f20ebeb90d1bf" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 35507 } } peers { permanent_uuid: "7dc5a7c32f85427593fc2392ba83b04e" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 39777 } } peers { permanent_uuid: "0c573857e3a444bf9b4b156337159c9b" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 43469 } } }
I20260808 04:44:48.169875 15839 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c573857e3a444bf9b4b156337159c9b [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:44:48.176574 15864 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2629ca17b79348b9ad3f20ebeb90d1bf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2629ca17b79348b9ad3f20ebeb90d1bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2629ca17b79348b9ad3f20ebeb90d1bf" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 35507 } } peers { permanent_uuid: "7dc5a7c32f85427593fc2392ba83b04e" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 39777 } } peers { permanent_uuid: "0c573857e3a444bf9b4b156337159c9b" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 43469 } } }
I20260808 04:44:48.176708 15864 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2629ca17b79348b9ad3f20ebeb90d1bf [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:48.176815 15920 mvcc.cc:205] Tried to move back new op lower bound from 7316128924257812480 to 7316128924192677888. Current Snapshot: MvccSnapshot[applied={T|T < 7316128924257812480}]
I20260808 04:44:48.177986 15895 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7dc5a7c32f85427593fc2392ba83b04e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2629ca17b79348b9ad3f20ebeb90d1bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2629ca17b79348b9ad3f20ebeb90d1bf" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 35507 } } peers { permanent_uuid: "7dc5a7c32f85427593fc2392ba83b04e" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 39777 } } peers { permanent_uuid: "0c573857e3a444bf9b4b156337159c9b" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 43469 } } }
I20260808 04:44:48.178102 15895 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7dc5a7c32f85427593fc2392ba83b04e [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:44:48.178521 15922 mvcc.cc:205] Tried to move back new op lower bound from 7316128924257812480 to 7316128924192677888. Current Snapshot: MvccSnapshot[applied={T|T < 7316128924257812480}]
I20260808 04:44:48.183385 15914 catalog_manager.cc:1347] Generated new cluster ID: a9577d7682eb41a5a2bfd37c3a305b08
I20260808 04:44:48.183466 15914 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:48.184342 15894 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2629ca17b79348b9ad3f20ebeb90d1bf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2629ca17b79348b9ad3f20ebeb90d1bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2629ca17b79348b9ad3f20ebeb90d1bf" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 35507 } } peers { permanent_uuid: "7dc5a7c32f85427593fc2392ba83b04e" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 39777 } } peers { permanent_uuid: "0c573857e3a444bf9b4b156337159c9b" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 43469 } } }
I20260808 04:44:48.184460 15894 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2629ca17b79348b9ad3f20ebeb90d1bf [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:48.185578 15839 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c573857e3a444bf9b4b156337159c9b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2629ca17b79348b9ad3f20ebeb90d1bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2629ca17b79348b9ad3f20ebeb90d1bf" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 35507 } } peers { permanent_uuid: "7dc5a7c32f85427593fc2392ba83b04e" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 39777 } } peers { permanent_uuid: "0c573857e3a444bf9b4b156337159c9b" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 43469 } } }
I20260808 04:44:48.185719 15839 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c573857e3a444bf9b4b156337159c9b [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:44:48.186913 15927 mvcc.cc:205] Tried to move back new op lower bound from 7316128924257812480 to 7316128924192677888. Current Snapshot: MvccSnapshot[applied={T|T < 7316128924257812480}]
I20260808 04:44:48.212468 15914 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:48.213971 15914 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:48.232007 15914 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2629ca17b79348b9ad3f20ebeb90d1bf: Generated new TSK 0
I20260808 04:44:48.232995 15914 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 04:44:48.274788 15734 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:44:48.271920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51096 (local address 127.12.148.125:39777)
0808 04:44:48.272072 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:48.272077 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:48.273515 (+ 1438us) server_negotiation.cc:407] Connection header received
0808 04:44:48.273801 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:48.273806 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:48.273865 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:48.273925 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:48.274637 (+ 712us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51096: BlockingRecv error: recv got EOF from 127.0.0.1:51096 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
W20260808 04:44:48.276496 15835 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:44:48.272890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53796 (local address 127.12.148.124:43469)
0808 04:44:48.273045 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:48.273050 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:48.275531 (+ 2481us) server_negotiation.cc:407] Connection header received
0808 04:44:48.275720 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:48.275723 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:48.275777 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:48.275832 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:48.276360 (+ 528us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53796: BlockingRecv error: recv got EOF from 127.0.0.1:53796 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260808 04:44:48.278779 15601 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:44:48.277136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35002 (local address 127.12.148.126:35507)
0808 04:44:48.277253 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:48.277257 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:48.277670 (+ 413us) server_negotiation.cc:407] Connection header received
0808 04:44:48.277979 (+ 309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:48.277983 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:48.278040 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:48.278093 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:48.278653 (+ 560us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35002: BlockingRecv error: recv got EOF from 127.0.0.1:35002 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260808 04:44:48.283429 15734 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:44:48.281853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51098 (local address 127.12.148.125:39777)
0808 04:44:48.281962 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:48.281966 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:48.282459 (+ 493us) server_negotiation.cc:407] Connection header received
0808 04:44:48.282675 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:48.282678 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:48.282754 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:48.282802 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:48.283309 (+ 507us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51098: BlockingRecv error: recv got EOF from 127.0.0.1:51098 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260808 04:44:48.288455 15734 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:44:48.286943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51112 (local address 127.12.148.125:39777)
0808 04:44:48.287050 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:48.287054 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:48.287571 (+ 517us) server_negotiation.cc:407] Connection header received
0808 04:44:48.287737 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:48.287740 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:48.287788 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:48.287835 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:48.288337 (+ 502us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51112: BlockingRecv error: recv got EOF from 127.0.0.1:51112 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260808 04:44:48.294135 15734 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:44:48.292517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51120 (local address 127.12.148.125:39777)
0808 04:44:48.292616 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:48.292620 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:48.293125 (+ 505us) server_negotiation.cc:407] Connection header received
0808 04:44:48.293307 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:48.293311 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:48.293360 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:48.293408 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:48.294011 (+ 603us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51120: BlockingRecv error: recv got EOF from 127.0.0.1:51120 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260808 04:44:48.302814 15734 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:44:48.300407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51134 (local address 127.12.148.125:39777)
0808 04:44:48.300562 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:48.300566 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:48.301089 (+ 523us) server_negotiation.cc:407] Connection header received
0808 04:44:48.301269 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:48.301272 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:48.301320 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:48.301368 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:48.302704 (+ 1336us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51134: BlockingRecv error: recv got EOF from 127.0.0.1:51134 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
W20260808 04:44:48.314296 15734 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:44:48.313129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51150 (local address 127.12.148.125:39777)
0808 04:44:48.313246 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:48.313250 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:48.313463 (+ 213us) server_negotiation.cc:407] Connection header received
0808 04:44:48.313586 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:48.313589 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:48.313638 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:48.313735 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:48.314179 (+ 444us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51150: BlockingRecv error: recv got EOF from 127.0.0.1:51150 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260808 04:44:48.333426 15734 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:44:48.332175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51160 (local address 127.12.148.125:39777)
0808 04:44:48.332296 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:48.332301 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:48.332532 (+ 231us) server_negotiation.cc:407] Connection header received
0808 04:44:48.332725 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:48.332728 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:48.332775 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:48.332841 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:48.333297 (+ 456us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51160: BlockingRecv error: recv got EOF from 127.0.0.1:51160 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260808 04:44:48.368454 15734 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:44:48.367241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51166 (local address 127.12.148.125:39777)
0808 04:44:48.367365 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:48.367370 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:48.367608 (+ 238us) server_negotiation.cc:407] Connection header received
0808 04:44:48.367745 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:48.367747 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:48.367796 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:48.367862 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:48.368320 (+ 458us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51166: BlockingRecv error: recv got EOF from 127.0.0.1:51166 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260808 04:44:48.435395 15734 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:44:48.434353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51182 (local address 127.12.148.125:39777)
0808 04:44:48.434525 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:48.434530 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:48.434636 (+ 106us) server_negotiation.cc:407] Connection header received
0808 04:44:48.434757 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:48.434759 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:48.434814 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:48.434892 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:48.435294 (+ 402us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51182: BlockingRecv error: recv got EOF from 127.0.0.1:51182 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
W20260808 04:44:48.566812 15734 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:44:48.565694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51192 (local address 127.12.148.125:39777)
0808 04:44:48.565834 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:48.565839 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:48.565950 (+ 111us) server_negotiation.cc:407] Connection header received
0808 04:44:48.566109 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:48.566112 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:48.566159 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:48.566227 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:48.566699 (+ 472us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51192: BlockingRecv error: recv got EOF from 127.0.0.1:51192 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260808 04:44:48.825917 15734 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:44:48.824814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51202 (local address 127.12.148.125:39777)
0808 04:44:48.824969 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:48.824973 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:48.825088 (+ 115us) server_negotiation.cc:407] Connection header received
0808 04:44:48.825202 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:48.825204 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:48.825258 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:48.825338 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:48.825778 (+ 440us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51202: BlockingRecv error: recv got EOF from 127.0.0.1:51202 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 04:44:49.118098 15861 catalog_manager.cc:1259] Loaded cluster ID: a9577d7682eb41a5a2bfd37c3a305b08
I20260808 04:44:49.118184 15861 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 0c573857e3a444bf9b4b156337159c9b: loading cluster ID for follower catalog manager: success
I20260808 04:44:49.120023 15861 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 0c573857e3a444bf9b4b156337159c9b: acquiring CA information for follower catalog manager: success
I20260808 04:44:49.121280 15861 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 0c573857e3a444bf9b4b156337159c9b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 04:44:49.138984 15910 catalog_manager.cc:1259] Loaded cluster ID: a9577d7682eb41a5a2bfd37c3a305b08
I20260808 04:44:49.139083 15910 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7dc5a7c32f85427593fc2392ba83b04e: loading cluster ID for follower catalog manager: success
I20260808 04:44:49.140861 15910 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7dc5a7c32f85427593fc2392ba83b04e: acquiring CA information for follower catalog manager: success
I20260808 04:44:49.142043 15910 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7dc5a7c32f85427593fc2392ba83b04e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 04:44:49.343740 16028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:49.340053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51206 (local address 127.12.148.125:39777)
0808 04:44:49.340327 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:49.340331 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:49.340347 (+ 16us) server_negotiation.cc:407] Connection header received
0808 04:44:49.340452 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:49.340455 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:49.340582 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:49.340677 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:44:49.340945 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:49.341491 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:49.342312 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:49.342555 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:49.342633 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:49.342886 (+ 253us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:44:49.343333 (+ 447us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:44:49.343423 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:49.343525 (+ 102us) server_negotiation.cc:299] Negotiation successful
0808 04:44:49.343577 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":94,"threads_started":1}
I20260808 04:44:49.350449 16036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:49.346840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53802 (local address 127.12.148.124:43469)
0808 04:44:49.347065 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:49.347070 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:49.347083 (+ 13us) server_negotiation.cc:407] Connection header received
0808 04:44:49.347257 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:49.347260 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:49.347376 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:49.347486 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:44:49.347699 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:49.348208 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:49.349015 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:49.349243 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:49.349329 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:49.349614 (+ 285us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:44:49.350060 (+ 446us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:44:49.350168 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:49.350237 (+ 69us) server_negotiation.cc:299] Negotiation successful
0808 04:44:49.350292 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":65,"threads_started":1}
I20260808 04:44:49.357067 16028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:49.353163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51208 (local address 127.12.148.125:39777)
0808 04:44:49.353278 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:49.353282 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:49.353738 (+ 456us) server_negotiation.cc:407] Connection header received
0808 04:44:49.353911 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:49.353915 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:49.353970 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:49.354017 (+ 47us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:44:49.354398 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:49.354948 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:49.355822 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:49.356152 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:49.356245 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:49.356640 (+ 395us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:44:49.356726 (+ 86us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:44:49.356788 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:49.356880 (+ 92us) server_negotiation.cc:299] Negotiation successful
0808 04:44:49.356932 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 04:44:49.357067 16036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:49.353518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53816 (local address 127.12.148.124:43469)
0808 04:44:49.353627 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:49.353631 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:49.353643 (+ 12us) server_negotiation.cc:407] Connection header received
0808 04:44:49.353704 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:49.353707 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:49.353752 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:49.353821 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:44:49.354044 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:49.354703 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:49.355868 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:49.356208 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:49.356289 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:49.356614 (+ 325us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:44:49.356680 (+ 66us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:44:49.356726 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:49.356886 (+ 160us) server_negotiation.cc:299] Negotiation successful
0808 04:44:49.356950 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 04:44:49.357821 16045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:49.353140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35016 (local address 127.12.148.126:35507)
0808 04:44:49.353733 (+ 593us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:49.353738 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:49.353751 (+ 13us) server_negotiation.cc:407] Connection header received
0808 04:44:49.353839 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:49.353842 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:49.353991 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:49.354109 (+ 118us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:44:49.354363 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:49.355054 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:49.356076 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:49.356398 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:49.356497 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:49.356818 (+ 321us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:44:49.357144 (+ 326us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:44:49.357565 (+ 421us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:49.357601 (+ 36us) server_negotiation.cc:299] Negotiation successful
0808 04:44:49.357684 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":488,"thread_start_us":86,"threads_started":1}
I20260808 04:44:49.360571 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 15502
I20260808 04:44:49.372805 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 15608
I20260808 04:44:49.385723 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 15737
2026-08-08T04:44:49Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3203 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 04:44:49 dist-test-slave-t7g5 krb5kdc[16051](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 04:44:49 dist-test-slave-t7g5 krb5kdc[16051](info): set up 2 sockets
Aug 08 04:44:49 dist-test-slave-t7g5 krb5kdc[16051](info): commencing operation
krb5kdc: starting...
W20260808 04:44:50.530973 12881 mini_kdc.cc:121] Time spent starting KDC: real 1.121s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/krb5kdc/test-user.keytab.
Aug 08 04:44:50 dist-test-slave-t7g5 krb5kdc[16051](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164290, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T04:44:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T04:44:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.148.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
Entry for principal kudu/127.12.148.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab.
I20260808 04:44:50.652628 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:41597
--webserver_interface=127.12.148.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:43045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:41597,127.12.148.125:42007,127.12.148.124:33615
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 04:44:50.763615 16069 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 04:44:50.763926 16069 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:50.763978 16069 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:50.764042 16069 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:50.768046 16069 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:50.768107 16069 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:50.768132 16069 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:50.768154 16069 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:50.768188 16069 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:50.773422 16069 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:43045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:41597,127.12.148.125:42007,127.12.148.124:33615
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.126.keytab
--principal=kudu/127.12.148.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.126:41597
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.148.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16069
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:50.774477 16069 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:50.775484 16069 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:50.783876 16079 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:50.783869 16081 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:50.784076 16069 server_base.cc:1034] running on GCE node
W20260808 04:44:50.783869 16083 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:50.784719 16069 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:50.785815 16069 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:50.786971 16069 hybrid_clock.cc:648] HybridClock initialized: now 1786164290786955 us; error 29 us; skew 500 ppm
Aug 08 04:44:50 dist-test-slave-t7g5 krb5kdc[16051](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164290, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:50.789707 16069 init.cc:377] Logged in from keytab as kudu/127.12.148.126@KRBTEST.COM (short username kudu)
I20260808 04:44:50.790545 16069 webserver.cc:460] Webserver started at http://127.12.148.126:45021/ using document root <none> and password file <none>
I20260808 04:44:50.791066 16069 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:50.791131 16069 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:50.791329 16069 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:50.793293 16069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-0/data/instance:
uuid: "eb5bffbd052b428fba667e27f1d12a32"
format_stamp: "Formatted at 2026-08-08 04:44:50 on dist-test-slave-t7g5"
server_key: "481fe5d299d530c3f079649c5f870640"
server_key_iv: "e709f49988c2ded6ace8eda3f6247425"
server_key_version: "encryptionkey@0"
I20260808 04:44:50.793865 16069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-0/wal/instance:
uuid: "eb5bffbd052b428fba667e27f1d12a32"
format_stamp: "Formatted at 2026-08-08 04:44:50 on dist-test-slave-t7g5"
server_key: "481fe5d299d530c3f079649c5f870640"
server_key_iv: "e709f49988c2ded6ace8eda3f6247425"
server_key_version: "encryptionkey@0"
I20260808 04:44:50.797366 16069 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 04:44:50.799817 16092 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:50.800999 16069 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 04:44:50.801110 16069 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-0/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-0/wal
uuid: "eb5bffbd052b428fba667e27f1d12a32"
format_stamp: "Formatted at 2026-08-08 04:44:50 on dist-test-slave-t7g5"
server_key: "481fe5d299d530c3f079649c5f870640"
server_key_iv: "e709f49988c2ded6ace8eda3f6247425"
server_key_version: "encryptionkey@0"
I20260808 04:44:50.801201 16069 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:50.816190 16069 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:50.819199 16069 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:50.819377 16069 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:50.826133 16069 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.126:41597
I20260808 04:44:50.826395 16170 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.126:41597 every 8 connection(s)
I20260808 04:44:50.827064 16069 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-0/data/info.pb
I20260808 04:44:50.828217 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 16069
I20260808 04:44:50.828331 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-0/wal/instance
I20260808 04:44:50.828604 12881 external_mini_cluster.cc:1428] Setting key 6235cff8b3ff1ae9da534eb675ad2c6a
I20260808 04:44:50.829903 16172 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:50.834753 16172 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41597 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.12.148.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.125@KRBTEST.COM" created.
Aug 08 04:44:50 dist-test-slave-t7g5 krb5kdc[16051](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164290, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:44:50.850440 16176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:50.837516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39280 (local address 127.12.148.126:41597)
0808 04:44:50.838084 (+ 568us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:50.838101 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:50.838153 (+ 52us) server_negotiation.cc:407] Connection header received
0808 04:44:50.839200 (+ 1047us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:50.839204 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:50.839432 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:50.839589 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:50.840334 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:50.841430 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:50.842754 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:50.843169 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:50.843323 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:50.845731 (+ 2408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:50.845737 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:50.845748 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:50.845771 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:50.847309 (+ 1538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:50.847870 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:50.847873 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:50.847874 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:50.847975 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:50.848295 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:50.848297 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:50.848298 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:50.848679 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:50.848780 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:50.849233 (+ 453us) server_negotiation.cc:299] Negotiation successful
0808 04:44:50.849501 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":22,"server-negotiator.queue_time_us":453,"spinlock_wait_cycles":29568,"thread_start_us":191,"threads_started":1}
I20260808 04:44:50.850447 16175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:50.837516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41597 (local address 127.0.0.1:39280)
0808 04:44:50.838020 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:50.838071 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:50.838907 (+ 836us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:50.839601 (+ 694us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:50.839605 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:50.839934 (+ 329us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:50.840179 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:50.840191 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:50.841556 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:50.841560 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:50.842627 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:50.842639 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:50.843340 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:50.843345 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:50.843440 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:50.843970 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:50.843987 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:50.845554 (+ 1567us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:50.847422 (+ 1868us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:50.847432 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:50.847444 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:50.847763 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:50.848055 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:50.848058 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:50.848060 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:50.848208 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:50.848801 (+ 593us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:50.848808 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:50.848989 (+ 181us) client_negotiation.cc:769] Sending connection context
0808 04:44:50.849190 (+ 201us) client_negotiation.cc:240] Negotiation successful
0808 04:44:50.849597 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"mutex_wait_us":97,"thread_start_us":150,"threads_started":1}
I20260808 04:44:50.852900 16172 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.148.125" port: 42007 } has no permanent_uuid. Determining permanent_uuid...
I20260808 04:44:50.853735 16175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:50.853369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.125:42007 (local address 127.0.0.1:44144)
0808 04:44:50.853558 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:50.853631 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.125:42007: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111}
W20260808 04:44:50.853997 16098 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.148.125:42007: connect: Connection refused (error 111)
I20260808 04:44:50.854893 16175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:50.854648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.125:42007 (local address 127.0.0.1:44150)
0808 04:44:50.854762 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:50.854841 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.125:42007: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260808 04:44:50.855037 16172 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.148.125:42007: Network error: Client connection negotiation failed: client connection to 127.12.148.125:42007: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.125.keytab.
Entry for principal kudu/127.12.148.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.125.keytab.
I20260808 04:44:50.858783 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.125:42007
--webserver_interface=127.12.148.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.125.keytab
--principal=kudu/127.12.148.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:43045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:41597,127.12.148.125:42007,127.12.148.124:33615
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 04:44:50.904275 16172 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.148.125" port: 42007 } attempt: 1
I20260808 04:44:50.905210 16175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:50.904854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.125:42007 (local address 127.0.0.1:44158)
0808 04:44:50.905034 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:50.905112 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.125:42007: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260808 04:44:50.906016 16175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:50.905775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.125:42007 (local address 127.0.0.1:44162)
0808 04:44:50.905890 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:50.905948 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.125:42007: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260808 04:44:50.906212 16172 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.148.125:42007: Network error: Client connection negotiation failed: client connection to 127.12.148.125:42007: connect: Connection refused (error 111)
W20260808 04:44:50.972045 16182 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 04:44:50.972334 16182 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:50.972359 16182 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:50.972416 16182 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260808 04:44:50.974383 16172 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.148.125" port: 42007 } attempt: 2
I20260808 04:44:50.975281 16175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:50.974952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.125:42007 (local address 127.0.0.1:44174)
0808 04:44:50.975108 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:50.975180 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.125:42007: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260808 04:44:50.976011 16175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:50.975798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.125:42007 (local address 127.0.0.1:44184)
0808 04:44:50.975894 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:50.975944 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.125:42007: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260808 04:44:50.976132 16172 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.148.125:42007: Network error: Client connection negotiation failed: client connection to 127.12.148.125:42007: connect: Connection refused (error 111)
W20260808 04:44:50.976894 16182 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:50.976935 16182 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:50.976953 16182 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:50.976969 16182 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:50.976982 16182 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:50.982581 16182 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:43045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:41597,127.12.148.125:42007,127.12.148.124:33615
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.125.keytab
--principal=kudu/127.12.148.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.125:42007
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.148.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16182
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:50.983624 16182 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 04:44:50.984596 16182 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:50.992805 16190 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:50.992815 16192 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:50.992982 16182 server_base.cc:1034] running on GCE node
W20260808 04:44:50.992888 16189 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:50.993564 16182 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:50.994632 16182 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:50.995796 16182 hybrid_clock.cc:648] HybridClock initialized: now 1786164290995771 us; error 35 us; skew 500 ppm
Aug 08 04:44:50 dist-test-slave-t7g5 krb5kdc[16051](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164290, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:50.998474 16182 init.cc:377] Logged in from keytab as kudu/127.12.148.125@KRBTEST.COM (short username kudu)
I20260808 04:44:50.999317 16182 webserver.cc:460] Webserver started at http://127.12.148.125:42087/ using document root <none> and password file <none>
I20260808 04:44:50.999867 16182 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:50.999938 16182 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:51.000129 16182 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:51.002168 16182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-1/data/instance:
uuid: "cd8db1c08be24bbda7392e214a2d5c29"
format_stamp: "Formatted at 2026-08-08 04:44:50 on dist-test-slave-t7g5"
server_key: "aecc10a0ab949f2dc50d9719674052bf"
server_key_iv: "676009c4e33b18c744b3acdc24ded94d"
server_key_version: "encryptionkey@0"
I20260808 04:44:51.002712 16182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-1/wal/instance:
uuid: "cd8db1c08be24bbda7392e214a2d5c29"
format_stamp: "Formatted at 2026-08-08 04:44:50 on dist-test-slave-t7g5"
server_key: "aecc10a0ab949f2dc50d9719674052bf"
server_key_iv: "676009c4e33b18c744b3acdc24ded94d"
server_key_version: "encryptionkey@0"
I20260808 04:44:51.006556 16182 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 04:44:51.008904 16199 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:51.010190 16182 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 04:44:51.010316 16182 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-1/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-1/wal
uuid: "cd8db1c08be24bbda7392e214a2d5c29"
format_stamp: "Formatted at 2026-08-08 04:44:50 on dist-test-slave-t7g5"
server_key: "aecc10a0ab949f2dc50d9719674052bf"
server_key_iv: "676009c4e33b18c744b3acdc24ded94d"
server_key_version: "encryptionkey@0"
I20260808 04:44:51.010424 16182 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:51.023515 16182 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:51.026379 16182 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:51.026575 16182 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:51.033188 16182 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.125:42007
I20260808 04:44:51.033424 16279 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.125:42007 every 8 connection(s)
I20260808 04:44:51.034154 16182 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-1/data/info.pb
I20260808 04:44:51.035902 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 16182
I20260808 04:44:51.036023 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-1/wal/instance
I20260808 04:44:51.036310 12881 external_mini_cluster.cc:1428] Setting key 84e63a8a81beb507ef27bd334d6a7895
I20260808 04:44:51.036870 16280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:51.041011 16280 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41597 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.12.148.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.148.124@KRBTEST.COM" created.
Aug 08 04:44:51 dist-test-slave-t7g5 krb5kdc[16051](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164290, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.125@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:44:51.054912 16176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:51.042918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39290 (local address 127.12.148.126:41597)
0808 04:44:51.043041 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:51.043044 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:51.044080 (+ 1036us) server_negotiation.cc:407] Connection header received
0808 04:44:51.044990 (+ 910us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:51.044994 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:51.045056 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:51.045126 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:51.046319 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:51.046839 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:51.048070 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:51.048299 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:51.048390 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:51.050797 (+ 2407us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:51.050802 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:51.050804 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:51.050836 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:51.052753 (+ 1917us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:51.053350 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:51.053352 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:51.053353 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:51.053429 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:51.053817 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:51.053820 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:51.053821 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:51.053992 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:51.054065 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:51.054688 (+ 623us) server_negotiation.cc:299] Negotiation successful
0808 04:44:51.054789 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 04:44:51.056113 16284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:51.043448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41597 (local address 127.0.0.1:39290)
0808 04:44:51.043934 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:51.043976 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:51.044784 (+ 808us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:51.045295 (+ 511us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:51.045302 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:51.045685 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:51.046181 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:51.046196 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:51.046959 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:51.046963 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:51.047959 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:51.047970 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:51.048450 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:51.048454 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:51.048624 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:51.049191 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:51.049207 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:51.050628 (+ 1421us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:51.052869 (+ 2241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:51.052875 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:51.052890 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:51.053258 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:51.053508 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:51.053511 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:51.053513 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:51.053729 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:51.054089 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:51.054096 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:51.054436 (+ 340us) client_negotiation.cc:769] Sending connection context
0808 04:44:51.054648 (+ 212us) client_negotiation.cc:240] Negotiation successful
0808 04:44:51.054991 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":142,"threads_started":1}
I20260808 04:44:51.057495 16280 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.148.125" port: 42007 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 04:44:51 dist-test-slave-t7g5 krb5kdc[16051](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164290, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.125@KRBTEST.COM for kudu/127.12.148.125@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.148.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.124.keytab.
Entry for principal kudu/127.12.148.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.124.keytab.
I20260808 04:44:51.065055 12881 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
/tmp/dist-test-taskMuxZs2/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.124:33615
--webserver_interface=127.12.148.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.124.keytab
--principal=kudu/127.12.148.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.148.84:43045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.148.126:41597,127.12.148.125:42007,127.12.148.124:33615
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 04:44:51.066069 16284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:51.058027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.125:42007 (local address 127.0.0.1:44196)
0808 04:44:51.058157 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:51.058169 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:51.058227 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:51.058816 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:51.058820 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:51.058982 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:51.059082 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:51.059088 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:51.060050 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:51.060053 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:51.060572 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:51.060579 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:51.061148 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:51.061152 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:51.061254 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:51.061690 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:51.061704 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:51.062828 (+ 1124us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:51.064574 (+ 1746us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:51.064577 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:51.064579 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:51.064816 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:51.065073 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:51.065076 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:51.065078 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:51.065168 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:51.065643 (+ 475us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:51.065646 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:51.065766 (+ 120us) client_negotiation.cc:769] Sending connection context
0808 04:44:51.065856 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 04:44:51.065957 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260808 04:44:51.066265 16288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:51.058115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44196 (local address 127.12.148.125:42007)
0808 04:44:51.058430 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:51.058441 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:51.058459 (+ 18us) server_negotiation.cc:407] Connection header received
0808 04:44:51.058492 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:51.058496 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:51.058694 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:51.058800 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:51.059170 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:51.059954 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:51.060665 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:51.061030 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:51.061140 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:51.062963 (+ 1823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:51.062971 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:51.062982 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:51.063003 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:51.064473 (+ 1470us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:51.064910 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:51.064915 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:51.064916 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:51.064990 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:51.065268 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:51.065270 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:51.065271 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:51.065537 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:51.065691 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:51.065966 (+ 275us) server_negotiation.cc:299] Negotiation successful
0808 04:44:51.066109 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":223,"thread_start_us":135,"threads_started":1}
I20260808 04:44:51.067271 16172 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.148.125" port: 42007 } attempt: 3
I20260808 04:44:51.068351 16280 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.148.124" port: 33615 } has no permanent_uuid. Determining permanent_uuid...
I20260808 04:44:51.068981 16284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:51.068727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:33615 (local address 127.0.0.1:59038)
0808 04:44:51.068834 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:51.068913 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.124:33615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260808 04:44:51.069178 16200 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.148.124:33615: connect: Connection refused (error 111)
I20260808 04:44:51.069967 16284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:51.069779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:33615 (local address 127.0.0.1:59048)
0808 04:44:51.069874 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:51.069918 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.124:33615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260808 04:44:51.070154 16280 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.148.124:33615: Network error: Client connection negotiation failed: client connection to 127.12.148.124:33615: connect: Connection refused (error 111)
Aug 08 04:44:51 dist-test-slave-t7g5 krb5kdc[16051](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164290, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for kudu/127.12.148.125@KRBTEST.COM
I20260808 04:44:51.076166 16288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:51.067928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44200 (local address 127.12.148.125:42007)
0808 04:44:51.068030 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:51.068034 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:51.068045 (+ 11us) server_negotiation.cc:407] Connection header received
0808 04:44:51.068077 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:51.068080 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:51.068116 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:51.068227 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:51.068679 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:51.069348 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:51.070450 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:51.071299 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:51.071381 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:51.073406 (+ 2025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:51.073409 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:51.073411 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:51.073431 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:51.074706 (+ 1275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:51.075101 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:51.075104 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:51.075105 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:51.075173 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:51.075429 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:51.075432 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:51.075434 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:51.075603 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:51.075686 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:51.075937 (+ 251us) server_negotiation.cc:299] Negotiation successful
0808 04:44:51.076033 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 04:44:51.076169 16175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:51.067721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.125:42007 (local address 127.0.0.1:44200)
0808 04:44:51.067844 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:51.067860 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:51.067947 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:51.068282 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:51.068285 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:51.068455 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:51.068577 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:51.068583 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:51.069461 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:51.069464 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:51.070333 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:51.070347 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:51.071416 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:51.071420 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:51.071531 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:51.071971 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:51.071986 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:51.073270 (+ 1284us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:51.074805 (+ 1535us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:51.074808 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:51.074811 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:51.075010 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:51.075254 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:51.075257 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:51.075259 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:51.075351 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:51.075694 (+ 343us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:51.075697 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:51.075791 (+ 94us) client_negotiation.cc:769] Sending connection context
0808 04:44:51.075876 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 04:44:51.076014 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 04:44:51.076835 16172 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.148.124" port: 33615 } has no permanent_uuid. Determining permanent_uuid...
I20260808 04:44:51.077447 16175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:51.077230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:33615 (local address 127.0.0.1:59064)
0808 04:44:51.077343 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:51.077391 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.124:33615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260808 04:44:51.078122 16175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:51.077898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:33615 (local address 127.0.0.1:59072)
0808 04:44:51.078034 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:51.078075 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.124:33615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
W20260808 04:44:51.078253 16172 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.148.124:33615: Network error: Client connection negotiation failed: client connection to 127.12.148.124:33615: connect: Connection refused (error 111)
I20260808 04:44:51.109442 16172 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.148.124" port: 33615 } attempt: 1
I20260808 04:44:51.110304 16175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:51.110009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:33615 (local address 127.0.0.1:59080)
0808 04:44:51.110158 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:51.110217 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.124:33615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260808 04:44:51.111030 16175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:51.110837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:33615 (local address 127.0.0.1:59088)
0808 04:44:51.110928 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:51.110975 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.124:33615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260808 04:44:51.111150 16172 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.148.124:33615: Network error: Client connection negotiation failed: client connection to 127.12.148.124:33615: connect: Connection refused (error 111)
I20260808 04:44:51.119400 16280 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.148.124" port: 33615 } attempt: 1
I20260808 04:44:51.120190 16284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:51.119903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:33615 (local address 127.0.0.1:59092)
0808 04:44:51.120056 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:51.120117 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.124:33615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260808 04:44:51.120850 16284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:51.120645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:33615 (local address 127.0.0.1:59106)
0808 04:44:51.120744 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:51.120792 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.124:33615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260808 04:44:51.120965 16280 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.148.124:33615: Network error: Client connection negotiation failed: client connection to 127.12.148.124:33615: connect: Connection refused (error 111)
W20260808 04:44:51.178862 16292 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 04:44:51.179167 16292 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 04:44:51.179203 16292 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 04:44:51.179265 16292 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 04:44:51.183465 16292 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 04:44:51.183521 16292 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 04:44:51.183547 16292 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 04:44:51.183568 16292 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 04:44:51.183597 16292 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 04:44:51.186296 16172 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.148.124" port: 33615 } attempt: 2
I20260808 04:44:51.187121 16175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:51.186827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:33615 (local address 127.0.0.1:59112)
0808 04:44:51.186974 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:51.187042 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.124:33615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260808 04:44:51.187779 16175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:51.187574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:33615 (local address 127.0.0.1:59120)
0808 04:44:51.187675 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:51.187722 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.124:33615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260808 04:44:51.187902 16172 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.148.124:33615: Network error: Client connection negotiation failed: client connection to 127.12.148.124:33615: connect: Connection refused (error 111)
I20260808 04:44:51.189105 16280 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.148.124" port: 33615 } attempt: 2
I20260808 04:44:51.189159 16292 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.148.84:43045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.148.126:41597,127.12.148.125:42007,127.12.148.124:33615
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/krb5kdc/kudu_127.12.148.124.keytab
--principal=kudu/127.12.148.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.148.124:33615
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.148.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16292
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 03:51:01 UTC on ccycloud.quasar-lceqdi.root.comops.site
build id 4574013
I20260808 04:44:51.189775 16284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:51.189478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:33615 (local address 127.0.0.1:59124)
0808 04:44:51.189618 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:51.189702 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.124:33615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260808 04:44:51.190431 16284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:51.190220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:33615 (local address 127.0.0.1:59138)
0808 04:44:51.190318 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:51.190369 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.148.124:33615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 04:44:51.190433 16292 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
W20260808 04:44:51.190577 16280 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.148.124:33615: Network error: Client connection negotiation failed: client connection to 127.12.148.124:33615: connect: Connection refused (error 111)
I20260808 04:44:51.191416 16292 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 04:44:51.199426 16306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:51.199407 16309 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 04:44:51.199440 16304 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 04:44:51.199602 16292 server_base.cc:1034] running on GCE node
I20260808 04:44:51.200280 16292 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 04:44:51.201288 16292 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 04:44:51.202437 16292 hybrid_clock.cc:648] HybridClock initialized: now 1786164291202410 us; error 39 us; skew 500 ppm
Aug 08 04:44:51 dist-test-slave-t7g5 krb5kdc[16051](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164291, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 04:44:51.212592 16292 init.cc:377] Logged in from keytab as kudu/127.12.148.124@KRBTEST.COM (short username kudu)
I20260808 04:44:51.213490 16292 webserver.cc:460] Webserver started at http://127.12.148.124:34829/ using document root <none> and password file <none>
I20260808 04:44:51.214088 16292 fs_manager.cc:359] Metadata directory not provided
I20260808 04:44:51.214164 16292 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 04:44:51.214365 16292 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 04:44:51.216405 16292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-2/data/instance:
uuid: "c0c94bb459bb4f3d839526a46bdca8a2"
format_stamp: "Formatted at 2026-08-08 04:44:51 on dist-test-slave-t7g5"
server_key: "b24e610d1a7501e8d350a466ac28de64"
server_key_iv: "861bddc486b8d6eb7cae49358b614e0d"
server_key_version: "encryptionkey@0"
I20260808 04:44:51.216949 16292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-2/wal/instance:
uuid: "c0c94bb459bb4f3d839526a46bdca8a2"
format_stamp: "Formatted at 2026-08-08 04:44:51 on dist-test-slave-t7g5"
server_key: "b24e610d1a7501e8d350a466ac28de64"
server_key_iv: "861bddc486b8d6eb7cae49358b614e0d"
server_key_version: "encryptionkey@0"
I20260808 04:44:51.220469 16292 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 04:44:51.222843 16321 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 04:44:51.224030 16292 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 04:44:51.224143 16292 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-2/data,/tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-2/wal
uuid: "c0c94bb459bb4f3d839526a46bdca8a2"
format_stamp: "Formatted at 2026-08-08 04:44:51 on dist-test-slave-t7g5"
server_key: "b24e610d1a7501e8d350a466ac28de64"
server_key_iv: "861bddc486b8d6eb7cae49358b614e0d"
server_key_version: "encryptionkey@0"
I20260808 04:44:51.224231 16292 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 04:44:51.241852 16292 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 04:44:51.244726 16292 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 04:44:51.244910 16292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 04:44:51.251638 16292 rpc_server.cc:307] RPC server started. Bound to: 127.12.148.124:33615
I20260808 04:44:51.251925 16394 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.148.124:33615 every 8 connection(s)
I20260808 04:44:51.252566 16292 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-2/data/info.pb
I20260808 04:44:51.252878 12881 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu as pid 16292
I20260808 04:44:51.252996 12881 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMuxZs2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786164004017495-12881-0/minicluster-data/master-2/wal/instance
I20260808 04:44:51.253330 12881 external_mini_cluster.cc:1428] Setting key 98644b27305f2bc2f97a8e4c8602f44e
I20260808 04:44:51.255645 16395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 04:44:51.259876 16395 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41597 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 04:44:51 dist-test-slave-t7g5 krb5kdc[16051](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164290, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.148.124@KRBTEST.COM
Aug 08 04:44:51 dist-test-slave-t7g5 krb5kdc[16051](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164291, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.124@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
I20260808 04:44:51.267128 16400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:51.254571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59148 (local address 127.12.148.124:33615)
0808 04:44:51.254935 (+ 364us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:51.254950 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:51.254984 (+ 34us) server_negotiation.cc:407] Connection header received
0808 04:44:51.255620 (+ 636us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:51.255636 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:51.255984 (+ 348us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:51.256249 (+ 265us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:51.257093 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:51.258121 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:51.259269 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:51.259714 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:51.259823 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:51.262794 (+ 2971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:51.262800 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:51.262820 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:51.262850 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:51.264364 (+ 1514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:51.264795 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:51.264801 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:51.264813 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:51.264956 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:51.265211 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:51.265213 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:51.265214 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:51.265703 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:51.265889 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:51.266119 (+ 230us) server_negotiation.cc:299] Negotiation successful
0808 04:44:51.266361 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":233,"thread_start_us":103,"threads_started":1}
I20260808 04:44:51.270192 16176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:51.261931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39292 (local address 127.12.148.126:41597)
0808 04:44:51.262048 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:51.262051 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:51.262429 (+ 378us) server_negotiation.cc:407] Connection header received
0808 04:44:51.262543 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:51.262546 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:51.262595 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:51.262700 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:51.263313 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:51.263788 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:51.264636 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:51.264920 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:51.265031 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:51.267164 (+ 2133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:51.267168 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:51.267171 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:51.267198 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:51.268541 (+ 1343us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:51.268987 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:51.268990 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:51.268992 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:51.269071 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:51.269341 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:51.269344 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:51.269346 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:51.269535 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:51.269626 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:51.269987 (+ 361us) server_negotiation.cc:299] Negotiation successful
0808 04:44:51.270081 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 04:44:51.270318 16402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:51.261889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.126:41597 (local address 127.0.0.1:39292)
0808 04:44:51.262307 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:51.262349 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:51.262462 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:51.262753 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:51.262757 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:51.263076 (+ 319us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:51.263193 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:51.263198 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:51.263896 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:51.263898 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:51.264514 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:51.264524 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:51.265036 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:51.265039 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:51.265155 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:51.265608 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:51.265640 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:51.267030 (+ 1390us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:51.268643 (+ 1613us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:51.268650 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:51.268655 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:51.268888 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:51.269160 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:51.269163 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:51.269165 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:51.269256 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:51.269680 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:51.269687 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:51.269793 (+ 106us) client_negotiation.cc:769] Sending connection context
0808 04:44:51.269923 (+ 130us) client_negotiation.cc:240] Negotiation successful
0808 04:44:51.270094 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"spinlock_wait_cycles":3200,"thread_start_us":149,"threads_started":1}
I20260808 04:44:51.271338 16395 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.148.125" port: 42007 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 04:44:51 dist-test-slave-t7g5 krb5kdc[16051](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164290, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.148.126@KRBTEST.COM
Aug 08 04:44:51 dist-test-slave-t7g5 krb5kdc[16051](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164291, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.124@KRBTEST.COM for kudu/127.12.148.125@KRBTEST.COM
I20260808 04:44:51.278228 16403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:51.269349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39308 (local address 127.12.148.126:41597)
0808 04:44:51.269706 (+ 357us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:51.269713 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:51.269725 (+ 12us) server_negotiation.cc:407] Connection header received
0808 04:44:51.269750 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:51.269752 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:51.269784 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:51.269855 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:51.270544 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:51.271196 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:51.272093 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:51.272401 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:51.272476 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:51.275055 (+ 2579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:51.275058 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:51.275060 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:51.275081 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:51.276566 (+ 1485us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:51.276922 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:51.276925 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:51.276927 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:51.277007 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:51.277252 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:51.277256 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:51.277257 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:51.277436 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:51.277634 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:51.277807 (+ 173us) server_negotiation.cc:299] Negotiation successful
0808 04:44:51.277926 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270,"thread_start_us":144,"threads_started":1}
I20260808 04:44:51.279392 16402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:51.271783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.125:42007 (local address 127.0.0.1:44210)
0808 04:44:51.271917 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:51.271930 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:51.271992 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:51.272205 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:51.272207 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:51.272331 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:51.272421 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:51.272426 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:51.273265 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:51.273269 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:51.274060 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:51.274070 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:51.274633 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:51.274637 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:51.274742 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:51.275128 (+ 386us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:51.275140 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:51.276326 (+ 1186us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:51.277872 (+ 1546us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:51.277875 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:51.277877 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:51.278118 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:51.278414 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:51.278417 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:51.278419 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:51.278510 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:51.278935 (+ 425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:51.278937 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:51.279028 (+ 91us) client_negotiation.cc:769] Sending connection context
0808 04:44:51.279118 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 04:44:51.279243 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":78}
I20260808 04:44:51.279769 16288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:51.271891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44210 (local address 127.12.148.125:42007)
0808 04:44:51.272003 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:51.272007 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:51.272022 (+ 15us) server_negotiation.cc:407] Connection header received
0808 04:44:51.272060 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:51.272063 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:51.272109 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:51.272186 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:51.272535 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:51.273157 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:51.274180 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:51.274529 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:51.274619 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:51.276456 (+ 1837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:51.276459 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:51.276461 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:51.276487 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:51.277746 (+ 1259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:51.278208 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:51.278211 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:51.278213 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:51.278306 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:51.278601 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:51.278605 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:51.278607 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:51.278824 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:51.278919 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:51.279243 (+ 324us) server_negotiation.cc:299] Negotiation successful
0808 04:44:51.279356 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 04:44:51.280376 16395 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.148.124" port: 33615 } has no permanent_uuid. Determining permanent_uuid...
I20260808 04:44:51.281724 16280 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.148.124" port: 33615 } attempt: 3
Aug 08 04:44:51 dist-test-slave-t7g5 krb5kdc[16051](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164290, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.148.125@KRBTEST.COM
Aug 08 04:44:51 dist-test-slave-t7g5 krb5kdc[16051](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164291, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.124@KRBTEST.COM for kudu/127.12.148.124@KRBTEST.COM
I20260808 04:44:51.287374 16172 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.148.124" port: 33615 } attempt: 3
Aug 08 04:44:51 dist-test-slave-t7g5 krb5kdc[16051](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164290, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.125@KRBTEST.COM for kudu/127.12.148.124@KRBTEST.COM
I20260808 04:44:51.288988 16402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:51.280860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:33615 (local address 127.0.0.1:59154)
0808 04:44:51.280966 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:51.280977 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:51.281046 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:51.281234 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:51.281237 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:51.281378 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:51.281441 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:51.281446 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:51.282300 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:51.282302 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:51.282903 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:51.282912 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:51.283382 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:51.283386 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:51.283488 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:51.284084 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:51.284096 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:51.285696 (+ 1600us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:51.287369 (+ 1673us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:51.287372 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:51.287374 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:51.287650 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:51.287938 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:51.287941 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:51.287943 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:51.288040 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:51.288511 (+ 471us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:51.288513 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:51.288588 (+ 75us) client_negotiation.cc:769] Sending connection context
0808 04:44:51.288676 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 04:44:51.288800 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40,"mutex_wait_us":1}
I20260808 04:44:51.289266 16407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:51.279388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44214 (local address 127.12.148.125:42007)
0808 04:44:51.279772 (+ 384us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:51.279781 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:51.279795 (+ 14us) server_negotiation.cc:407] Connection header received
0808 04:44:51.279828 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:51.279831 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:51.279874 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:51.279961 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:51.280550 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:51.281235 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:51.282154 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:51.282521 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:51.282621 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:51.285898 (+ 3277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:51.285901 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:51.285904 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:51.285930 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:51.287550 (+ 1620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:51.287988 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:51.287991 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:51.287993 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:51.288071 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:51.288364 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:51.288367 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:51.288369 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:51.288592 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:51.288817 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:51.288974 (+ 157us) server_negotiation.cc:299] Negotiation successful
0808 04:44:51.289099 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":126,"threads_started":1}
I20260808 04:44:51.289502 16400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:51.280979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59154 (local address 127.12.148.124:33615)
0808 04:44:51.281078 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:51.281083 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:51.281094 (+ 11us) server_negotiation.cc:407] Connection header received
0808 04:44:51.281121 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:51.281123 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:51.281156 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:51.281213 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:51.281536 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:51.282196 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:51.283004 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:51.283292 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:51.283386 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:51.285836 (+ 2450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:51.285839 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:51.285842 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:51.285865 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:51.287263 (+ 1398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:51.287731 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:51.287735 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:51.287737 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:51.287834 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:51.288186 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:51.288189 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:51.288191 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:51.288391 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:51.288479 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:51.289214 (+ 735us) server_negotiation.cc:299] Negotiation successful
0808 04:44:51.289354 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":35,"server-negotiator.queue_time_us":36,"spinlock_wait_cycles":896}
I20260808 04:44:51.293356 16395 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0c94bb459bb4f3d839526a46bdca8a2: Bootstrap starting.
I20260808 04:44:51.293458 12881 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
Aug 08 04:44:51 dist-test-slave-t7g5 krb5kdc[16051](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786164290, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.148.126@KRBTEST.COM for kudu/127.12.148.124@KRBTEST.COM
I20260808 04:44:51.295109 16284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:51.282088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:33615 (local address 127.0.0.1:59168)
0808 04:44:51.282231 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:51.282243 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:51.282304 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:51.283705 (+ 1401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:51.283709 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:51.283881 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:51.283959 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:51.283964 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:51.284945 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:51.284948 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:51.285505 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:51.285514 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:51.286480 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:51.286484 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:51.286569 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:51.287035 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:51.287050 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:51.289006 (+ 1956us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:51.293262 (+ 4256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:51.293266 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:51.293268 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:51.293555 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:51.293918 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:51.293922 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:51.293924 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:51.294015 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:51.294527 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:51.294530 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:51.294636 (+ 106us) client_negotiation.cc:769] Sending connection context
0808 04:44:51.294741 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 04:44:51.294938 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":84}
I20260808 04:44:51.295645 16408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:51.282468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59168 (local address 127.12.148.124:33615)
0808 04:44:51.283495 (+ 1027us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:51.283499 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:51.283513 (+ 14us) server_negotiation.cc:407] Connection header received
0808 04:44:51.283545 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:51.283548 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:51.283590 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:51.283682 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:51.284059 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:51.284831 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:51.285610 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:51.285975 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:51.286670 (+ 695us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:51.289143 (+ 2473us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:51.289146 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:51.289149 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:51.289170 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:51.293133 (+ 3963us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:51.293704 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:51.293708 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:51.293710 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:51.293805 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:51.294121 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:51.294124 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:51.294126 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:51.294372 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:51.294473 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:51.295312 (+ 839us) server_negotiation.cc:299] Negotiation successful
0808 04:44:51.295442 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":621,"thread_start_us":109,"threads_started":1}
I20260808 04:44:51.296362 16395 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c0c94bb459bb4f3d839526a46bdca8a2: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:51.294734 16137 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "eb5bffbd052b428fba667e27f1d12a32"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39308
I20260808 04:44:51.297273 16395 log.cc:824] T 00000000000000000000000000000000 P c0c94bb459bb4f3d839526a46bdca8a2: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:51.297597 16400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:51.288401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59180 (local address 127.12.148.124:33615)
0808 04:44:51.289638 (+ 1237us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:51.289642 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:51.289678 (+ 36us) server_negotiation.cc:407] Connection header received
0808 04:44:51.289707 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:51.289709 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:51.289748 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:51.290305 (+ 557us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:51.290398 (+ 93us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:51.290863 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:51.292048 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:51.292275 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:51.292361 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:51.294522 (+ 2161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:51.294526 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:51.294528 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:51.294549 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:51.295993 (+ 1444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:51.296391 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:51.296395 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:51.296397 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:51.296472 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:51.296723 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:51.296726 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:51.296728 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:51.296979 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:51.297070 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:51.297352 (+ 282us) server_negotiation.cc:299] Negotiation successful
0808 04:44:51.297453 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1186,"thread_start_us":101,"threads_started":1}
I20260808 04:44:51.297607 16175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:51.288369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.148.124:33615 (local address 127.0.0.1:59180)
0808 04:44:51.288580 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0808 04:44:51.288594 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 04:44:51.288672 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 04:44:51.289888 (+ 1216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 04:44:51.289892 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 04:44:51.290079 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0808 04:44:51.290194 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:51.290202 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:51.290998 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:51.291001 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:51.291937 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 04:44:51.291951 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 04:44:51.292375 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 04:44:51.292379 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 04:44:51.292460 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:51.292869 (+ 409us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 04:44:51.292884 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 04:44:51.294380 (+ 1496us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 04:44:51.296101 (+ 1721us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:51.296104 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:51.296106 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:51.296301 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:51.296555 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 04:44:51.296558 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 04:44:51.296560 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 04:44:51.296642 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 04:44:51.297072 (+ 430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 04:44:51.297076 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 04:44:51.297195 (+ 119us) client_negotiation.cc:769] Sending connection context
0808 04:44:51.297290 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 04:44:51.297441 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133}
I20260808 04:44:51.299549 16395 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0c94bb459bb4f3d839526a46bdca8a2: No bootstrap required, opened a new log
I20260808 04:44:51.299975 16280 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd8db1c08be24bbda7392e214a2d5c29: Bootstrap starting.
I20260808 04:44:51.300710 16172 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb5bffbd052b428fba667e27f1d12a32: Bootstrap starting.
I20260808 04:44:51.302321 16280 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cd8db1c08be24bbda7392e214a2d5c29: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:51.303194 16172 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eb5bffbd052b428fba667e27f1d12a32: Neither blocks nor log segments found. Creating new log.
I20260808 04:44:51.303174 16280 log.cc:824] T 00000000000000000000000000000000 P cd8db1c08be24bbda7392e214a2d5c29: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:51.303575 16395 raft_consensus.cc:348] T 00000000000000000000000000000000 P c0c94bb459bb4f3d839526a46bdca8a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb5bffbd052b428fba667e27f1d12a32" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41597 } } peers { permanent_uuid: "cd8db1c08be24bbda7392e214a2d5c29" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 42007 } } peers { permanent_uuid: "c0c94bb459bb4f3d839526a46bdca8a2" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 33615 } }
I20260808 04:44:51.303830 16395 raft_consensus.cc:729] T 00000000000000000000000000000000 P c0c94bb459bb4f3d839526a46bdca8a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0c94bb459bb4f3d839526a46bdca8a2, State: Initialized, Role: FOLLOWER
I20260808 04:44:51.303982 16172 log.cc:824] T 00000000000000000000000000000000 P eb5bffbd052b428fba667e27f1d12a32: Log is configured to *not* fsync() on all Append() calls
I20260808 04:44:51.304167 16395 consensus_queue.cc:260] T 00000000000000000000000000000000 P c0c94bb459bb4f3d839526a46bdca8a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb5bffbd052b428fba667e27f1d12a32" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41597 } } peers { permanent_uuid: "cd8db1c08be24bbda7392e214a2d5c29" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 42007 } } peers { permanent_uuid: "c0c94bb459bb4f3d839526a46bdca8a2" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 33615 } }
I20260808 04:44:51.304936 16417 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0c94bb459bb4f3d839526a46bdca8a2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb5bffbd052b428fba667e27f1d12a32" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41597 } } peers { permanent_uuid: "cd8db1c08be24bbda7392e214a2d5c29" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 42007 } } peers { permanent_uuid: "c0c94bb459bb4f3d839526a46bdca8a2" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 33615 } } }
I20260808 04:44:51.305070 16417 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0c94bb459bb4f3d839526a46bdca8a2 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:44:51.305411 16280 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd8db1c08be24bbda7392e214a2d5c29: No bootstrap required, opened a new log
I20260808 04:44:51.305517 16395 sys_catalog.cc:564] T 00000000000000000000000000000000 P c0c94bb459bb4f3d839526a46bdca8a2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:51.306119 16172 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb5bffbd052b428fba667e27f1d12a32: No bootstrap required, opened a new log
I20260808 04:44:51.309062 16172 raft_consensus.cc:348] T 00000000000000000000000000000000 P eb5bffbd052b428fba667e27f1d12a32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb5bffbd052b428fba667e27f1d12a32" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41597 } } peers { permanent_uuid: "cd8db1c08be24bbda7392e214a2d5c29" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 42007 } } peers { permanent_uuid: "c0c94bb459bb4f3d839526a46bdca8a2" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 33615 } }
I20260808 04:44:51.309279 16172 raft_consensus.cc:729] T 00000000000000000000000000000000 P eb5bffbd052b428fba667e27f1d12a32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb5bffbd052b428fba667e27f1d12a32, State: Initialized, Role: FOLLOWER
I20260808 04:44:51.309530 16280 raft_consensus.cc:348] T 00000000000000000000000000000000 P cd8db1c08be24bbda7392e214a2d5c29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb5bffbd052b428fba667e27f1d12a32" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41597 } } peers { permanent_uuid: "cd8db1c08be24bbda7392e214a2d5c29" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 42007 } } peers { permanent_uuid: "c0c94bb459bb4f3d839526a46bdca8a2" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 33615 } }
I20260808 04:44:51.310074 16280 raft_consensus.cc:729] T 00000000000000000000000000000000 P cd8db1c08be24bbda7392e214a2d5c29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd8db1c08be24bbda7392e214a2d5c29, State: Initialized, Role: FOLLOWER
W20260808 04:44:51.310221 16434 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c0c94bb459bb4f3d839526a46bdca8a2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 04:44:51.310290 16434 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 04:44:51.310380 16280 consensus_queue.cc:260] T 00000000000000000000000000000000 P cd8db1c08be24bbda7392e214a2d5c29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb5bffbd052b428fba667e27f1d12a32" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41597 } } peers { permanent_uuid: "cd8db1c08be24bbda7392e214a2d5c29" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 42007 } } peers { permanent_uuid: "c0c94bb459bb4f3d839526a46bdca8a2" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 33615 } }
I20260808 04:44:51.309590 16172 consensus_queue.cc:260] T 00000000000000000000000000000000 P eb5bffbd052b428fba667e27f1d12a32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb5bffbd052b428fba667e27f1d12a32" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41597 } } peers { permanent_uuid: "cd8db1c08be24bbda7392e214a2d5c29" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 42007 } } peers { permanent_uuid: "c0c94bb459bb4f3d839526a46bdca8a2" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 33615 } }
I20260808 04:44:51.311785 16280 sys_catalog.cc:564] T 00000000000000000000000000000000 P cd8db1c08be24bbda7392e214a2d5c29 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:51.312291 16137 raft_consensus.cc:482] T 00000000000000000000000000000000 P eb5bffbd052b428fba667e27f1d12a32 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 04:44:51.312423 16137 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eb5bffbd052b428fba667e27f1d12a32 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:51.314530 16137 raft_consensus.cc:504] T 00000000000000000000000000000000 P eb5bffbd052b428fba667e27f1d12a32 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb5bffbd052b428fba667e27f1d12a32" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41597 } } peers { permanent_uuid: "cd8db1c08be24bbda7392e214a2d5c29" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 42007 } } peers { permanent_uuid: "c0c94bb459bb4f3d839526a46bdca8a2" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 33615 } }
I20260808 04:44:51.311285 16292 master_runner.cc:186] Error getting master registration for 127.12.148.126:41597: OK, instance_id { permanent_uuid: "eb5bffbd052b428fba667e27f1d12a32" instance_seqno: 1786164290824226 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 04:44:51.314769 16292 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 04:44:51.315302 16437 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd8db1c08be24bbda7392e214a2d5c29 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb5bffbd052b428fba667e27f1d12a32" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41597 } } peers { permanent_uuid: "cd8db1c08be24bbda7392e214a2d5c29" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 42007 } } peers { permanent_uuid: "c0c94bb459bb4f3d839526a46bdca8a2" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 33615 } } }
I20260808 04:44:51.315474 16437 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd8db1c08be24bbda7392e214a2d5c29 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:44:51.316125 16137 leader_election.cc:288] T 00000000000000000000000000000000 P eb5bffbd052b428fba667e27f1d12a32 [CANDIDATE]: Term 1 election: Requested vote from peers cd8db1c08be24bbda7392e214a2d5c29 (127.12.148.125:42007), c0c94bb459bb4f3d839526a46bdca8a2 (127.12.148.124:33615)
I20260808 04:44:51.312225 16172 sys_catalog.cc:564] T 00000000000000000000000000000000 P eb5bffbd052b428fba667e27f1d12a32 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 04:44:51.316510 16244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "eb5bffbd052b428fba667e27f1d12a32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "cd8db1c08be24bbda7392e214a2d5c29"
I20260808 04:44:51.316774 16244 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cd8db1c08be24bbda7392e214a2d5c29 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:51.318279 16244 raft_consensus.cc:2454] T 00000000000000000000000000000000 P cd8db1c08be24bbda7392e214a2d5c29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb5bffbd052b428fba667e27f1d12a32 in term 1.
I20260808 04:44:51.315526 16182 master_runner.cc:186] Error getting master registration for 127.12.148.126:41597: OK, instance_id { permanent_uuid: "eb5bffbd052b428fba667e27f1d12a32" instance_seqno: 1786164290824226 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 04:44:51.318921 16182 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 04:44:51.319440 16360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "eb5bffbd052b428fba667e27f1d12a32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c0c94bb459bb4f3d839526a46bdca8a2"
I20260808 04:44:51.319718 16360 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c0c94bb459bb4f3d839526a46bdca8a2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 04:44:51.321180 16360 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c0c94bb459bb4f3d839526a46bdca8a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb5bffbd052b428fba667e27f1d12a32 in term 1.
I20260808 04:44:51.320580 16098 leader_election.cc:302] T 00000000000000000000000000000000 P eb5bffbd052b428fba667e27f1d12a32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd8db1c08be24bbda7392e214a2d5c29, eb5bffbd052b428fba667e27f1d12a32; no voters:
W20260808 04:44:51.320832 16103 tablet.cc:2369] T 00000000000000000000000000000000 P eb5bffbd052b428fba667e27f1d12a32: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 04:44:51.322788 16452 catalog_manager.cc:1558] T 00000000000000000000000000000000 P cd8db1c08be24bbda7392e214a2d5c29: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 04:44:51.322855 16452 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 04:44:51.323223 16438 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb5bffbd052b428fba667e27f1d12a32 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb5bffbd052b428fba667e27f1d12a32" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41597 } } peers { permanent_uuid: "cd8db1c08be24bbda7392e214a2d5c29" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 42007 } } peers { permanent_uuid: "c0c94bb459bb4f3d839526a46bdca8a2" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 33615 } } }
I20260808 04:44:51.323334 16438 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb5bffbd052b428fba667e27f1d12a32 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:44:51.323419 16438 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eb5bffbd052b428fba667e27f1d12a32 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 04:44:51.323479 16438 raft_consensus.cc:686] T 00000000000000000000000000000000 P eb5bffbd052b428fba667e27f1d12a32 [term 1 LEADER]: Becoming Leader. State: Replica: eb5bffbd052b428fba667e27f1d12a32, State: Running, Role: LEADER
I20260808 04:44:51.323791 16438 consensus_queue.cc:237] T 00000000000000000000000000000000 P eb5bffbd052b428fba667e27f1d12a32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb5bffbd052b428fba667e27f1d12a32" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41597 } } peers { permanent_uuid: "cd8db1c08be24bbda7392e214a2d5c29" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 42007 } } peers { permanent_uuid: "c0c94bb459bb4f3d839526a46bdca8a2" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 33615 } }
I20260808 04:44:51.326859 16476 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb5bffbd052b428fba667e27f1d12a32 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eb5bffbd052b428fba667e27f1d12a32. Latest consensus state: current_term: 1 leader_uuid: "eb5bffbd052b428fba667e27f1d12a32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb5bffbd052b428fba667e27f1d12a32" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41597 } } peers { permanent_uuid: "cd8db1c08be24bbda7392e214a2d5c29" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 42007 } } peers { permanent_uuid: "c0c94bb459bb4f3d839526a46bdca8a2" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 33615 } } }
I20260808 04:44:51.327001 16476 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb5bffbd052b428fba667e27f1d12a32 [sys.catalog]: This master's current role is: LEADER
W20260808 04:44:51.337087 16469 catalog_manager.cc:1558] T 00000000000000000000000000000000 P eb5bffbd052b428fba667e27f1d12a32: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 04:44:51.337175 16469 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 04:44:51.339020 16484 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 04:44:51.340044 16484 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 04:44:51.342226 16407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:51.325486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44220 (local address 127.12.148.125:42007)
0808 04:44:51.325596 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:51.325599 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:51.326467 (+ 868us) server_negotiation.cc:407] Connection header received
0808 04:44:51.327276 (+ 809us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:51.327280 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:51.327335 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:51.327386 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:51.331102 (+ 3716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:51.331775 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:51.333773 (+ 1998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:51.334148 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:51.334231 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:51.336704 (+ 2473us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:51.336708 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:51.336711 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:51.336738 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:51.338713 (+ 1975us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:51.339262 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:51.339265 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:51.339267 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:51.339361 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:51.339698 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:51.339701 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:51.339703 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:51.339947 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:51.340078 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:51.341937 (+ 1859us) server_negotiation.cc:299] Negotiation successful
0808 04:44:51.342070 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 04:44:51.344267 16403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:51.325028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39316 (local address 127.12.148.126:41597)
0808 04:44:51.325131 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:51.325136 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:51.326104 (+ 968us) server_negotiation.cc:407] Connection header received
0808 04:44:51.326564 (+ 460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:51.326569 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:51.326624 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:51.326679 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:51.329279 (+ 2600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:51.330025 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:51.332794 (+ 2769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:51.333145 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:51.333226 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:51.337092 (+ 3866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:51.337096 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:51.337099 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:51.337127 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:51.339806 (+ 2679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:51.340543 (+ 737us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:51.340547 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:51.340549 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:51.340639 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:51.341189 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:51.341192 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:51.341194 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:51.341413 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:51.341512 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:51.344002 (+ 2490us) server_negotiation.cc:299] Negotiation successful
0808 04:44:51.344121 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 04:44:51.350893 16400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:51.324523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59196 (local address 127.12.148.124:33615)
0808 04:44:51.324646 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:51.324651 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:51.342385 (+ 17734us) server_negotiation.cc:407] Connection header received
0808 04:44:51.342585 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:51.342589 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:51.342638 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:51.342687 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:51.343461 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:51.344122 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:51.345157 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:51.345459 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:51.345537 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:51.347233 (+ 1696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 04:44:51.347236 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 04:44:51.347239 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 04:44:51.347266 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 04:44:51.348900 (+ 1634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:51.349439 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:51.349443 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:51.349445 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:51.349539 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 04:44:51.349885 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 04:44:51.349888 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 04:44:51.349890 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 04:44:51.350116 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 04:44:51.350220 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:51.350607 (+ 387us) server_negotiation.cc:299] Negotiation successful
0808 04:44:51.350728 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 04:44:51.358686 16360 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c0c94bb459bb4f3d839526a46bdca8a2 [term 1 FOLLOWER]: Refusing update from remote peer eb5bffbd052b428fba667e27f1d12a32: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:44:51.358804 16244 raft_consensus.cc:1261] T 00000000000000000000000000000000 P cd8db1c08be24bbda7392e214a2d5c29 [term 1 FOLLOWER]: Refusing update from remote peer eb5bffbd052b428fba667e27f1d12a32: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 04:44:51.359401 16438 consensus_queue.cc:1035] T 00000000000000000000000000000000 P eb5bffbd052b428fba667e27f1d12a32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd8db1c08be24bbda7392e214a2d5c29" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 42007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:44:51.359611 16476 consensus_queue.cc:1035] T 00000000000000000000000000000000 P eb5bffbd052b428fba667e27f1d12a32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0c94bb459bb4f3d839526a46bdca8a2" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 04:44:51.363787 16437 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd8db1c08be24bbda7392e214a2d5c29 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eb5bffbd052b428fba667e27f1d12a32. Latest consensus state: current_term: 1 leader_uuid: "eb5bffbd052b428fba667e27f1d12a32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb5bffbd052b428fba667e27f1d12a32" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41597 } } peers { permanent_uuid: "cd8db1c08be24bbda7392e214a2d5c29" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 42007 } } peers { permanent_uuid: "c0c94bb459bb4f3d839526a46bdca8a2" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 33615 } } }
I20260808 04:44:51.363814 16417 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0c94bb459bb4f3d839526a46bdca8a2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eb5bffbd052b428fba667e27f1d12a32. Latest consensus state: current_term: 1 leader_uuid: "eb5bffbd052b428fba667e27f1d12a32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb5bffbd052b428fba667e27f1d12a32" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41597 } } peers { permanent_uuid: "cd8db1c08be24bbda7392e214a2d5c29" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 42007 } } peers { permanent_uuid: "c0c94bb459bb4f3d839526a46bdca8a2" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 33615 } } }
I20260808 04:44:51.363907 16437 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd8db1c08be24bbda7392e214a2d5c29 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:44:51.363916 16417 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0c94bb459bb4f3d839526a46bdca8a2 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:44:51.367148 16476 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb5bffbd052b428fba667e27f1d12a32 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "eb5bffbd052b428fba667e27f1d12a32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb5bffbd052b428fba667e27f1d12a32" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41597 } } peers { permanent_uuid: "cd8db1c08be24bbda7392e214a2d5c29" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 42007 } } peers { permanent_uuid: "c0c94bb459bb4f3d839526a46bdca8a2" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 33615 } } }
I20260808 04:44:51.367276 16476 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb5bffbd052b428fba667e27f1d12a32 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:51.368324 16437 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd8db1c08be24bbda7392e214a2d5c29 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "eb5bffbd052b428fba667e27f1d12a32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb5bffbd052b428fba667e27f1d12a32" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41597 } } peers { permanent_uuid: "cd8db1c08be24bbda7392e214a2d5c29" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 42007 } } peers { permanent_uuid: "c0c94bb459bb4f3d839526a46bdca8a2" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 33615 } } }
I20260808 04:44:51.368455 16437 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd8db1c08be24bbda7392e214a2d5c29 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:44:51.368801 16486 mvcc.cc:205] Tried to move back new op lower bound from 7316128937396772864 to 7316128937266073600. Current Snapshot: MvccSnapshot[applied={T|T < 7316128937396772864}]
I20260808 04:44:51.370998 16489 mvcc.cc:205] Tried to move back new op lower bound from 7316128937396772864 to 7316128937266073600. Current Snapshot: MvccSnapshot[applied={T|T < 7316128937396772864}]
I20260808 04:44:51.372752 16484 catalog_manager.cc:1347] Generated new cluster ID: 911bb0df0cf34994ba53e17b5a25d324
I20260808 04:44:51.372822 16484 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 04:44:51.382333 16438 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb5bffbd052b428fba667e27f1d12a32 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "eb5bffbd052b428fba667e27f1d12a32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb5bffbd052b428fba667e27f1d12a32" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41597 } } peers { permanent_uuid: "cd8db1c08be24bbda7392e214a2d5c29" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 42007 } } peers { permanent_uuid: "c0c94bb459bb4f3d839526a46bdca8a2" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 33615 } } }
I20260808 04:44:51.382488 16438 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb5bffbd052b428fba667e27f1d12a32 [sys.catalog]: This master's current role is: LEADER
I20260808 04:44:51.383543 16417 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0c94bb459bb4f3d839526a46bdca8a2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "eb5bffbd052b428fba667e27f1d12a32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb5bffbd052b428fba667e27f1d12a32" member_type: VOTER last_known_addr { host: "127.12.148.126" port: 41597 } } peers { permanent_uuid: "cd8db1c08be24bbda7392e214a2d5c29" member_type: VOTER last_known_addr { host: "127.12.148.125" port: 42007 } } peers { permanent_uuid: "c0c94bb459bb4f3d839526a46bdca8a2" member_type: VOTER last_known_addr { host: "127.12.148.124" port: 33615 } } }
I20260808 04:44:51.383657 16417 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0c94bb459bb4f3d839526a46bdca8a2 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 04:44:51.403744 16484 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 04:44:51.405190 16484 catalog_manager.cc:1504] Loading token signing keys...
I20260808 04:44:51.423249 16484 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eb5bffbd052b428fba667e27f1d12a32: Generated new TSK 0
I20260808 04:44:51.424181 16484 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 04:44:51.462127 16403 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:44:51.459250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39330 (local address 127.12.148.126:41597)
0808 04:44:51.459377 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:51.459381 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:51.460727 (+ 1346us) server_negotiation.cc:407] Connection header received
0808 04:44:51.461152 (+ 425us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:51.461155 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:51.461213 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:51.461269 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:51.461980 (+ 711us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39330: BlockingRecv error: recv got EOF from 127.0.0.1:39330 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260808 04:44:51.463297 16407 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:44:51.460016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44232 (local address 127.12.148.125:42007)
0808 04:44:51.460134 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:51.460139 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:51.461062 (+ 923us) server_negotiation.cc:407] Connection header received
0808 04:44:51.462517 (+ 1455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:51.462520 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:51.462573 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:51.462621 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:51.463175 (+ 554us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44232: BlockingRecv error: recv got EOF from 127.0.0.1:44232 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260808 04:44:51.465579 16400 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:44:51.464263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59206 (local address 127.12.148.124:33615)
0808 04:44:51.464377 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:51.464381 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:51.464690 (+ 309us) server_negotiation.cc:407] Connection header received
0808 04:44:51.464848 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:51.464851 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:51.464900 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:51.464949 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:51.465455 (+ 506us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59206: BlockingRecv error: recv got EOF from 127.0.0.1:59206 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260808 04:44:51.470250 16407 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:44:51.468602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44240 (local address 127.12.148.125:42007)
0808 04:44:51.468711 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:51.468715 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:51.469150 (+ 435us) server_negotiation.cc:407] Connection header received
0808 04:44:51.469367 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:51.469371 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:51.469462 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:51.469516 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:51.470135 (+ 619us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44240: BlockingRecv error: recv got EOF from 127.0.0.1:44240 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260808 04:44:51.475445 16407 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:44:51.473910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44256 (local address 127.12.148.125:42007)
0808 04:44:51.474017 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:51.474020 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:51.474547 (+ 527us) server_negotiation.cc:407] Connection header received
0808 04:44:51.474721 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:51.474725 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:51.474774 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:51.474822 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:51.475331 (+ 509us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44256: BlockingRecv error: recv got EOF from 127.0.0.1:44256 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260808 04:44:51.480803 16407 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:44:51.479320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44264 (local address 127.12.148.125:42007)
0808 04:44:51.479430 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:51.479433 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:51.479947 (+ 514us) server_negotiation.cc:407] Connection header received
0808 04:44:51.480114 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:51.480117 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:51.480162 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:51.480209 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:51.480700 (+ 491us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44264: BlockingRecv error: recv got EOF from 127.0.0.1:44264 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260808 04:44:51.488372 16407 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:44:51.486794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44276 (local address 127.12.148.125:42007)
0808 04:44:51.486927 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:51.486931 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:51.487466 (+ 535us) server_negotiation.cc:407] Connection header received
0808 04:44:51.487652 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:51.487656 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:51.487705 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:51.487755 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:51.488272 (+ 517us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44276: BlockingRecv error: recv got EOF from 127.0.0.1:44276 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260808 04:44:51.500468 16407 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:44:51.498733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44286 (local address 127.12.148.125:42007)
0808 04:44:51.498851 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:51.498855 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:51.499437 (+ 582us) server_negotiation.cc:407] Connection header received
0808 04:44:51.499651 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:51.499654 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:51.499707 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:51.499758 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:51.500331 (+ 573us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44286: BlockingRecv error: recv got EOF from 127.0.0.1:44286 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260808 04:44:51.520960 16407 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:44:51.519276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44292 (local address 127.12.148.125:42007)
0808 04:44:51.519422 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:51.519427 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:51.520015 (+ 588us) server_negotiation.cc:407] Connection header received
0808 04:44:51.520155 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:51.520158 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:51.520224 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:51.520326 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:51.520829 (+ 503us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44292: BlockingRecv error: recv got EOF from 127.0.0.1:44292 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260808 04:44:51.556068 16407 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:44:51.554929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44304 (local address 127.12.148.125:42007)
0808 04:44:51.555076 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:51.555081 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:51.555174 (+ 93us) server_negotiation.cc:407] Connection header received
0808 04:44:51.555325 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:51.555328 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:51.555378 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:51.555447 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:51.555946 (+ 499us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44304: BlockingRecv error: recv got EOF from 127.0.0.1:44304 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260808 04:44:51.623219 16407 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:44:51.622107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44308 (local address 127.12.148.125:42007)
0808 04:44:51.622261 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:51.622265 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:51.622394 (+ 129us) server_negotiation.cc:407] Connection header received
0808 04:44:51.622548 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:51.622551 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:51.622598 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:51.622666 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:51.623117 (+ 451us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44308: BlockingRecv error: recv got EOF from 127.0.0.1:44308 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260808 04:44:51.754478 16407 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:44:51.753385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44322 (local address 127.12.148.125:42007)
0808 04:44:51.753540 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:51.753544 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:51.753662 (+ 118us) server_negotiation.cc:407] Connection header received
0808 04:44:51.753829 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:51.753831 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:51.753880 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:51.753943 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:51.754337 (+ 394us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44322: BlockingRecv error: recv got EOF from 127.0.0.1:44322 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260808 04:44:52.013923 16407 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 04:44:52.012742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44334 (local address 127.12.148.125:42007)
0808 04:44:52.012872 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:52.012877 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:52.012983 (+ 106us) server_negotiation.cc:407] Connection header received
0808 04:44:52.013141 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:52.013145 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:52.013199 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:52.013269 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 04:44:52.013798 (+ 529us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44334: BlockingRecv error: recv got EOF from 127.0.0.1:44334 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 04:44:52.311568 16434 catalog_manager.cc:1259] Loaded cluster ID: 911bb0df0cf34994ba53e17b5a25d324
I20260808 04:44:52.311661 16434 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c0c94bb459bb4f3d839526a46bdca8a2: loading cluster ID for follower catalog manager: success
I20260808 04:44:52.313637 16434 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c0c94bb459bb4f3d839526a46bdca8a2: acquiring CA information for follower catalog manager: success
I20260808 04:44:52.314940 16434 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c0c94bb459bb4f3d839526a46bdca8a2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 04:44:52.324312 16452 catalog_manager.cc:1259] Loaded cluster ID: 911bb0df0cf34994ba53e17b5a25d324
I20260808 04:44:52.324401 16452 catalog_manager.cc:1552] T 00000000000000000000000000000000 P cd8db1c08be24bbda7392e214a2d5c29: loading cluster ID for follower catalog manager: success
I20260808 04:44:52.326107 16452 catalog_manager.cc:1574] T 00000000000000000000000000000000 P cd8db1c08be24bbda7392e214a2d5c29: acquiring CA information for follower catalog manager: success
I20260808 04:44:52.327425 16452 catalog_manager.cc:1602] T 00000000000000000000000000000000 P cd8db1c08be24bbda7392e214a2d5c29: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 04:44:52.531893 16601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:52.528010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44344 (local address 127.12.148.125:42007)
0808 04:44:52.528284 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:52.528290 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:52.528326 (+ 36us) server_negotiation.cc:407] Connection header received
0808 04:44:52.528511 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:52.528514 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:52.528647 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:52.528741 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:44:52.529011 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:52.529537 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:52.530429 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:52.530659 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:52.530745 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:52.531067 (+ 322us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:44:52.531497 (+ 430us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:44:52.531609 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:52.531680 (+ 71us) server_negotiation.cc:299] Negotiation successful
0808 04:44:52.531739 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":205,"thread_start_us":96,"threads_started":1}
I20260808 04:44:52.538959 16610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:52.534748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59216 (local address 127.12.148.124:33615)
0808 04:44:52.534996 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:52.535000 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:52.535089 (+ 89us) server_negotiation.cc:407] Connection header received
0808 04:44:52.535261 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:52.535264 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:52.535421 (+ 157us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:52.535561 (+ 140us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:44:52.535794 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:52.536417 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:52.537341 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:52.537724 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:52.537826 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:52.538141 (+ 315us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:44:52.538597 (+ 456us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:44:52.538693 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:52.538751 (+ 58us) server_negotiation.cc:299] Negotiation successful
0808 04:44:52.538803 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":91,"threads_started":1}
I20260808 04:44:52.545457 16610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:52.541973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59230 (local address 127.12.148.124:33615)
0808 04:44:52.542097 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:52.542100 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:52.542112 (+ 12us) server_negotiation.cc:407] Connection header received
0808 04:44:52.542151 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:52.542154 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:52.542201 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:52.542268 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:44:52.542570 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:52.543258 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:52.544337 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:52.544602 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:52.544687 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:52.545006 (+ 319us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:44:52.545072 (+ 66us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:44:52.545125 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:52.545265 (+ 140us) server_negotiation.cc:299] Negotiation successful
0808 04:44:52.545327 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 04:44:52.545630 16601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:52.542230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44356 (local address 127.12.148.125:42007)
0808 04:44:52.542355 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:52.542360 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:52.542481 (+ 121us) server_negotiation.cc:407] Connection header received
0808 04:44:52.542626 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:52.542630 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:52.542679 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:52.542751 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:44:52.542997 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:52.543619 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:52.544434 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:52.544774 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:52.544868 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:52.545169 (+ 301us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:44:52.545245 (+ 76us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:44:52.545302 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:52.545447 (+ 145us) server_negotiation.cc:299] Negotiation successful
0808 04:44:52.545501 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 04:44:52.546495 16616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 04:44:52.541644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39338 (local address 127.12.148.126:41597)
0808 04:44:52.542504 (+ 860us) server_negotiation.cc:206] Beginning negotiation
0808 04:44:52.542509 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 04:44:52.542521 (+ 12us) server_negotiation.cc:407] Connection header received
0808 04:44:52.542609 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 04:44:52.542612 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 04:44:52.542760 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 04:44:52.542881 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 04:44:52.543096 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:52.543807 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:52.544976 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 04:44:52.545298 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 04:44:52.545676 (+ 378us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 04:44:52.545827 (+ 151us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 04:44:52.546145 (+ 318us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 04:44:52.546234 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 04:44:52.546308 (+ 74us) server_negotiation.cc:299] Negotiation successful
0808 04:44:52.546364 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":763,"thread_start_us":69,"threads_started":1}
I20260808 04:44:52.549034 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 16069
I20260808 04:44:52.562518 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 16182
I20260808 04:44:52.572530 12881 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMuxZs2/build/debug/bin/kudu with pid 16292
2026-08-08T04:44:52Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3190 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6393 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (288554 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST